Actually construct the private pointer