Load the destination chunk just before teleporting the player