Call the player remove code in a synchronized delay timer to stop issues with teleporting and removing arrow entities.