Fix some determinacy bug with updating when the player isn't there