Only update FOV when the player actuall moves