We must not allow updating center if the map is moving to prevent update loop.