Keep camera position when clearing follow with controller.