Update camera's projection and frustum only when needed