Ensure manual rotate override remains relative to the user's coordinate frame (no rotation around the z-axis as we rotate)