`viewRotation3D` and `inverseViewRotation3D` are just the upper-left 3x3 of `view3D` and `inverseView3D`.