Small optimization to mat3x4_inverse_orthonormal to avoid a few ops.