The ref unit test cannot be easily written to work with EIGEN_DEFAULT_TO_ROW_MAJOR