More tests for rotation matrix