If you get the rotation, then transpose, you won't need any scratch matrices.