Derp, have to set the rotation after adjusting it.