Fix manual rotation so it stays in the current up vector space