Fix panning when rotate on and follow mode off