It does almost sound like they need to check your eyes to see if you may indeed need some prism added if your left eye seems to turn out a bit.
Of course that would be on the doctor for not catching that.