Fix the calculation for the direction of the listener