Won't add same direction to the directionsQueue