Only allow a single direction for a swipe.