Only move one direction at a time once on a point