Traverse only one direction.  Keep track of inverses so we don't
backtrack.