Only change to remembered directory if not already in a different directory

Allows ssh -t localhost 'cd [path] && exec /bin/bash -'