Set vi mode for moving around.  Don't rely on the shell to do so.