Use plugin vim-tmux-navigator

This provides seamless navigation between terminal vim and tmux. It
should not change anything for non-tmux sessions.