If not in insert mode don't enter insert mode