Prefer built-in back-i-search to zsh substring search.
Use vi mode at the prompt, remap ESC key.