Nevermind, there's an easier way.

Preferences > Advanced Tab > unchecked "Allow VT100 application keypad mode."

https://github.com/robbyrussell/oh-my-zsh/issues/2654#issuecomment-61001367