Small performance improvements

On win32 release, this should be about a ~1.2% gain (plus or minus, I don't have time atm to average.)  Nothing huge and probably smaller on Android/etc.

This does add one behavior change: it will no longer jump to an invalid address, but instead ignore it.  Since this "shouldn't happen" anyway, I'm hoping it's fine either way.

-[Unknown]