fix issue 1097

at least for hotkey based swapping
https://github.com/libretro/RetroArch/issues/1097