InputListener: Don't restart game while a movement

if you swipe onto the button