Instead of adding and removing the off-keyboard gesture recognizer, let's just enable and disable it as needed.  Props @aerych