Revert "SwipeHelper: Ignore ACTION_OUTSIDE touches"

This reverts commit 0f8688b6f8232faee9e72ef2a588b25b408d4616.