Enables swipe listening over all surfaces and handles ignoring controller clicks.