x11: Move event filter to backend connection