Revert "backends: Include Xfixes for cursor events and manipulation"

This reverts commit 34421e90c3c3b219d4287ba3c55b7aa9b08f14ad.

These aren't needed at all.