build: Don't build client-protocols for things

We don't use these.
xwayland: Split out the XWayland stuff into its own private struct