Revert "manifest: tag xserver"

This reverts commit 2c6c0fe5c1129308cd5e227cdde741bdce115b2f.

Upstream pushed the fix.