manifest: Remove old patch to libX11

This was pushed upstream months ago, but being silently "applied" ever since,
but recent formatting changes to libX11 broke it.