libcaca: disable x11

Closes #28291.