Revert "X11 backend: make xcb_get_modifier_mapping failure non-fatal"

This reverts commit e4ea9f5c40b018884c03e75fd6c6d3ad314a92c1.
X11 backend: more error checks