Removed the X11 check

I just realized this may break the build for some people, and we're probably not going to use X11 anyway.