Can't the FindX11.cmake file do this work for us somehow? Too lazy to look into that right now.