Clean up CMake library specification

The X11 libraries don't need to be specified when doing dynamic linking