server: Pull out common X server args

https://bugzilla.gnome.org/show_bug.cgi?id=726380