Remove unused build steps that require X11