Cleanup GLX cl_gl setup a bit
Have another go at the runaway allocation problem