test negative GLU_TESS_COORD_TOO_LARGE values as well