Add some more checks for vectorized GLM