Check the affine dimension of the point set instead