Don't get kernel when there aren't many unique x or y values