Average only when it means we are limiting the number of points