Give KDIndex a const reference to its PointBuffer since it doesn't/shouldn't modify it.