Believe it or not, this is how DiracKernels have always been implemented.  I assumed there was a reason you did it and didn't save the PointLocator.  If there's not a reason then yeah we shouldn't rebuild it every time.