This approach is fine for now.  We could look into using K-d trees from SciPy for a more efficient algorithm later.