Do we really want to support element-wise distance callables? Wouldn't it be more efficient to ask the user to provide a callable that works on the arrays `X_chunk` and `Y_chunk` arrays directly?

Do we have existing code in scikit-learn that would require the element-wise variant?