now using sklearn pairwise distance which speedsup bottleneck considerably, but parallel not working though