adding some debugging comments, there's an error with spearman rho
calculation, need to re-implement