If permutating, only comptute pearson's p value