added google sparse hash -> speed improved 10 fold
dropped dereplication step