use circular hash based collation for marking duplicates