removed merge blocks, refactor duplicate clusters to take a iterable of blocks of records