add documentation for deduplication
Merge pull request #7 from sjyk/changes_Juan

add documentation for deduplication