add dedupe option
Merge pull request #25 from gvn/1015276

add dedupe option - 1015276