Deduper with hdfs sttore