Project: talenddataquality
Issue TDQ-12141: Have a component similar to tUniqRows on Spark
* Based on Bloom filters * Batch + Streaming * Shouldn't we rename the component since it won't be an exact porting? http://highscalability.com/blog/2016/4/4/how-to-remove-duplicates-in-a-large-dataset-reducing-memory.html Check with the BD team whether it can be implemented in the tUniqRow or in a new component.
Story points: 5