implemented withoutDuplicates(), clean() now uses withoutDuplicates()
some comments
test for processing.withoutDuplicates()