* duplicates filter: improved duplicate detection algorithm
* duplicates filter: improved warning output
* general fixes and improvements