critical bug fix #206 for stripping out duplicates