new post on algorithm for removing dups