added removal of duplicates using LRUmap