added deduping hash