Well it works ... but at 33% of a standard unordered_map. This is becoming frustrating :(
Removed the embedded copy of the value in the iterator. Now at 39% performance.