Good point re:keySize, I'll change.
Not so sure about the Set interface here: we really need a concurrent set there and not any kind of set would do. A ConcurrentSet interface similar to ConcurrentMap would be ideal.