Remove ConcurrentHashMap.

ConcurrentHashMap is unused and has a lot of uses of transmute_mut, so
it's best to remove it.