Looks more and more like a JVM bug.  Next step, never release an unmodifiable map wrapper -- only unmodifiable copies.