Fix leaking empty concurrent hashmaps