fixes clohfink/RendezvousHash#1 (I think, cant reproduce). Requires
synchronizing remove/add functions but due to COW data structure they
blocked each other anyway.