World|Map|Client: de::Map has ownership of the contact blockmaps

Todo: Cleanup.