Remove spawned villagers from map