Should remove server from shards

When a server is removed from the cluster, its ID should be removed from shards, shouldn't it?
It might be better to copy such shards to a different server, though.