Fix remove even if it's the same as CopyTo

Sometimes, we forgot to set the autoremove
in copyto.