Remove the container after it was killed