Add support for deleting containers

This only tests and handles the happy path so far. Handling concurrent modifications will be next.