Fixes issues with deleting files and cleanup on windows.

Throw `ContainerNotFoundException` instead.