Don't try to delete empty output dir

To support using a docker volume.