Split up dir cleanup from purge_batch operation
Clean up batch dirs on bad ingest