Make sure documents are removed before the job is