allowed any job to spawn a warc file job and be able to recover from a prev. run