More cases added to new -output_interim_files=1 option

Also added override parameter to job runner function letting it force
writing of interim files if needed for email notifications