remove the job archive file as it is built into AWS, however, there
may be a reason for having an archived job log.
add ability to merge updated directory list to static storage so we can keep track of files in glacier