updated method to build jobs based on files. can add the directory of the files or just files individually
updates to robustness calculation to use updated datastructure. updated distribute-cluster to accept more general commands. fold-ops uses the fold multimethod now.