Updated Talend harvester to run on a file by file basis, added subjob to delete duplicates
Amended harvester based on Craig's comments
Merge pull request #6 from AODN-ETL/process_file_by_file

Updated Talend harvester to run on a file by file basis, added subjob to...