Merge pull request #22 from willtp87/1.x.ingest.multiprocess

1.x.ingest.multiprocess
tmp dir multiprocess hack
Merge pull request #24 from willtp87/1.x.ingest.multiprocess

tmp dir multiprocess hack
Added a new function that is a generator.
Merge pull request #25 from jonathangreen/1.x.ingest.dir.generator

Added a new function that is a generator to scan directories.
get files is now a generator
Merge pull request #26 from willtp87/1.x.ingest

get files is now a generator