Merge pull request #12 from gregorylull/mergeAlex

Merged Alex's branch into warren's update, and fixed merge conflicts.
no \n
exclude
Deployment Experimentation
fine tuneing filters
created recursive fs.readfile reader that only opens up a max 255 files at a time for reading
Pushing up working/deployable code
more tuning
fine tuned readJsonDir in cronBatch to reserve
Merge pull request #14 from rawrin/batchOperation

Deployment Ready
merged code now contains updated readJsonDir() that takes care of more than 255 simultaneous async fs.readFiles.

also currently reading rss style, e.g.:

  doc.link
  item.file

Merge remote-tracking branch 'upstream/BatchOperation' into refactor

Conflicts:
	app.js
	batchOp.js
	cronBatchInsert.js
Merge pull request #15 from gregorylull/refactor

Refactor, merged with warren's production code, handles >255 fs.readFile
Merge remote-tracking branch 'alex/scrape' into mergeAlex
minor fs.readfile limit change, instead of 255, made it 250