ignore deploy.sh file
checkDir(), which batchInserts new files and moves files to scrapeArchive, only activates when the neo4j cosine similarity query is DONE calculating
got rid of hacker news forums by preventing them from entering the master queue. created helper articleTypeFilter() in scrape.js
readabilityQuery will make three attempts, if the file cannot be read / readability does not work, then it is dequeued