last tweak
Merge pull request #29 from thrownblown/dev

Dev
Turned on cron for scraping and changed timing to 1 minute
Merged in scrapeHackerNews, fixed minor syntax errors.
Merge pull request #30 from rawrin/batchOperation

Added function and end point for fetching all documents, merged in automated scraping every minute.
Merge pull request #31 from nextup/dev

Added end points, set scraping to 1 min, checks json and scrapeArchive before adding new files