Added end points, set scraping to 1 min, checks json and scrapeArchive before adding new files