working scraper and added several web REST end-points