consolidated scraper and web interface