adds sidekiq worker and scraping functionality