raise an exception at the end if scrapers fail
handle pages with no category description