improved resilience of the scraper, should now lessen the occurences of JSON exceptions and 503 error messages