added application specific checkexists function
updated scraper code with additional error checking