Make scraper more resilient

When SOLUS throws a Data Integrity Error the scraper currently dies. It should attempt to detect the error and recover from it.