show actual diffbot error in urls.csv.
do not stop indexing page and harvesting links on diffbot error.