make more resilient in the face of spark.io API failures