10000 docs/batch was a bit too aggressive ... seemed to be breaking curl every once in a while