Yelp/mrjob — Issue #367: S3 connection dropped during cat()
Author: davidmarin
Created: 2012-02-15 00:45:31+00:00
State: open
Labels: Bug

If you use `mrjob.emr.EMRJobRunner.cat()` to read some of the data from a key, and then do something else for a while, and come back, S3 can silently drop the connection, and your call to `cat()` can hang.

S3 has the capacity to set socket timeouts and retry on a timeout; we should make this an option and set a reasonable default.

Nominally assigning to @jfennell because he's researching this bug. @sjohnson or I can write the relevant code if need be.