Yelp/mrjob — Issue #338: IndexError when fetching logs
Author: kevinburke
Created: 2012-01-15 04:50:59+00:00
State: open

I get the following traceback when fetching logs from S3:

Waiting 5.0s for S3 eventual consistency
Removing all files in s3://com.mybucket/tmp/no_script.root.20120115.044253.698608/
Traceback (most recent call last):
File "/usr/local/python/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/local/python/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/Python-2.7.2/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/tools/emr/fetch_logs.py", line 267, in
main()
File "/usr/local/Python-2.7.2/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/tools/emr/fetch_logs.py", line 145, in main
find_failure(runner, options.step_num)
File "/usr/local/Python-2.7.2/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/tools/emr/fetch_logs.py", line 251, in find_failure
cause = runner._find_probable_cause_of_failure(step_nums)
File "/usr/local/python/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/emr.py", line 1733, in _find_probable_cause_of_failure
return self._find_probable_cause_of_failure_s3(step_nums)
File "/usr/local/python/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/emr.py", line 1748, in _find_probable_cause_of_failure_s3
self._wait_for_job_flow_termination()
File "/usr/local/python/lib/python2.7/site-packages/mrjob-0.3.1-py2.7.egg/mrjob/emr.py", line 1101, in _wait_for_job_flow_termination
raise IndexError