bwhite/hadoopy — Issue #42: If the current user isn't in the appropriate groups, confusing errors come from streaming
Author: bwhite
Created: 2011-12-12 21:29:54+00:00
State: open

This isn't a hadoopy problem but if the current user isn't in mapred/hadoop/hdfs groups hadoop streaming will give something like this

>>> hadoopy.writetb('blah', [(1,1)])
Traceback (most recent call last):
File "", line 1, in
File "/usr/local/lib/python2.7/dist-packages/hadoopy/_hdfs.py", line 200, in writetb
raise IOError('writetb: Child returned [%d] Stderr[%s]' % (p.returncode, p.stderr.read()))
IOError: writetb: Child returned [1] Stderr[Exception in thread "main" java.io.IOException: Mkdirs failed to create /tmp/brandyn
at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:100)
at org.apache.hadoop.util.RunJar.main(RunJar.java:144)
]