shravanmn/Yahoo_LDA — Issue #5: Failed stream-job while run Yahoo!LDA on hadoop distribution system
Author: YimingChen
Created: 2011-12-08 07:35:52+00:00
State: open

I have followed single machine setup and run successfully. However, I got a similar problem with yuvalye while run on multi machine, but not the same.

The failed job output is below:
------------------------------------------------------------------------------------------------------------------------
A checkpointed directory exists. Do you want to start from this checkpoint?
[: 71: ==: unexpected operator
Deleted hdfs://xx:xx/xx/xx/yahoo_lda/output_0
+ /opt/hadoop/hadoop-0.20.2/bin/hadoop jar /opt/hadoop/hadoop-0.20.2/hadoop-streaming.jar -Dmapred.job.queue.name=default -Dmapred.reduce.tasks.speculative.execution=false -Dmapred.job.reduce.memory.mb=8000 -Dmapred.reduce.tasks=1 -Dmapred.child.ulimit=8001000 -Dmapred.task.timeout=1800000 -Dmapred.reduce.max.attempts=1 -Dmapreduce.job.acl-view-job=shravanm,smola -input ./yahoo_lda/ut/ydir_1k.txt -output ./yahoo_lda/output_0 -cacheArchive hdfs://xx:xx/xx/xx/LDALibs.jar#LDALibs -mapper /bin/cat -reducer Formatter.sh 1 " " I -file Formatter.sh -file functions.sh -numReduceTasks 3
11/12/08 14:30:34 WARN streaming.StreamJob: -cacheArchive option is deprecated, please use -archives instead.
packageJobJar: [Formatter.sh, functions.sh, /tmp/hadoop-idm/hadoop-unjar8278286049299668675/] [] /tmp/streamjob5832830091559634848.jar tmpDir=null
11/12/08 14:30:35 INFO mapred.FileInputFormat: Total input paths to process : 1
11/12/08 14:30:35 INFO streaming.StreamJob: getLocalDirs(): [/opt/hadoop/hadoop-0.20.2/data/mapredlocal]
11/12/08 14:30:35 INFO streaming.StreamJob: Running job: job_201112081253_0005
11/12/08 14:30:35 INFO streaming.StreamJob: To kill this job, run:
11/12/08 14:30:35 INFO streaming.StreamJob: /opt/hadoop/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=192.168.1.21:9001 -kill job_201112081253_0005
11/12/08 14:30:35 INFO streaming.StreamJob: Tracking URL: http://xx:50030/jobdetails.jsp?jobid=job_201112081253_0005
11/12/08 14:30:36 INFO streaming.StreamJob: map 0% reduce 0%
11/12/08 14:30:44 INFO streaming.StreamJob: map 100% reduce 0%
11/12/08 14:30:53 INFO streaming.StreamJob: map 100% reduce 28%
11/12/08 14:30:56 INFO streaming.StreamJob: map 100% reduce 22%
11/12/08 14:30:59 INFO streaming.StreamJob: map 100% reduce 100%
11/12/08 14:30:59 INFO streaming.StreamJob: To kill this job, run:
11/12/08 14:30:59 INFO streaming.StreamJob: /opt/hadoop/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=192.168.1.21:9001 -kill job_201112081253_0005
11/12/08 14:30:59 INFO streaming.StreamJob: Tracking URL: http://xx:50030/jobdetails.jsp?jobid=job_201112081253_0005
11/12/08 14:30:59 ERROR streaming.StreamJob: Job not Successful!
11/12/08 14:30:59 INFO streaming.StreamJob: killJob...
Streaming Job Failed!
+ exit_code=1
+ set +x
Unable to run Formatter on your corpus
------------------------------------------------------------------------------------------------------------------------

and the jobtracker log is:
------------------------------------------------------------------------------------------------------------------------
557 2011-12-08 14:30:52,576 INFO org.apache.hadoop.mapred.TaskInProgress: Error from attempt_201112081253_0005_r_000000_0: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
558 at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:311)
559 at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:545)
560 at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:137)
561 at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:473)
562 at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
563 at org.apache.hadoop.mapred.Child.main(Child.java:170)
------------------------------------------------------------------------------------------------------------------------

From yuvalye's issue description we can see that is the "Permission denied" problem. But I have no idea what's problem I have got, could some one help me?

Thanks
YimingChen