Project: springxd
Issue XD-3136: Example hashtag-count MR job fails when running XD on YARN with PHD 3.0
Running XD on YARN on PHD 3.0 Ambari install. Uploading and submitting a custom job fails with the following: {code} 2015-06-02 16:54:15,580 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1433273561345_0009_m_000000_0: Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.springframework.xd.examples.hadoop.HashtagCount$TokenizerMapper not found org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2076) org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186) org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:742) org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:415) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.lang.ClassNotFoundException: Class org.springframework.xd.examples.hadoop.HashtagCount$TokenizerMapper not found org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1982) org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2074)	... 8 more {code} Same example jar works fine when submitted from XD cluster.
Story points: 5