nathanmarz/storm — Issue #37: worker exception does not bubble up in UI
Author: colinsurprenant
Created: 2011-11-03 14:21:53+00:00
State: open

Per IRC discussion, while testing my JRuby integration using a one node Storm cluster, the topology submission was successful, UI was showing the topology as "active" but all UI metrics were showing zeros. The worker logs showed an exception was thrown but this exception never surfaced in the UI.

Environment:
- Ubuntu 10.04
- storm 0.5.4
- zookeeper 3.3.3
- zeromq 2.1.10
- jzmq 2.1.10 (master from nathanmarz/jzmq)

- java version "1.6.0_20"
- OpenJDK Runtime Environment (IcedTea6 1.9.9) (6b20-1.9.9-0ubuntu1~10.04.2)
- OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode)

Worker log trace:

2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:host.name=gunks2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.version=1.6.0_202011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.vendor=Sun Microsystems Inc.2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.home=/usr/lib/jvm/java-6-openjdk/jre2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.class.path=/home/colin/services/storm/storm-0.5.4/storm-0.5.4.jar:/home/colin/services/storm/storm-0.5.4/lib/log4j-1.2.16.jar:/home/colin/services/storm/storm 0.5.4/lib/commons-lang-2.5.jar:/home/colin/services/storm/storm-0.5.4/lib/joda-time-1.6.jar:/home/colin/services/storm/storm-0.5.4/lib/clout-0.4.1.jar:/home/colin/services/storm/storm-0.5.4/lib/commons-io 1.4.jar:/home/colin/services/storm/storm-0.5.4/lib/clj-time-0.3.0.jar:/home/colin/services/storm/storm-0.5.4/lib/ring-jetty-adapter-0.3.11.jar:/home/colin/services/storm/storm-0.5.4/lib/libthrift7 0.7.0.jar:/home/colin/services/storm/storm-0.5.4/lib/slf4j-log4j12-1.5.8.jar:/home/colin/services/storm/storm-0.5.4/lib/servlet-api-2.5-20081211.jar:/home/colin/services/storm/storm-0.5.4/lib/json-simple 1.1.jar:/home/colin/services/storm/storm-0.5.4/lib/slf4j-api-1.5.8.jar:/home/colin/services/storm/storm-0.5.4/lib/httpcore-4.0.1.jar:/home/colin/services/storm/storm-0.5.4/lib/jline 0.9.94.jar:/home/colin/services/storm/storm-0.5.4/lib/core.incubator-0.1.0.jar:/home/colin/services/storm/storm-0.5.4/lib/commons-logging-1.1.1.jar:/home/colin/services/storm/storm-0.5.4/lib/jvyaml 1.0.0.jar:/home/colin/services/storm/storm-0.5.4/lib/jzmq-2.1.0.jar:/home/colin/services/storm/storm-0.5.4/lib/tools.macro-0.1.0.jar:/home/colin/services/storm/storm-0.5.4/lib/jetty-util 6.1.26.jar:/home/colin/services/storm/storm-0.5.4/lib/commons-fileupload-1.2.1.jar:/home/colin/services/storm/storm-0.5.4/lib/commons-codec-1.3.jar:/home/colin/services/storm/storm-0.5.4/lib/servlet-api 2.5.jar:/home/colin/services/storm/storm-0.5.4/lib/zookeeper-3.3.2.jar:/home/colin/services/storm/storm-0.5.4/lib/hiccup-0.3.6.jar:/home/colin/services/storm/storm-0.5.4/lib/jetty 6.1.26.jar:/home/colin/services/storm/storm-0.5.4/lib/junit-3.8.1.jar:/home/colin/services/storm/storm-0.5.4/lib/commons-exec-1.1.jar:/home/colin/services/storm/storm-0.5.4/lib/ring-core 0.3.10.jar:/home/colin/services/storm/storm-0.5.4/lib/clojure-1.2.0.jar:/home/colin/services/storm/storm-0.5.4/lib/clojure-contrib-1.2.0.jar:/home/colin/services/storm/storm-0.5.4/lib/ring-servlet 0.3.11.jar:/home/colin/services/storm/storm-0.5.4/lib/httpclient-4.0.1.jar:/home/colin/services/storm/storm-0.5.4/lib/compojure-0.6.4.jar:/home/colin/services/storm/storm 0.5.4/log4j:/home/colin/services/storm/storm-0.5.4/conf:/var/storm/supervisor/stormdist/word-count-3-1320269840/stormjar.jar
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.io.tmpdir=/tmp
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:java.compiler=
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:os.name=Linux2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:os.arch=amd64
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:os.version=2.6.32-34-server
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:user.name=colin
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:user.home=/home/colin
2011-11-02 17:46:56 ZooKeeperServer [INFO] Server environment:user.dir=/home/colin/services/storm/storm-0.5.4
2011-11-02 17:46:58 worker [INFO] Launching worker for word-count-3-1320269840 on f0f42c5f-ac6e-459d-9970-fac0748bc87d:6700 with id d98179ea-8cd9-4689-b397-5619adf32c85
2011-11-02 17:46:58 ZooKeeper [INFO] Initiating client connection, connectString=localhost:2181/ sessionTimeout=10000 watcher=backtype.storm.zookeeper$mk_client$reify__1247@12948069
2011-11-02 17:46:58 ClientCnxn [INFO] Opening socket connection to server localhost/127.0.0.1:2181
2011-11-02 17:46:58 ClientCnxn [INFO] Socket connection established to localhost/127.0.0.1:2181, initiating session
2011-11-02 17:46:58 ClientCnxn [INFO] Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13364f363760113, negotiated timeout = 10000
2011-11-02 17:46:58 zookeeper [INFO] Zookeeper state update: :connected:none
2011-11-02 17:46:58 ZooKeeper [INFO] Session: 0x13364f363760113 closed
2011-11-02 17:46:58 ZooKeeper [INFO] Initiating client connection, connectString=localhost:2181/storm sessionTimeout=20000 watcher=backtype.storm.zookeeper$mk_client$reify__1247@31a734ff
2011-11-02 17:46:58 ClientCnxn [INFO] EventThread shut down
2011-11-02 17:46:58 ClientCnxn [INFO] Opening socket connection to server localhost/127.0.0.1:2181
2011-11-02 17:46:58 ClientCnxn [INFO] Socket connection established to localhost/127.0.0.1:2181, initiating session
2011-11-02 17:46:58 ClientCnxn [INFO] Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13364f363760114, negotiated timeout = 20000

2011-11-02 17:47:07 worker [ERROR] Error on initialization of server mk-worker java.lang.RuntimeException: java.lang.RuntimeException: org.jruby.exceptions.RaiseException: (NameError) uninitialized constant RubySplitSentence
at clojure.lang.LazySeq.sval(LazySeq.java:47)
at clojure.lang.LazySeq.seq(LazySeq.java:56)
at clojure.lang.RT.seq(RT.java:450)
at clojure.core$seq.invoke(core.clj:122)
at clojure.core$dorun.invoke(core.clj:2450)
at clojure.core$doall.invoke(core.clj:2465)
at backtype.storm.daemon.worker$fn__3074$exec_fn__858__auto____3075.invoke(worker.clj:172)
at clojure.lang.AFn.applyToHelper(AFn.java:187)
at clojure.lang.AFn.applyTo(AFn.java:151)
at clojure.core$apply.invoke(core.clj:540)
at backtype.storm.daemon.worker$fn__3074$mk_worker__3216.doInvoke(worker.clj:78)
at clojure.lang.RestFn.invoke(RestFn.java:513)
at backtype.storm.daemon.worker$_main.invoke(worker.clj:247)
at clojure.lang.AFn.applyToHelper(AFn.java:174)
at clojure.lang.AFn.applyTo(AFn.java:151)
at backtype.storm.daemon.worker.main(Unknown Source)
Caused by: java.lang.RuntimeException: org.jruby.exceptions.RaiseException: (NameError) uninitialized constant RubySplitSentence
at backtype.storm.jruby.JRubyBolt.newProxyBolt(JRubyBolt.java:65)
at backtype.storm.jruby.JRubyBolt.prepare(JRubyBolt.java:36)
at backtype.storm.daemon.task$fn__3031.invoke(task.clj:457)
at clojure.lang.MultiFn.invoke(MultiFn.java:194)
at backtype.storm.daemon.task$mk_task.invoke(task.clj:278)
at backtype.storm.daemon.worker$fn__3074$exec_fn__858__auto____3075$iter__3120__3124$fn__3125$fn__3126.invoke(worker.clj:172)
at backtype.storm.daemon.worker$fn__3074$exec_fn__858__auto____3075$iter__3120__3124$fn__3125.invoke(worker.clj:172)
at clojure.lang.LazySeq.sval(LazySeq.java:42)
... 15 more
Caused by: org.jruby.exceptions.RaiseException: (NameError) uninitialized constant RubySplitSentence
2011-11-02 17:47:07 util [INFO] Halting process: ("Error on initialization")