nathanmarz/storm — Issue #115: Keep Storm classes and user classes independent
Author: nathanmarz
Created: 2012-01-28 21:02:02+00:00
State: open
Labels: Improvement

For instance, user classes should be able to use a different version of a library than Storm uses. Users have run into issues with Hibernate since Hibernate requires asm 1.4 while Storm requires asm 3.3 (through Kryo).

This is tricky since the Storm code and user code run together. e.g., when a user does an emit call, that calls into Storm code which calls into Kryo, 0mq, etc. It's not clear how to keep the dependencies separate.

Possible technologies to look at include OSGi and JPF. However, there is a serious concern about the complexity and overhead of these approaches.

Hadoop has the exact same problem, so it's worth looking to see if it does anything to address this. AFAIK, it doesn't.