nathanmarz/storm — Issue #132: Replication
Author: nathanmarz
Created: 2012-02-11 06:42:33+00:00
State: open
Labels: Idea

This is an idea to replicate a computation across many tasks on different machines. The "replication" part is already possible since you can implement your own grouping which sends the tuple to multiple tasks. What is needed is help from Nimbus to make sure those tasks run on different machines.

Replicated computation would be useful for doing things like highly available DRPC. Essentially you do the same DRPC multiple times and at the end pick the first one that finishes for the result.