Rapleaf/hank — Issue #239: Make Compaction and Domain Builders report Hadoop and Cascading progress
Author: thomas-kielbus
Created: 2012-01-06 22:48:22+00:00
State: open

Since we don't report progress, the compactor hadoop job starts many speculative map tasks. I had to turn it off. However, speculative execution is important in this case since some tasks can take forever because of slow disks. If Compaction and Domain Builders would report progress, we could turn speculative execution back on.