Added an output dir scanner to detect when hadoop jobs didn't run.