twitter/hraven — pull request #124 by vrushalic (2014-11-07 23:29:35+00:00)
Title: Preprocessing step for Spark history file processing

Enables the preprocessing step to process Spark history/conf files.

Ensures the "spark" prefix is applied to spark jobs, but backwards compatibility is maintained for hadoop jobs. hRaven till now presumed the prefix to be "job" for all job ids. All the JobIds, JobKeys, Row keys did not contain this prefix , but now we need to add existence of such a prefix to include spark files.