spotify/luigi — pull request #274 by edwardnewett (2014-02-10 23:17:48+00:00)
Title: Support for Apache Spark

This patch adds basic support for launching a
Spark application on YARN in standalone mode.

- support for env specific config through client.cfg
- simple status tracking / error handling
- kills the yarn app on ctrl+c