Fix SPARK-698. From ExecutorRunner, launch java directly instead via the run scripts.
Incorporate feedback from mateiz:
- we do not need getEnvOrEmpty
- Instead of saving SPARK_NONDAEMON_JAVA_OPTS, it would be better to modify the scripts to use a different variable name for the JAVA_OPTS they do eventually use
Examaple of cumulative counting using updateStateByKey
Modified as per TD's suggestions
Removed unused code, clarified intent of the program, batch size to 1 second
Add support for Spark on Yarn on a secure Hadoop cluster
upmerge with latest mesos/spark master and fix hbase compile with hadoop2-yarn profile
Allow other twitter authorizations than username/password
Partially working checkpoint
Completely hacked version of block manager UI in jetty
Minor cleanup
Adding deterministic port
Fix in storage status page
Spray refactoring for master web UI
Commenting unfinished part
Adding WebUI file
Cleaning up master web UI
Some comments
Adding worker version of UI
Changing JSON protocol and removing spray code