Updated data generator to use receiver
Removed all use of org.apache.spark.Logging
Removed all use of org.apache.spark.Logging
Merge remote-tracking branch 'databricks/master'
Fixed config.
add Python streaming tests
Report Spark Core results as JSON:

After this patch, the "result: " line printed to the stdout logs will contain
a JSON object that captures information on the test configuration in addition
to the actual test results.  This makes it easier to process the test results
using tools like Pandas or Spark SQL.
Extend SchedulerThroughputTest to test closure size, number of jobs.

I’m adding these parameters in order to test the broadcast-based
task shipping added in Spark 1.1.0.
Fixed bug in streaming tests project
Merge pull request #18 from tdas/master

Updated Streaming Perf tests with Receivers
Make setting configs more user-friendly

Previously there were tons of flags that the user must set, and
these are scattered throughout the config.py file. This commit
organizes the necessary settings by category and moves the
important ones to the top.

It also replaces all "SKIP_*" flags with the positive form,
which makes it more straightforward for the user to reason about.
Always rsync Spark to all nodes

When a Worker config changes, for instance, we need to manually
rsync Spark before running spark-perf. With this commit this is
no longer the case.
Ignore results directory
Actually skip PySpark tests if they are not configured to run
Merge pull request #20 from davies/streaming

add Python streaming tests
Add header to result file to explain what the numbers mean

It was very confusing before. For each test all we see is something
like 10.1, 0.25, 9.75, 10.8, 10.35. Every time I have to dig into
the code to figure out what these mean. This commit adds a header to
the result file to explain this.
Rewrite README; add bin/spark-ec2/install-maven script.
Add support for Yarn

This is almost trivial. The only thing we need is to set
SPARK_CLUSTER_URL to "yarn", and avoid restarting the standalone
cluster as we normally do
Support running on Mesos
Move mesos configuration to the top