Refactored streaming project to separate out the twitter functionality.
Refactored kafka, flume, zeromq, mqtt as separate external projects, with their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects.
Added pom.xml for external projects and removed unnecessary dependencies and repositoris from other poms and sbt.
Removed unnecessary comments.
Removed extra empty lines.
Merge branch 'apache-master' into project-refactor
Merge pull request #1 from apache/master

Merge latest Spark changes
Added ‘-i’ command line option to spark REPL.
We had to create a new implementation of both scala.tools.nsc.CompilerCommand and scala.tools.nsc.Settings, because using scala.tools.nsc.GenericRunnerSettings would bring in other options (-howtorun, -save and -execute) which don’t make sense in Spark.
Any new Spark specific command line option could now be added to org.apache.spark.repl.SparkRunnerSettings class.

Since the behavior of loading a script from the command line should be the same as loading it using the “:load” command inside the shell, the script should be loaded when the SparkContext is available, that’s why we had to move the call to ‘loadfiles(settings)’ _after_ the call to postInitialization(). This still doesn’t work if ‘isAsync = true’.
Get rid of `Either[ActorRef, ActorSelection]'

Although we can send messages via an ActorSelection, it would be better to identify the actor and obtain an ActorRef first, so that we can get informed earlier if the remote actor doesn't exist, and get rid of the annoying Either wrapper.
Fixed several compilation errors in test suites
Fixed test suite compilation errors
Changed JavaStreamingContextWith*** to ***Function in streaming.api.java.*** package. Also fixed packages of Flume and MQTT tests.
Merge remote-tracking branch 'apache/master' into project-refactor

Conflicts:
	examples/src/main/java/org/apache/spark/streaming/examples/JavaFlumeEventCount.java
	streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala
	streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
	streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java
	streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala
	streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala
Added license header and removed @author tag
Removed XYZFunctions and added XYZUtils as a common Scala and Java interface for creating XYZ streams.
Fixed examples/pom.xml and run-example based on Patrick's suggestions.
Add way to limit default # of cores used by applications on standalone mode

Also documents the spark.deploy.spreadOut option.
Fix unit test compilation
Address review comments
Add ASF header to the new sbt script.