Enable compression by default for spills
Merge pull request #415 from pwendell/shuffle-compress

Enable compression by default for spills
Merge pull request #416 from tdas/filestream-fix

Removed unnecessary DStream operations and updated docs

Removed StreamingContext.registerInputStream and registerOutputStream - they were useless. InputDStream has been made to register itself, and just registering a DStream as output stream cause RDD objects to be created but the RDDs will not be computed at all.. Also made DStream.register() private[streaming] for the same reasons.

Updated docs, specially added package documentation for streaming package.

Also, changed NetworkWordCount's input storage level to use MEMORY_ONLY, replication on the local machine causes warning messages (as replication fails) which is scary for a new user trying out his/her first example.
Add missing header files
Merge pull request #420 from pwendell/header-files

Add missing header files
Improving the graphx-programming-guide.
Merge pull request #423 from jegonzal/GraphXProgrammingGuide

Improving the graphx-programming-guide

This PR will track a few minor improvements to the content and formatting of the graphx-programming-guide.
Broadcast variable visibility change & doc update.

Note that previously Broadcast class was accidentally marked as private[spark]. It needs to be public
for broadcast variables to work. Also exposing the broadcast varaible id.
Updated API doc for Accumulable and Accumulator.
Added package doc for the Java API.
Added license header for package.scala in the Java API package.
Maintain Serializable API compatibility by reverting back to java.io.Serializable for Broadcast and Accumulator.
Fixed a typo in JavaSparkContext's API doc.
Don't clone records for text files
Deprecate rather than remove old combineValuesByKey function
Merge pull request #425 from rxin/scaladoc

API doc update & make Broadcast public

In #413 Broadcast was mistakenly made private[spark]. I changed it to public again. Also exposing id in public given the R frontend requires that.

Copied some of the documentation from the programming guide to API Doc for Broadcast and Accumulator.

This should be cherry picked into branch-0.9 as well for 0.9.0 release.
Adding fix covering combineCombinersByKey as well
Style fix
Add GraphX dependency to examples/pom.xml
Merge pull request #427 from pwendell/deprecate-aggregator

Deprecate rather than remove old combineValuesByKey function