fix test bug
Update SvdppSuite.scala
Merge pull request #289 from tdas/filestream-fix

Bug fixes for file input stream and checkpointing

- Fixed bugs in the file input stream that led the stream to fail due to transient HDFS errors (listing files when a background thread it deleting fails caused errors, etc.)
- Updated Spark's CheckpointRDD and Streaming's CheckpointWriter to use SparkContext.hadoopConfiguration, to allow checkpoints to be written to any HDFS compatible store requiring special configuration.
- Changed the API of SparkContext.setCheckpointDir() - eliminated the unnecessary 'useExisting' parameter. Now SparkContext will always create a unique subdirectory within the user specified checkpoint directory. This is to ensure that previous checkpoint files are not accidentally overwritten.
- Fixed bug where setting checkpoint directory as a relative local path caused the checkpointing to fail.
Address Aaron's and Jerry's comments
Add warning message for spilling
Merge pull request #120 from ankurdave/subgraph-reuses-view

Reuse VTableReplicated in GraphImpl.subgraph
Merge pull request #238 from ngbinh/upgradeNetty

upgrade Netty from 4.0.0.Beta2 to 4.0.13.Final

the changes are listed at https://github.com/netty/netty/wiki/New-and-noteworthy
Fixing the persist behavior of the Vertex and Edge RDDs to persist the current RDD and not the parent.
Merge remote-tracking branch 'apache/master' into conf2

Conflicts:
	core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala
	streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala
	streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobGenerator.scala
Fix two compile errors introduced in merge
minor improvements
Made the code more compact and readable
Add support and test for null keys in ExternalAppendOnlyMap

Also add safeguard against use of destructively sorted AppendOnlyMap
Merge branch 'master' of github.com:andrewor14/incubator-spark
Adding outer checkout when initializing logging
Rename IntermediateBlockId to TempBlockId
Merge pull request #73 from falaki/ApproximateDistinctCount

Approximate distinct count

Added countApproxDistinct() to RDD and countApproxDistinctByKey() to PairRDDFunctions to approximately count distinct number of elements and distinct number of values per key, respectively. Both functions use HyperLogLog from stream-lib for counting. Both functions take a parameter that controls the trade-off between accuracy and memory consumption. Also added Scala docs and test suites for both methods.
restore core/pom.xml file modification
Address Patrick's and Reynold's comments
Merge branch 'master' of github.com:andrewor14/incubator-spark