Added setter method setGenerator to JavaRDD.
Added mapPartitions method to JavaRDD.
Added foreachPartition method to JavaRDD.
Remove classtag from mapPartitions.
Remove default param from mapPartitions
Modifications as suggested in PR feedback-

- mapPartitions, foreachPartition moved to JavaRDDLike
- call scala rdd's setGenerator instead of setting directly in JavaRDD
Modifications as suggested in PR feedback-

- more variants of mapPartitions added to JavaRDDLike
- move setGenerator to JavaRDDLike
- clean up
Allow files added through SparkContext.addFile() to be overwritten

This is useful for the cases when a file needs to be refreshed and downloaded
by the executors periodically.

Signed-off-by: Yinan Li <liyinan926@gmail.com>
Addressed comments from Reynold

Signed-off-by: Yinan Li <liyinan926@gmail.com>
Replace the code to check for Option != None with Option.isDefined call in Scala code.

This hopefully will make the code cleaner.
Replace commons-math with jblas
Add jblas dependency
Add jblas dependency
fixed ClassTag in mapPartitions
Merge pull request #499 from jianpingjwang/dev1

Replace commons-math with jblas in SVDPlusPlus
Merge pull request #406 from eklavya/master

Extending Java API coverage

Hi,

I have added three new methods to JavaRDD.

Please review and merge.
Fix SPARK-1034: Py4JException on PySpark Cartesian Result
Fix SPARK-978: ClassCastException in PySpark cartesian.
Remove Hadoop object cloning and warn users making Hadoop RDD's.

The code introduced in #359 used Hadoop's WritableUtils.clone() to
duplicate objects when reading from Hadoop files. Some users have
reported exceptions when cloning data in verious file formats,
including Avro and another custom format.

This patch removes that functionality to ensure stability for the
0.9 release. Instead, it puts a clear warning in the documentation
that copying may be necessary for Hadoop data sets.
Fix bug on read-side of external sort when using Snappy.

This case wasn't handled correctly and this patch fixes it.