added spark-class and spark-executor to sbin

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
add admin scripts to sbin

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
moved user scripts to bin folder

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
add scripts in bin

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
fix path

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
fix paths and change spark to use APP_MEM as application driver memory instead of SPARK_MEM, user should add application jars to SPARK_CLASSPATH

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
rm bin/spark.cmd as we don't have windows test environment. Will added it later if needed

Signed-off-by: shane-huang <shengsheng.huang@intel.com>
Merge branch 'reorgscripts' into scripts-reorg
refactor $FWD variable
deprecate "spark" script and SPAKR_CLASSPATH environment variable
Added partition aware union to improve reduceByKeyAndWindow
Added partitioner aware union, modified DStream.window.
Added flag in window operation to use partition awaare union.
Merge branch 'scheduler-update' into window-improvement

Conflicts:
	streaming/src/main/scala/org/apache/spark/streaming/dstream/WindowedDStream.scala
Added tests for PartitionerAwareUnionRDD in the CheckpointSuite. Refactored CheckpointSuite to make the tests simpler and more reliable. Added missing test for ZippedRDD.
Merge branch 'scheduler-update' into window-improvement
standard Naive Bayes classifier
Refactored NaiveBayes

* Minimized shuffle output with mapPartitions.
* Reduced RDD actions from 3 to 1.
Let reduceByKey to take care of local combine

Also refactored some heavy FP code to improve readability and reduce memory footprint.
Fixed bug in PartitionAwareUnionRDD