a) Add support for hyper local scheduling - specific to a host + port - before trying host local scheduling.

b) Add some fixes to test code to ensure it passes (and fixes some other issues).

c) Fix bug in task scheduling which incorrectly used availableCores instead of all cores on the node.
Fix some npe introduced accidentally
Integrate review comments on pull request
Integrate review comments 2
comment out debug versions of checkHost, etc from Utils - which were used to test
Fix ZippedRDD as part Matei's suggestion
pull from master
Add support for instance local in getPreferredLocations of ZippedPartitionsBaseRDD. Add comments to both ZippedPartitionsBaseRDD and ZippedRDD to better describe the potential problem with the approach
Merge from master
Merge branch 'master' of github.com:mridulm/spark
Remove explicit hardcoding of yarn-standalone as args(0) if it is missing.
1) Add support for HADOOP_CONF_DIR (and/or YARN_CONF_DIR - use either) : which is used to specify the client side configuration directory : which needs to be part of the CLASSPATH.

2) Move from var+=".." to var="$var.." : the former does not work on older bash shells unfortunately.
Merge pull request #589 from mridulm/master

Add support for instance local scheduling