Fix Bug in Partition Pruning, index of Pruned Partitions should inherit from parent
Indentation
Indentation
Code review
Added missing scalatest dependency
Merge pull request #738 from harsha2010/pruning

Fix bug in Partition Pruning.
Merge pull request #739 from markhamstra/toolsPom

Missing tools/pom.xml scalatest dependency
Some fixes to Python examples (style and package name for LR)
Two fixes to IPython support:

- Don't attempt to run worker processes with ipython (that can cause
  some crashes as ipython prints things to standard out)
- Allow passing some IPYTHON_OPTS to launch things like the notebook
Optimize Python take() to not compute entire first partition
Optimize Python foreach() to not return as many objects
Allow python/run-tests to run from any directory
Use None instead of empty string as it's slightly smaller/faster
SPARK-815. Python parallelize() should split lists before batching

One unfortunate consequence of this fix is that we materialize any
collections that are given to us as generators, but this seems necessary
to get reasonable behavior on small collections. We could add a
batchSize parameter later to bypass auto-computation of batch size if
this becomes a problem (e.g. if users really want to parallelize big
generators nicely)
Add docs about ipython
Merge branch 'master' of github.com:mesos/spark