apache/spark — pull request #3408 by wingchen (2014-11-21 21:17:52+00:00)
Title: Supporting elasticsearch API in this page in pyspark

I am trying to support elasticsearch API in this page in pyspark:
https://github.com/elasticsearch/elasticsearch-hadoop/blob/master/spark/src/main/scala/org/elasticsearch/spark/rdd/api/java/JavaEsSpark.scala

The POC code is committed into this pull request for `def esRDD(self, resource, query)`. It's working well. I can come up with the rest functions too.

However, I understand that introduction of a new dependency is not generally accepted:

> Introduction of dependencies: Due to the complex nature of Spark, we are conservative about introducing new dependencies. If patches add new dependencies to Spark, they may not be merged.

I will be happy to listen to a 3-rd party way to do it from the community too.