giwa/spark — pull request #1 by tdas (2014-07-23 22:48:19+00:00)
Title: Implemented DStream.foreachRDD in the Python API using Py4J callback server

This also required a slight bug fix in the Py4J gateways server. Inside python/lib/py4j-0.8.1-src.zip, there is a file called
java_gateway.py . Line 662 from
`args_command = ''.join([get_command_part(arg) for arg in args])`
to
`args_command = ''.join([get_command_part(arg, python_proxy_pool = self._gateway_client.gateway_property.pool) for arg in args])`

I am merging the change for now, for convenience. But this needs to be fixed properly at the source py4j source repo. We should submit a bug fix.