apache/spark — pull request #1559 by davies (2014-07-24 01:30:57+00:00)
Title: [SPARK-2010] [PySpark] support nested structure in SchemaRDD.

add API: applySchema(rdd, schema, f=None)

It need the new API to support nested structure.

It will do inferSchema() in Python, then convert the namedtuple() or other objects into
tuple() (using dict currently). Before call SchemaRDD.mapPartitions(), It will convert
the tuple into namdtuple, so user will access name fields like normal objects.

Because the type of returned data from collect has changed, so unit tests still failing,
will be fixed later.