I'll take a pass through and see what I come up with.  Thanks!


On Tue, May 13, 2014 at 10:52 PM, Reynold Xin <notifications@github.com>wrote:

> In core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala:
>
> > +                                  "Jane|Smith|40",
> > +                                  "Thomas|Williams|30",
> > +                                  "Karen|Williams|60"))
> > +
> > +    val ageOrdered = Array("Thomas|Williams|30",
> > +                           "Jane|Smith|40",
> > +                           "Bob|Smith|50",
> > +                           "Karen|Williams|60")
> > +
> > +    // last name, then first name
> > +    val nameOrdered = Array("Bob|Smith|50",
> > +                            "Jane|Smith|40",
> > +                            "Karen|Williams|60",
> > +                            "Thomas|Williams|30")
> > +
> > +    def parse(s: String): Person = {
>
> if you change this to a closure, then it will pass without the
> serialization problem, e.g.
>
> val parse = (s: String) => {
>
>   val split = s.split("\\|")
>
>   Person(split(0), split(1), split(2).toInt)}
>
> —
> Reply to this email directly or view it on GitHub<https://github.com/apache/spark/pull/369/files#r12621775>
> .
>