Patrick rewrote it in the actual patch to something better - and I closed
the PR subsequent to it getting picked and merged into trunk and 0.9

- Mridul


On Sat, Feb 1, 2014 at 1:24 AM, Reynold Xin <notifications@github.com>wrote:

> In core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala:
>
> > @@ -44,7 +44,9 @@ class CheckpointRDD[T: ClassTag](sc: SparkContext, val checkpointPath: String)
> >      // listStatus can throw exception if path does not exist.
> >      if (fs.exists(cpath)) {
> >        val dirContents = fs.listStatus(cpath)
> > -      val partitionFiles = dirContents.map(_.getPath.toString).filter(_.contains("part-")).sorted
> > +      // Also ignore attempt files left around - rewrite the condition in a better way ?
> > +      val partitionFiles = dirContents.map(_.getPath.toString).filter( fileName =>
>
> Perhaps
>
> val partitionFiles = dirContents.map(_.getPath.toString).filter { name =>
>   name.contains("part-") && !(name.contains("-attempt-") && name.contains(".part-"))}.sorted
>
> so it fits in 100 chars and be slightly more readable
>
> --
> Reply to this email directly or view it on GitHub<https://github.com/apache/incubator-spark/pull/477/files#r9355130>
> .
>