Can we add a header to the output that specifies the codec used? Seems
brittle to require the configuration to be correct for simply reading the
checkpoint. (Not that it's an unreasonable assumption in >90% of cases, but
robustness is nice.)

On Wed, Jul 31, 2013 at 8:52 AM, Matei Zaharia <notifications@github.com>wrote:

> In streaming/src/main/scala/spark/streaming/Checkpoint.scala:
>
> > @@ -49,6 +50,11 @@ class Checkpoint(@transient ssc: StreamingContext, val checkpointTime: Time)
> >    }
> >  }
> >
> > +private[streaming]
> > +object Checkpoint {
>
> Hmm, I don't really get it. The reader is going to be a different instance
> of the program anyway, after a failure. It will have to be configured with
> the same codec class either way.
>
> —
> Reply to this email directly or view it on GitHub<https://github.com/mesos/spark/pull/754/files#r5507181>
> .
>