Looks good to me. Can you replace the current page on Distributed Cache
with this?

https://github.com/twitter/scalding/wiki/Using-the-distributed-cache

I think we should get people to use this approach as the supported approach.


On Tue, Oct 15, 2013 at 10:26 AM, Jonathan Simms
<notifications@github.com>wrote:

> In
> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
>
> > @@ -0,0 +1,29 @@
> > +package com.twitter.scalding.filecache
> > +
> > +import java.net.URI
> > +import org.apache.hadoop.conf.Configuration
> > +import org.apache.hadoop.filecache.{DistributedCache => HDistributedCache}
> > +import org.apache.hadoop.fs.Path
> > +
> > +
> > +// used to supply the implicit cache argument to UncachedFile, allows us to stub this in tests
>
> Oh, hey, yes $ git clone git@github.com:twitter/scalding.wiki.git
> scalding.wiki it's in a branch 'distributed-cache-page' in
> Using-DistributedCacheFile.md I may have been overly conservative in making
> a branch and such, I had an aversion to publishing without approval beaten
> into me early on :) After you take a look, just lemme know if you want me
> to push the change and I'll take care of it
> … <#141bd273caced9bf_>
> On Tue, Oct 15, 2013 at 1:21 PM, P. Oscar Boykin <notifications@github.com>wrote:
> > In >
> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
> > > > @@ -0,0 +1,29 @@ > > +package com.twitter.scalding.filecache > > + >
> > +import java.net.URI > > +import org.apache.hadoop.conf.Configuration > >
> +import org.apache.hadoop.filecache.{DistributedCache => HDistributedCache}
> > > +import org.apache.hadoop.fs.Path > > + > > + > > +// used to supply
> the implicit cache argument to UncachedFile, allows us to stub this in
> tests > > Jonathan, Congrats on the new son, by the way. Just checking in:
> I lost > track of the wiki stuff you wrote for you distributed cache work.
> That is > in science now, and I wanted to give you a shout-out and link to
> the > documentation. Can you remind me where I can find that wiki doc you
> made? > … <#141bd22c4d0defea_> > On Mon, Jun 17, 2013 at 5:03 PM, Jonathan
> Simms <notifications@github.com>wrote: In
> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
> > @@ -0,0 +1,29 @@ > +package com.twitter.scalding.filecache > + > +import
> java.net.URI > +import org.apache.hadoop.conf.Configuration > +import
> org.apache.hadoop.filecache.{DistributedCache => HDistributedCache} >
> +import org.apache.hadoop.fs.Path > + > + > +// used to supply the implicit
> cache argument to UncachedFile, allows us to stub this in tests Sure, I was
> going to update the example in the wiki once this landed as well. (if
> that's OK with you) — Reply to this email directly or view it on GitHub<
> https://github.com/twitter/scalding/pull/450/files#r4738528> . -- Oscar
> Boykin :: @posco <https://github.com/posco> <https://github.com/posco> ::
> http://twitter.com/posco — Reply to this email directly or view it on
> GitHub<https://github.com/twitter/scalding/pull/450/files#r6977742> .
>  -- Jonathan Simms Twitter, Core Services (Geo) @slyphon<https://github.com/slyphon><
> https://twitter.com/slyphon>
>
> —
> Reply to this email directly or view it on GitHub<https://github.com/twitter/scalding/pull/450/files#r6977944>
> .
>



-- 
Oscar Boykin :: @posco :: http://twitter.com/posco