updated!
https://github.com/twitter/scalding/wiki/Using-the-distributed-cache


On Tue, Oct 15, 2013 at 2:40 PM, Jonathan Simms <slyphon@twitter.com> wrote:

> yup, will do
>
>
> On Tue, Oct 15, 2013 at 1:35 PM, P. Oscar Boykin <notifications@github.com
> > wrote:
>
>> In
>> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
>>
>> > @@ -0,0 +1,29 @@
>> > +package com.twitter.scalding.filecache
>> > +
>> > +import java.net.URI
>> > +import org.apache.hadoop.conf.Configuration
>> > +import org.apache.hadoop.filecache.{DistributedCache => HDistributedCache}
>> > +import org.apache.hadoop.fs.Path
>> > +
>> > +
>> > +// used to supply the implicit cache argument to UncachedFile, allows us to stub this in tests
>>
>> Looks good to me. Can you replace the current page on Distributed Cache
>> with this?
>> https://github.com/twitter/scalding/wiki/Using-the-distributed-cache I
>> think we should get people to use this approach as the supported approach.
>> … <#141bd6b9733ffa32_141bd301bfd1019b_>
>> On Tue, Oct 15, 2013 at 10:26 AM, Jonathan Simms <
>> notifications@github.com>wrote: > In >
>> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
>> > > > @@ -0,0 +1,29 @@ > > +package com.twitter.scalding.filecache > > + >
>> > +import java.net.URI > > +import org.apache.hadoop.conf.Configuration > >
>> +import org.apache.hadoop.filecache.{DistributedCache => HDistributedCache}
>> > > +import org.apache.hadoop.fs.Path > > + > > + > > +// used to supply
>> the implicit cache argument to UncachedFile, allows us to stub this in
>> tests > > Oh, hey, yes $ git clone git@github.com:twitter/scalding.wiki.git
>> > scalding.wiki it's in a branch 'distributed-cache-page' in >
>> Using-DistributedCacheFile.md I may have been overly conservative in making
>> > a branch and such, I had an aversion to publishing without approval
>> beaten > into me early on :) After you take a look, just lemme know if you
>> want me > to push the change and I'll take care of it > …
>> <#141bd273caced9bf_> > On Tue, Oct 15, 2013 at 1:21 PM, P. Oscar Boykin <
>> notifications@github.com>wrote: > In >
>> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
>> > > > @@ -0,0 +1,29 @@ > > +package com.twitter.scalding.filecache > > + >
>> > +import java.net.URI > > +import org.apache.hadoop.conf.Configuration > >
>> +import org.apache.hadoop.filecache.{DistributedCache => HDistributedCache}
>> > > +import org.apache.hadoop.fs.Path > > + > > + > > +// used to supply
>> the implicit cache argument to UncachedFile, allows us to stub this in
>> tests > > Jonathan, Congrats on the new son, by the way. Just checking in:
>> I lost > track of the wiki stuff you wrote for you distributed cache work.
>> That is > in science now, and I wanted to give you a shout-out and link to
>> the > documentation. Can you remind me where I can find that wiki doc you
>> made? > … <#141bd22c4d0defea_> > On Mon, Jun 17, 2013 at 5:03 PM, Jonathan
>> Simms <notifications@github.com>wrote: In
>> scalding-core/src/main/scala/com/twitter/scalding/filecache/DistributedCache.scala:
>> > @@ -0,0 +1,29 @@ > +package com.twitter.scalding.filecache > + > +import
>> java.net.URI > +import org.apache.hadoop.conf.Configuration > +import
>> org.apache.hadoop.filecache.{DistributedCache => HDistributedCache} >
>> +import org.apache.hadoop.fs.Path > + > + > +// used to supply the implicit
>> cache argument to UncachedFile, allows us to stub this in tests Sure, I was
>> going to update the example in the wiki once this landed as well. (if
>> that's OK with you) — Reply to this email directly or view it on GitHub<
>> https://github.com/twitter/scalding/pull/450/files#r4738528> . -- Oscar
>> Boykin :: @posco <https://github.com/posco> <https://github.com/posco> <
>> https://github.com/posco> :: http://twitter.com/posco — Reply to this
>> email directly or view it on GitHub<
>> https://github.com/twitter/scalding/pull/450/files#r6977742> . --
>> Jonathan Simms Twitter, Core Services (Geo) @slyphon<https://github.com/slyphon>
>> <https://github.com/slyphon>< https://twitter.com/slyphon> — Reply to
>> this email directly or view it on GitHub<
>> https://github.com/twitter/scalding/pull/450/files#r6977944> .
>>  -- Oscar Boykin :: @posco <https://github.com/posco> ::
>> http://twitter.com/posco
>>
>> —
>> Reply to this email directly or view it on GitHub<https://github.com/twitter/scalding/pull/450/files#r6978269>
>> .
>>
>
>
>
> --
> Jonathan Simms
> Twitter, Core Services (Geo)
> @slyphon <https://twitter.com/slyphon>
>



-- 
Jonathan Simms
Twitter, Core Services (Geo)
@slyphon <https://twitter.com/slyphon>