Ok, removed the () constructors. Leaving data/ in because the unit tests
need them.


On Tue, Jan 7, 2014 at 9:59 PM, Matt Hayes <notifications@github.com> wrote:

> In src/java/datafu/pig/text/opennlp/TokenizeME.java:
>
> > +public class TokenizeME extends EvalFunc<DataBag>
> > +{
> > +    private boolean isFirst = true;
> > +    InputStream is = null;
> > +    TokenizerModel model = null;
> > +    private TokenizerME tokenizer = null;
> > +    public static final String MODEL_FILE = "tokens";
> > +    TupleFactory tf = TupleFactory.getInstance();
> > +    BagFactory bf = BagFactory.getInstance();
> > +    String modelPath;
> > +
> > +    public TokenizeME(String modelPath) {
> > +        this.modelPath = modelPath;
> > +    }
> > +
> > +    public TokenizeME() {
>
> But this constructor is only going to work when you have checked out the
> datafu source code and are running in local mode from the datafu directory
> where "data/en-token.bin" exists. It's not going to work for the typical
> use case.
>
> —
> Reply to this email directly or view it on GitHub<https://github.com/linkedin/datafu/pull/84/files#r8716260>
> .
>



-- 
Russell Jurney twitter.com/rjurney russell.jurney@gmail.com datasyndrome.com