Sent too soon on that last comment. Just write functions; don't use
classes. We don't care too much about caching this data, and we're
definitely not interested in the restful stuff in this case.


On Thu, Mar 20, 2014 at 9:53 AM, tristaneuan <notifications@github.com>wrote:

> In wikia_dstk/identify/services.py:
>
> > @@ -0,0 +1,204 @@
> > +import nltk
>
> The stuff I moved from nlp_client to this repo is missing from the new
> nlp_services library, because it relies on the data cached in /data/xml/
> and /data/wiki_xml/. The former seems easy enough to rewrite and add to the
> nlp_services library so that it uses the XML stored in S3, but to my
> knowledge, the description_txt, headline_txt, and sitename_txt Solr fields
> for each wiki (which reside in /data/wiki_xml/) were never parsed and
> stored on S3. I need to extract the NPs from each of these fields in order
> for identify_subject() to work. How should I approach solving this problem?
>
> --
> Reply to this email directly or view it on GitHub<https://github.com/Wikia/data-science-toolkit/pull/2/files#r10804082>
> .
>