nltk/nltk — Issue #54: chunker models
Author: alexrudnick
Created: 2012-01-17 06:24:57+00:00
State: open

Two chunker models lack an XML file, are gzipped instead of zipped, don't
unpack into a subdirectory, and have extra periods in their names. Please
see nltk_data/packages/chunkers/*.gz

Migrated from http://code.google.com/p/nltk/issues/detail?id=300

earlier comments

edloper said, at 2009-02-20T18:15:22.000Z:

These two files are pickles for nltk_contrib/coref objects (by jpf3). And at the
moment, they don't actually work when you unpickle them. So I recommend that we
either move them under nltk_contrib somewhere, or delete them.

StevenBird1 said, at 2009-02-20T21:01:23.000Z:

Joey -- I moved the chunk model files from nltk_data/chunkers down into
nltk_data/packages/chunkers. However, they're not in the right format and not being
distributed. Let us know if you need some help.

joseph.frazee said, at 2009-02-23T14:05:01.000Z:

Ok. I have the fixes made and just need to retrain on the whole Conll2k dataset. I'll
have that done soon.

joseph.frazee said, at 2009-03-04T14:58:22.000Z:

The chunker refactoring is done and an NP-chunker has been retrained on the entire CoNLL 2000 dataset. All
the dependencies in nltk_contrib.coref have been checked in but I'm waiting for the go ahead to check in the
pickled ChunkTagger object.

joseph.frazee said, at 2009-03-09T13:55:14.000Z:

Since I wasn't sure if this would make it in, I enhanced the nltk_contrib.coref.chunk and nltk_contrib.coref.tag
to allow the possibility of using models local to nltk_contrib.coref. For the time being, the demos run assuming
this location. This should make it easier to ensure that the trunk code for those components is functional
outside of the patches getting applied to the main nltk tree.

StevenBird1 said, at 2009-05-03T09:46:04.000Z:

Sorry for the long delay with 0.9.9. It would be good to have your updated models.
Please ensure that the pickle file has the same directory structure and file naming
convention as the existing chunker models, then check it in to
nltk_data/packages/chunkers. Please also add the corresponding XML files.