* Refactored features, pulling out the problem-specific code into its own module, and giving us a generic feature extraction class
* Added sloppy POS tagger
* Temporarily hacked disuses sentence attrs for pos-tagging stuff
* Updated import on parser for renamed beam.
* Removed outdated gold flag from parse script
* Added pretty scrappy POS tagger. Does viterbi tagging in weird way by co-opting parser beam code, would be cleaner to just do it fresh. Similar story with the features.
* Added capability for bag-of-words features
* Added bow features inspired by the toutanova (2003) paper. Getting 96.9 on 00-18 tested on 24
* Cleaned up dynamic programming slightly, although still a bit scrappy. Now uses bag-of-words features and quote features. The quote features seem to help 0.1, up to 97.00 on 24.
* Broken version of tagger, refactoring
* Improved organisation of tagger.
* Added unfinalize method, to unaverage perceptron weights and allow optimising training iterations
* Fixed bug in BoW features, for zero values.
* Do heldout evaluation during training to optimise iterations
* Still debugging tagger
* Use different separator
* Tagger still broken with weird history bug
* Added some more debug printing
* Working tagger, gets 97.03 on dev. Tracking down the 0.1% regression.
* Fixed bug where indices weren't being shuffled