training data fixes
big refactoring
split features into token features and global features
make HtmlToken.token unicode
«tag» now means NER tag
HtmlLoader
added support for WebAnnotator > 1.14 title annotation feature
break interface again: fit/transform methods now accepts multiple sequences; «tag» attribute is removed from HtmlToken
tokenization changes: split by «|», make tokenizer aware of some unicode quotes
one more tokenization fix
trainer for Wapiti CRF models
make HtmlTokenizer and HtmlFeatureExtractor work on lists of trees by default
add load_trees helper for bulk loading data
add WapitiCRF to top-level exports
update requirements.txt
remove WapitiChunker; add transform and score methods to WapitiCRF
attributes are renamed to fix serialization and __repr__
HtmlLoader cleanup
smart_join utility function
add support for auto-extracting dev data for wapiti training