Release 1.9.0b
Issue #10: Add sub-project to train and analyse Talismane on any language when indicating resources
Issue #11: Add language detection module to Talismane
Issue #12: Change default CONLL reading format to read both projective and non-projective arcs
For Issue 10, added talismane_lang project and tested to train and evaluate Occitan and French pos-taggers without lexica.
For Issue 11, added languageDetector package, and tested on English and French (currently without official evaluation)
For Issue 12, changed ParserRegexBasedCorpusReader
talismane_core/SentenceProcessor: changed to process the Sentence object, rather than a String, giving access for example to the position in the original text
talismane_extensions: renamed former package talismane_other
talismane_ftb: fixed bug in FTB xml reader
talismane_core: added new options module=language/languageDetector, languageModel, languageFeatures, locale (for generic training/analysis), languageCorpusMap
v2.0.0b
Major update including generic package (talismane_lang) and major updates around lexicons, allow full definition of lexicons from configuration files
talismane_lang: new package, allowing training/evaluation/analysis for any language if resources are listed in command line
talismane_lefff: removed, as lexicons are now managed purely via configuration files
talismane_core/TalismaneMain: added new main class, for running certain non-corpus related options from the command-line, including serializeLexicon
talismane_core/DefaultLexicalEntry: complete rewrite, to ensure efficient storage and ability to give parent lexicon name
talismane_core/DefaultPosTagMapper: complete rewrite to allow mapping based on any list of LexicalAttribute
talismane_core/LexiconFile: complete rewrite to handle various serialization options
talismane_core/LexiconSerializer: complete rewrite to handle various serialization options and store a single file as a result
talismane_core/RegexLexicalEntryReader: complete rewrite with far better handling for regex to LexicalAttribute mapping
talismane_en: uses new lexicon model
talismane_fr: uses new lexicon model
talismane_lang/examples: fully usable examples, described in Wiki