Release 1.8.3.1b - using 4th digit to indicate dev releases
Changed all build files to use Java 1.7
talsimane_core/TalismaneConfig: added startSentence to skip first n sentences when reading a corpus
talismane_core/TalismaneConfig: added includeTransitionLog to view exact transitions that were applied when analysing/evaluating parses
talismane_core/TalismaneConfig: added errorLabels to limit transition log to certain labels only
talismane_core/TalismaneConfig: added port to change the server listening port
talismane_core/AnnotatedCorpusReader: added get/setStartSentence to skip the first n sentences
talismane_core/ParseEvaluationObserverImpl: an observer which wraps a ParseConfigurationProcessor, but only outputs evaluation errors of certain types
talismane_core/TransitionLogWriter: writes the exact sequence of transitions for each parse
talismane_core/PosTaggedToken: now implements PosTaggerContext, so it can be used in context features as well
talismane_core/IfThenElseTokenAddressFeature: so that these features can be used as result of If-then-else and fed to other features
talismane_core/LexiconPosTagFeature: now takes an array of postags, and returns true if any one of them is listed in the glossary
talismane_fr/TalismaneFrench: applying input regex no matter which reader is used
Release 1.8.3.2b
Added talismane_en with support for English (no models yet)
Added inDir option, possibility of analysing all files in a directory structure and generating output files following the same directory structure (via outDir)
Added support for projective and non-projective heads in input/output (as per CONLL-X format)
talismane_core/TalismaneSession: added LinguisticRules for various language-specific rules
talismane_core/DefaultLexicalEntry: created DefaultLexicalEntry, DefaultMorphologyReader, DefaultPosTagMapper to simplify lexicon handling
talismane_core/ParseConfigurationOutput: non-projective heads available
talismane_core/ParseConfigurationTokenOutput: non-projective head available
talismane_core/ParseConfiguration: added getNonProjectiveDependencies() and addManualNonProjectiveDependency
talismane_core/ParserRegexBasedCorpusReader - implementing SentenceDetectorAnnotatedCorpusReader to allow training of sentence detector from CoNLL corpora
talismane_core/ParserRegexBasedCorpusReader - added %NON_PROJ_GOVERNOR% and %NON_PROJ_LABEL% as possibilities in regex
talismane_core/PosTagRegexBasedCorpusReaderImpl: applying TokenFilters and TokenSequenceFilters correctly
talismane_core/AbstractTokenSequence: replaced French specific sentence construction with LinguisticRules
talismane_core/TalismaneConfig: fixed bug where TokeniserModel didn't contain pattern descriptors, also when missing models (was causing crash)
talismane_en: brand new package for English
talismane_fr: fixed license, added implementations for LinguisticRules
talismane_other/CorpusProjectifier: fixed to use new non-projective AND projective arcs
talismane_utils: added CurrentFileObserver, CurrentFileProvider, DirectoryReader, DirectoryWriter, for processing multiple files in directory (both in input and a different output file per input file)
Release 1.8.3b
First release with both English and French implementations
talismane_core/TalismaneConfig: added possibility to evaluate sentence detector
talismane_core/TalismaneConfig: added possibility to replace token filters, text filters, and token sequence filters, by prefixing the filename with "replace:"
talismane_core/TalismaneConfig: no longer reading token filters and token sequence filters from TokeniserModel - always using default filters, or those provided by user
talismane_core/TalismaneImpl: added code for sentence detector evaluation
talismane_core/ParseEvaluationObserverImpl: fixed bug when token had no guessed governor
talismane_core/SentenceDetectorImpl: certain token placeholders can coincide with sentence boundaries (e.g. a sentence ending with "etc.")
talismane_core/TokenRegexFilter: created public interface, private implementation
talismane_core/TokenPlaceholder: added isPossibleSentenceBoundary
talismane_core/TokenRegexFilter: added isPossibleSentenceBoundary
talismane_core/TokenFilterServiceImpl: reading possibleSentenceBoundary parameter from descriptors
talismane_en: added all default models and default filters
talismane_fr: put all token filters into the token_filters file, rather than relying on the TokeniserModel to contain them