Release 1.7.5b
Including Talismane Terminology release 1.0.0b - works with PostGreSQL database only
talismane_core: several minor bugfixes for talismane terminology to work correctly
talismane_fr/lexicons/talismane_lex.prep.txt: fixed preposition d'ou, checking all entries before adding them
talismane_term_extractor: all code added for first time
talismane_term_veiwer: all code added for first time
R1.8.0b
Merged talismane_trainer_fr into talismane_core, to avoid code duplication and take advantage of numerous options when training
Merged talismane_ftbDep into talismane_fr (one class only, fits will with project)
talismane_core/TalismaneConfig: added new "Server" mode where Talismane listens on a given port and processes input received.
talisamne_core/TalismaneConfig: added all required training options
talismane_core/TalisamneConfig: separated config from language specific implementation, to lighten implementation class that's stored in TalismaneSession
talismane_core/Talismane: added Reader and Writer to Talismane, to allow a different reader/writer combination for each socket opened
talismane_core/TalismaneImpl: implemented "train" command for all modules
talisamne_core/TalismaneSession: added LanguageSpecificImplementation to ThreadLocal storage
talismane_core/ParseConfigurationProcessor: added Writer to onNextParseConfiguration, to allow processor to send output to a specific writer
talismane_core/PosTagSequenceProcessor: same change as above
talismane_core/SentenceProcessor: same change as above
talismane_core/TokenSequenceProcessor: same change as above
talismane_core/TokenFilterServiceImpl: moved all French filters to talismane_fr + new method on LanguageSpecificImplementation to find them
talismane_fr/TalismaneFrench: changed to inherit from new light LanguageSpecificImplementation
talismane_term_extractor/build.xml: unified versions on terminology and core packages
talismane_term_viewer/build.xml: same change as above
talismane_trainer_fr: removed project
talismane_ftbDep: removed project
Release 1.8.1b
Moved to Lefff v3.2 for talismane_fr. Made Lexicon and PosTagMapper more generic to make it easier to accomodate new lexicon versions.
talismane_core/PosTagMapper: new interface for mapping a LexicalEntry to a set of PosTags
talismane_fr/TalismaneFrench: replaced Lefff v2 with Lefff v3.2
talismane_fr/lefff3TalismanePosTagMap: added pos-tag mapping file directly to talismane_fr
talismane_lefff: changes to accomodate v3.2 file format, while remaining compatible with v2
talismane_term_extractor/build.xml: building into main dist directory
talismane_term_veiwer/build.xml: building into main dist directory
Release 1.8.2b
Changed copyright holder from Assaf Urieli to Joliciel Informatique
Fixed issue #8: When using the OUTPUT text marker filter, some text does not get output. This seems to occur when the border between two SentenceHolders corresponds to a sentence border (i.e. no leftover sentence to carry over the output segments).
talismane_core/TalismaneServerThread: Fixed charset issue on input/output
talismane_core/TalismaneImpl: issue #8
talismane_core/SentenceHolder: issue #8
talismane_core/SentenceHolderImpl: issue #8
talismane_core/SentenceImpl: issue #8
talismane_term_extractor/TermExtractorTest: fixed to use new LeffServiceLocator.getInstance() interface
Release 1.8.3.1b - using 4th digit to indicate dev releases
Changed all build files to use Java 1.7
talsimane_core/TalismaneConfig: added startSentence to skip first n sentences when reading a corpus
talismane_core/TalismaneConfig: added includeTransitionLog to view exact transitions that were applied when analysing/evaluating parses
talismane_core/TalismaneConfig: added errorLabels to limit transition log to certain labels only
talismane_core/TalismaneConfig: added port to change the server listening port
talismane_core/AnnotatedCorpusReader: added get/setStartSentence to skip the first n sentences
talismane_core/ParseEvaluationObserverImpl: an observer which wraps a ParseConfigurationProcessor, but only outputs evaluation errors of certain types
talismane_core/TransitionLogWriter: writes the exact sequence of transitions for each parse
talismane_core/PosTaggedToken: now implements PosTaggerContext, so it can be used in context features as well
talismane_core/IfThenElseTokenAddressFeature: so that these features can be used as result of If-then-else and fed to other features
talismane_core/LexiconPosTagFeature: now takes an array of postags, and returns true if any one of them is listed in the glossary
talismane_fr/TalismaneFrench: applying input regex no matter which reader is used
Release 1.8.3.2b
Added talismane_en with support for English (no models yet)
Added inDir option, possibility of analysing all files in a directory structure and generating output files following the same directory structure (via outDir)
Added support for projective and non-projective heads in input/output (as per CONLL-X format)
talismane_core/TalismaneSession: added LinguisticRules for various language-specific rules
talismane_core/DefaultLexicalEntry: created DefaultLexicalEntry, DefaultMorphologyReader, DefaultPosTagMapper to simplify lexicon handling
talismane_core/ParseConfigurationOutput: non-projective heads available
talismane_core/ParseConfigurationTokenOutput: non-projective head available
talismane_core/ParseConfiguration: added getNonProjectiveDependencies() and addManualNonProjectiveDependency
talismane_core/ParserRegexBasedCorpusReader - implementing SentenceDetectorAnnotatedCorpusReader to allow training of sentence detector from CoNLL corpora
talismane_core/ParserRegexBasedCorpusReader - added %NON_PROJ_GOVERNOR% and %NON_PROJ_LABEL% as possibilities in regex
talismane_core/PosTagRegexBasedCorpusReaderImpl: applying TokenFilters and TokenSequenceFilters correctly
talismane_core/AbstractTokenSequence: replaced French specific sentence construction with LinguisticRules
talismane_core/TalismaneConfig: fixed bug where TokeniserModel didn't contain pattern descriptors, also when missing models (was causing crash)
talismane_en: brand new package for English
talismane_fr: fixed license, added implementations for LinguisticRules
talismane_other/CorpusProjectifier: fixed to use new non-projective AND projective arcs
talismane_utils: added CurrentFileObserver, CurrentFileProvider, DirectoryReader, DirectoryWriter, for processing multiple files in directory (both in input and a different output file per input file)
Release 1.8.3b
First release with both English and French implementations
talismane_core/TalismaneConfig: added possibility to evaluate sentence detector
talismane_core/TalismaneConfig: added possibility to replace token filters, text filters, and token sequence filters, by prefixing the filename with "replace:"
talismane_core/TalismaneConfig: no longer reading token filters and token sequence filters from TokeniserModel - always using default filters, or those provided by user
talismane_core/TalismaneImpl: added code for sentence detector evaluation
talismane_core/ParseEvaluationObserverImpl: fixed bug when token had no guessed governor
talismane_core/SentenceDetectorImpl: certain token placeholders can coincide with sentence boundaries (e.g. a sentence ending with "etc.")
talismane_core/TokenRegexFilter: created public interface, private implementation
talismane_core/TokenPlaceholder: added isPossibleSentenceBoundary
talismane_core/TokenRegexFilter: added isPossibleSentenceBoundary
talismane_core/TokenFilterServiceImpl: reading possibleSentenceBoundary parameter from descriptors
talismane_en: added all default models and default filters
talismane_fr: put all token filters into the token_filters file, rather than relying on the TokeniserModel to contain them
Release 1.8.4b
talismane_core/TalismaneServerImpl: preloading models, properly closing socket
talismane_core/TalismaneServerThread: cleaned up code to set ShutDownListener
talismane_fr/TalismaneFrench: fixed bug on wrong dependency label set when training.