Release 1.6.2b
talismane_core/tokeniser: Added new PatternTokeniser: tokenises entire compounds, rather than intervals between tokens, to avoid inconsistent compounds lower down in beam
talismane_core/TalismaneConfig: added token evaluator to default interface
talismane_core/TalismaneImpl: added token evaluator to default interface
talismane_core/TokenisedAtomicTokenSequenceImpl: adding white spaces to inferred token sequence
talismane_core/tokeniser/features: created TokenPatternMatchFeature, and implementations for all pattern-specific features
talismane_core/tokeniser/patterns: created CompoundPatternTokeniser and CompoundPatternEventStream, renamed PatternTokeniserImpl to IntervalPatternTokeniser and TokeniserEventStream to IntervalPatternEventStream
talismane_core/tokeniser/patterns: renamed TokenPatternMatch to TokenPatternMatchSequenceImpl, extracted TokenPatternMatchSequence interface
talismane_core/tokeniser/patterns: renamed TokenMatch to TokenPatternMatchImpl, extracted TokenPatternMatch interface
talismane_fr: replaced default tokeniser by compound tokeniser
talismane_trainer_fr/tokeniserPatterns_fr: marked portions of patterns that shouldn't have statistical decision applied
talismane_trainer_fr/tokeniser_compound_fr: created features for compound pattern tokeniser
talismane_trainer_fr/TokeniserMaxentRunner: can now train for either Interval or Compound pattern tokeniser