Release 1.8.5.2b
TalismaneConfigImpl: added options tokeniserType to enable simple deterministic tokenisation, and preloadLexicon, to indicate whether or not the lexicon has to be loaded ahead of time
SimpleTokeniser: complete rewrite to be based entirely on filters
Token: changed attributes to a Map<String,String>, for storing attributes against tokens
TokenImpl: reads attributes from atomic parts when token has only a single non-whitespace part
TokenSequenceImpl: read attributes from placeholders
DiacriticRemover: new TokenFilter for removing all diacritics
LowercaseFilter: new TokenFilter for placing all text in lower case
TokenFilterServiceImpl: added ability to specify group index in parameters
TokenRegexFilter: added attributes, ability to set group index after instantiation
talismane_fr: new classes specifically for handling the SPMRL French corpus