Added external word lists
talismane_core/TokenRegexFilterImpl: \p{WordList(Name,true|false,true|false)} will replace contents of word list with a pipe delimited list of words in the regex
If first parameter is true, diacritics are optional (e.g. é is replaced by [ée])
If the second parameter is true, uppercase characters are optional (e.g. E is replaced by [Ee])
The regex should surround this by parentheses for it to work, e.g. \b(\p{WordList(FrenchNames,true,false)})\b
talismane_machine_learning/ExternalWordList - when read from a text file, should start with:
Type: WordList
Name: name
followed by the list of words