adding dependency to fsa
added Unicode character class rule-based tokenizer ported from GATE
tokenizer fsm
base gazetteer
cleanup
fix double allocation of annotation features
Merge branch 'master' of github.com:kzn/tokens