tokens: If one of MySQL 's collations , for example utf8_general_ci , would be suitable ( even if you do n't use MySQL ) or would be a decent starting point that you can adapt then you might find this useful : http://thefsb.wordpress.com/2010/12/
ner_tags: O O O B-Application O O O O O B-Value O O O O O O O O O O O B-Application O O O O O O O O O O O O O O O O O O O O