added charset_table for correct tokenization regarding internationl strings