Intelligent word tokenization