Detailed explanation of tokenizer