Finished the tokenization rules.