layed out tokenizer, listed all possible tokens.