small progress with alphanum_tokenizer(), and am considering how exactly to structure Token class in terms of identifying the type of token in general (boolean), and specifically (false/true), and the value of the token