dummy tokenizer passes
kinda working
work on tokenizer
token rework
consume bug for regex
Merge pull request #2 from mucbuc/dev

add tokenizer and test