Halfway done with the tokenizer. Also did some housekeeping

Signed-off-by: shrimpboyho <shrimpboyhoftw@gmail.com>