tokenizer finished

i'm a fucking moron