tokenizer.js didnt need fixing after all