fixing the tokenizer syncing bug