revert tokenizer update

#9
by Leyo HF staff - opened
HuggingFaceM4 org
No description provided.
Leyo changed pull request status to open
Leyo changed pull request status to merged

Sign up or log in to comment