tokenizer.model missing?
#1
by
b0968
- opened
is the file "tokenizer.model" missing?
Seems so, thanks for flagging this. Will add asap :)
bjoernp
changed discussion status to
closed
@bjoernp Could you please share the steps you used to create tokenizer.model from tokenizer.json. I am trying out SmolLm2 model(https://huggingface.co/HuggingFaceTB/SmolLM-135M-Instruct/tree/main) in executorch which requires tokenizer.model, but on huggingface only tokenizer.json is present.