Isn't it necessary to also include tokenizer.model?
#14
by
ArkaAbacus
- opened
As per title. This is missing in this repo.
not sure if it's needed. But feel free to make a PR!
sophiamyang
changed discussion status to
closed
@sophiamyang
Hi, thank you for providing the great model, Mixtral-8x22B-Instruct-v0.1.
In my project, I would like to access to the tokenizer with use_fast = False, which probably needs tokenizer.model.
Can you provide tokenizer.model?