Isn't it necessary to also include tokenizer.model?

by ArkaAbacus - opened

As per title. This is missing in this repo.

Mistral AI_ org

not sure if it's needed. But feel free to make a PR!

sophiamyang changed discussion status to closed

Hi, thank you for providing the great model, Mixtral-8x22B-Instruct-v0.1.
In my project, I would like to access to the tokenizer with use_fast = False, which probably needs tokenizer.model.
Can you provide tokenizer.model?

Sign up or log in to comment