tokenizer model?
#2
by
bdambrosio
- opened
I'd like to exllamav2 quantize, but need tokenizer model. Which one can I use? thanks!
The tokenizer is included in the model files. For exllamav2, it will load from the tokenizer.json file by default.
jklj077
changed discussion status to
closed