Upload tokenizer.model for quantization
#5
by
GusPuffy
- opened
tokenizer.model is needed to create a GPTQ quant
brucethemoose
changed pull request status to
merged
Actually where did you get this tokenizer.model? I noticed its a different size than the one I madel locally.
Here is where I grabbed it from
huggingface-cli download 01-ai/Yi-34B-200K tokenizer.model --local-dir . --local-dir-use-symlinks False