Hugging Face's logo

MaziyarPanahi
/
Yi-9B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
arxiv:2311.16502
arxiv:2401.11944
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
3

Thanks for your quants!

#3
by Cran-May - opened
Discussion
Cran-May

Would you mind making a GGUF quantization for feeltheAGI/yi-super-9B as well?
https://huggingface.co/feeltheAGI/yi-super-9B

MaziyarPanahi
 Owner

@Cran-May of course! Uploads will be available here: https://huggingface.co/MaziyarPanahi/yi-super-9B-GGUF

Sign up or log in to comment