GGUF file

#8
by BB8-dev - opened

大神您好,方便上传一下GGUF格式的模型文件吗?感激不尽!!

已经看到评测,效果很棒,期待gguf

期待gguf,感谢感谢!

We provide the official 8bit-quantized and fp16 versions of Llama3-8B-Chinese-Chat in the following links, respectively. You are welcome to have a try!

8bit-quantized: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit
fp16: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-fp16

shenzhi-wang changed discussion status to closed

Sign up or log in to comment