Hugging Face's logo

shenzhi-wang
/
Llama3.1-8B-Chinese-Chat

Text Generation
Transformers
Safetensors
GGUF
English
Chinese
llama
llama-factory
orpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
4

坐等70b chinese

#1
by iwaitu - opened
Discussion
iwaitu

最好再有个 70b awq 或者 gptq 的4位量化，没办法，只有一张 A100

shenzhi-wang
 Owner

来了，我们提供了q3, q4, q8, f16的各个版本的gguf

https://huggingface.co/shenzhi-wang/Llama3.1-70B-Chinese-Chat

Sign up or log in to comment