The model does not exist in the repository.

#1
by tiangou0123456 - opened

I did not see the guff file in the "file and versions" section. Please double-check. Thank you very much.

We are still uploading the GGUF file. Due to the network problem and the large size of this GGUF file, it may take some time. We are really sorry for that. If you want to use our q4 GGUF, you can use the ollama q4 model first.

https://ollama.com/wangshenzhi/llama3-70b-chinese-chat-ollama-q4

We have now uploaded the GGUF file.

shenzhi-wang changed discussion status to closed

可以提供70B 8bit的gguf 吗?谢谢!

Sign up or log in to comment