Hugging Face's logo

01-ai
/
Yi-34B-200K

Text Generation
Transformers
PyTorch
Safetensors
llama
Inference Endpoints
text-generation-inference
Model card Files Community
21

Yi-34B-200K 是否有4bit量化版?

#20
by william0014 - opened
Discussion
william0014

Yi-34B-200K 是否有4bit量化版AWQ OR GPTQ?

YShow

官方没有提供，这里有第三方的https://huggingface.co/TheBloke/RpBird-Yi-34B-200k-AWQ

lorinma changed discussion status to closed

Sign up or log in to comment