Hugging Face's logo

LoneStriker
/
Smaug-72B-v0.1-AWQ

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
3

exl2 quant kyllene 34B

#1
by JNewber - opened
Discussion
JNewber

https://huggingface.co/TeeZee/Kyllene-34B-v1.1

Could we have a exl2 quant for this 34B yi model.

LoneStriker
 Owner

Sure, I'll add it to the queue

LoneStriker
 Owner

Quants here: https://huggingface.co/models?search=LoneStriker/Kyllene-34B-v1.1

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment