Hugging Face's logo

Sao10K
/
Euryale-1.4-L2-70B

Text Generation
Transformers
Safetensors
English
llama
Inference Endpoints
text-generation-inference
Model card Files Community
1

EXL2 Quants

#1
by OrangeApples - opened
Discussion
OrangeApples

@LoneStriker will you be making EXL2 quants of this? A 2.4bpw one would be nice to fit in 24GB VRAM.

LoneStriker

Sure. I don't recall why I didn't create them for this version, but I can put it into the queue.

LoneStriker

Quants here:
https://huggingface.co/models?sort=created&search=lonestriker+euryale-1.4-l2-70b

Sign up or log in to comment