Hugging Face's logo

LoneStriker
/
Llama-3-70B-Instruct-Gradient-524k-3.5bpw-h6-exl2

Text Generation
Transformers
Safetensors
English
llama
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
1
New discussion

Any chance you can make a 3.0bpw version of this?
#1 opened 8 months ago by
Goldkoron