Hugging Face's logo

LoneStriker
/
opus-v0.5-70b-3.0bpw-h6-exl2

Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
opus-v0.5-70b-3.0bpw-h6-exl2 / output-00003-of-00004.safetensors

Commit History

ExLLaMA V2 quant of opus-v0.5-70b-3.0bpw-h6-exl2
bb466b3

LoneStriker commited on