Hugging Face's logo

LoneStriker
/
opus-v0.5-70b-2.4bpw-h6-exl2

Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
opus-v0.5-70b-2.4bpw-h6-exl2 / generation_config.json

Commit History

ExLLaMA V2 quant of opus-v0.5-70b-2.4bpw-h6-exl2
6c395b0

LoneStriker commited on