Panchovix

/

airoboros-l2-70b-gpt4-1.4.1_5.0bpw-h6-exl2

like 8

Thanks!

I did use https://huggingface.co/spaces/safetensors/convert/tree/main with https://discuss.huggingface.co/t/bin-to-safetensors-without-publishing-it-on-hub/39956/3 suggestion, and it worked fine.

Also, seems the text-generation-webui has a script as well to do it, but I haven't tested it.

Sweet! So annoying that this convert script doesn't allow local conversion by design. Would you mind sharing the edited script please?

Sadly I've had no luck with text-generation-webui convert-to-safetensors.py - https://github.com/turboderp/exllamav2/issues/20

Sure, uploaded one into the 70b safetensor fp16 model https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/tree/main/bin2safetensors