Panchovix
/

airoboros-l2-70b-gpt4-1.4.1_4bit-bpw_variants_h6-exl2

Text Generation

Inference Endpoints

Model card Files Files and versions Community

airoboros-l2-70b-gpt4-1.4.1_4bit-bpw_variants_h6-exl2 / README.md

Panchovix's picture

Update README.md

a925b6b about 1 year ago

|

164 Bytes

metadata

license: other

4.75 bit quantization of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2.

More info TODO.