alchemonaut
/

QuartetAnemoi-70B-t0.0001

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

lodrick-the-lafted commited on Feb 17

Commit

ab56f2c

•

1 Parent(s): 3b3c301

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -130,6 +130,8 @@ Some exl2 quants were made by llmixer too:
  - [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
  - [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
 <br/>
 <br/>

  - [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
  - [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
+As well as [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF) by Nexesenex.
 <br/>
 <br/>