TheBloke
/

Noromaid-13B-v0.3-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Jan 7

Commit

6694865

•

1 Parent(s): 4cc1fc2

Upload README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -413,7 +413,7 @@ This repo contains fp16 files of Noromaid-13b-v0.3.
 <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
-<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
 <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->

 <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
+[exl2[other quants linked on the hf] - by AzureBlack](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2)
 <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->