Kooten
/

Echidna-13b-v0.3-4bpw-h8-exl2

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Kooten commited on Oct 29, 2023

Commit

de42703

•

1 Parent(s): b4382ab

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags:
 Exllama 2 quant of [NeverSleep/Echidna-13b-v0.3](https://huggingface.co/NeverSleep/Echidna-13b-v0.3)
-3 BPW, Head bit set to 8
 ## VRAM
 My VRAM usage with 13B models are:

 Exllama 2 quant of [NeverSleep/Echidna-13b-v0.3](https://huggingface.co/NeverSleep/Echidna-13b-v0.3)
+4 BPW, Head bit set to 8
 ## VRAM
 My VRAM usage with 13B models are: