Kotokin
/

Merged-RP-Stew-V2-51B-exl2-4bpw

Text Generation

Not-For-All-Audiences

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Kotokin commited on Apr 18

Commit

29b6d91

•

1 Parent(s): fb464a6

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -10,8 +10,7 @@ tags:
 ---
 ORIGIGNAL MODEL LINK https://huggingface.co/ParasiticRogue/Merged-RP-Stew-V2-34B
-Hi, this is the rp-stew-v2 model enlarged up to 90 layers. To be honest, I don't know why, but someone might need it. I'm just testing it myself, compared to the original.
-I will post the exl2 quantization of 4 bits soon.
 # Merged-Vicuna-RP-Stew-51B

 ---
 ORIGIGNAL MODEL LINK https://huggingface.co/ParasiticRogue/Merged-RP-Stew-V2-34B
+exl2 4 bits.
 # Merged-Vicuna-RP-Stew-51B