xxx777xxxASD
/

PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation

Mixture of Experts

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

xxx777xxxASD commited on Mar 17

Commit

eaedbad

•

1 Parent(s): be6635e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,4 +10,4 @@ tags:
 ExLlamaV2 BPW 4.0 quant of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)
-(Fits in 12GB VRAM/14k context/4-bit cache)


10
11	ExLlamaV2 BPW 4.0 quant of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)
12
13	+ (Fits in 12GB VRAM/16k context/4-bit cache)