Hugging Face's logo

xxx777xxxASD
/
PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation Transformers Safetensors English mixtral Merge Mixture of Experts conversational Inference Endpoints text-generation-inference
Model card Files Community
Edit model card

image/png

ExLlamaV2 BPW 4.0 quant of xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k

(Fits in 12GB VRAM/16k context/4-bit cache)

Downloads last month
29

Collection including xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0