altomek
/

mini-magnum-12b-v1.1-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Edit model card

nini-magnum-12b-v-1.1

ExLlamav2 8 bpw quants of https://huggingface.co/intervitens/mini-magnum-12b-v1.1

Downloads last month: 12

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/mini-magnum-12b-v1.1-8bpw-EXL2

Base model

intervitens/mini-magnum-12b-v1.1

Quantized

(12)

this model