Kooten
/

MiquMaid-v1-70B-3.5bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MiquMaid-v1-70B-3.5bpw-exl2 / README.md

Kooten's picture

Update README.md

ce32df2 verified 6 months ago

|

No virus

667 Bytes

MiquMaid-v1-70B 3.5bpw

Description

Exllama quant of NeverSleep/MiquMaid-v1-70B

Other quants:

EXL2: 3.5bpw, 3bpw, 2.4bpw

GGUF:

2bit Imatrix GGUF

NeverSleeps Official Quants

Custom format:

### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}

Contact

Kooten on discord