NeverSleep
/

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (1)

A new HQQ Quantization in <16GB VRAM

#8 opened about 1 month ago by

Silly Tavern Settings

#7 opened 3 months ago by

What is the correct prompt format for this model?

#6 opened 3 months ago by

Peak

#5 opened 4 months ago by

1.64-upmanship (2 bit HQQ quantize)

#3 opened 4 months ago by

ProphetOfBostrom

EXL2 - 3.64 bpw

#2 opened 4 months ago by

Recommended settings?

#1 opened 4 months ago by