Text Generation
Transformers
GGUF
English
mixtral
text-generation-inference

Commit History

Add Q6 and Q8 models
3670b9d

Xin Liu commited on

Add Q5 models
ebab9b8

Xin Liu commited on

Add Q4_K_M and Q4_K_S models
b5e1d9d

Xin Liu commited on

Add Q3_K_S and Q4_0 models
b316ec2

Xin Liu commited on

Add Q3_K_M model
f2db3f4

Xin Liu commited on

Add Q3 model
abe31be

Xin Liu commited on

Add Q2 model
10a334e

Xin Liu commited on

initial commit
45ae6a6
verified

apepkuss79 commited on