shuyuej
/

Mixtral-8x7B-v0.1-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuyuej commited on Jul 25

Commit

ddf6f06

•

1 Parent(s): 59fef18

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "mistralai/Mixtral-8x7B-v0.1",
   "architectures": [
     "MixtralForCausalLM"
   ],

 {
+  "_name_or_path": "shuyuej/Mixtral-8x7B-v0.1-GPTQ",
   "architectures": [
     "MixtralForCausalLM"
   ],