squeeze-ai-lab
/

sq-llama-2-7b-w4-s0

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

squeeze-ai-lab commited on Oct 4, 2023

Commit

2ef761a

•

1 Parent(s): 897e465

Update quant_config.json

Files changed (1) hide show

quant_config.json +1 -1

quant_config.json CHANGED Viewed

@@ -1,3 +1,3 @@
 {
-    "w_bit": 4
 }

 {
+    "wbits": 4
 }