ModelCloud
/

gemma-2-9b-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

lrl-modelcloud commited on Jul 2

Commit

1d82a4a

•

1 Parent(s): 8ba832c

Update quantize_config.json

Files changed (1) hide show

quantize_config.json +1 -1

quantize_config.json CHANGED Viewed

@@ -12,6 +12,6 @@
   "quant_method": "gptq",
   "checkpoint_format": "gptq",
   "meta": {
-    "quantizer": "gptqmodel:0.9.1"
   }
 }

   "quant_method": "gptq",
   "checkpoint_format": "gptq",
   "meta": {
+    "quantizer": "gptqmodel:0.9.2"
   }
 }