ModelCloud
/

gemma-2-9b-it-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jul 9

Commit

7ea624d

•

1 Parent(s): 9d07749

Update README.md

Files changed (1) hide show

README.md +9 -1

README.md CHANGED Viewed

@@ -1,5 +1,13 @@
-Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: false

+---
+license: apache-2.0
+tags:
+- gemma 2
+- gptq
+- 4bit
+- gptqmodel
+---
+This model has been quantized using [GPTQModel](https://github.com/ModelCloud/GPTQModel).
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: false