ModelCloud
/

gemma-2-9b-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jul 2

Commit

fee147a

•

1 Parent(s): c7fec57

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -1,5 +1,6 @@
---Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
--
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: true

+Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: true