Update README.md

README.md

@@ -1,3 +1,25 @@
----
-license: mit
----
+---
+base_model: google/gemma-2-9b-it
+inference: false
+license: apache-2.0
+model_name: Gemma-2-9B-Instruct-4Bit-GPTQ
+pipeline_tag: text-generation
+quantized_by: Granther
+tags:
+- gptq
+---
+
+# Gemma-2-9B-Instruct-4Bit-GPTQ
+- Original Model: [gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it)
+- Model Creator: [google](https://huggingface.co/google)
+
+## Quantization
+- This model was quantized with the Auto-GPTQ library
+
+
+## Metrics
+
+| Benchmark  | Metric | Gemma 2 GPTQ | Gemma 2 9B it |
+| ------------------| ---------- | -----------  | -------------- |
+| [PIQA](piqa)      | 0-shot     | 80.52        | 80.79          |
+| [MMLU](mmlu)      | 5-shot     | 52.0         | 50.00          |