README.md

---
base_model: google/gemma-2-9b-it
inference: false
license: apache-2.0
model_name: Gemma-2-9B-Instruct-4Bit-GPTQ
pipeline_tag: text-generation
quantized_by: Granther
tags:
- gptq
---

# Gemma-2-9B-Instruct-4Bit-GPTQ
- Original Model: [gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it)
- Model Creator: [google](https://huggingface.co/google)

## Quantization
- This model was quantized with the Auto-GPTQ library


## Metrics

| Benchmark  | Metric | Gemma 2 GPTQ | Gemma 2 9B it |
| ------------------| ---------- | -----------  | -------------- |
| [PIQA](piqa)      | 0-shot     | 80.52        | 80.79          |
| [MMLU](mmlu)      | 5-shot     | 52.0         | 50.00          |