README.md

metadata

base_model: google/gemma-2-9b-it
inference: false
license: apache-2.0
model_name: Gemma-2-9B-Instruct-4Bit-GPTQ
pipeline_tag: text-generation
quantized_by: Granther
tags:
  - gptq

Gemma-2-9B-Instruct-4Bit-GPTQ

• Original Model: gemma-2-9b-it
• Model Creator: google

Quantization

• This model was quantized with the Auto-GPTQ library

Metrics

Benchmark	Metric	Gemma 2 GPTQ	Gemma 2 9B it
PIQA	0-shot	80.52	80.79
MMLU	5-shot	52.0	50.00