Granther
/

Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Gemma-2-9B-Instruct-4Bit-GPTQ

1 contributor

History: 3 commits

Granther's picture

Upload gemma_quantize.ipynb with huggingface_hub

41dacb0 verified 5 months ago