Granther
/

Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Gemma-2-9B-Instruct-4Bit-GPTQ / gemma_quantize.ipynb

Commit History

Upload gemma_quantize.ipynb with huggingface_hub

41dacb0
verified

Granther commited on Jul 2