Granther
/

Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Gemma-2-9B-Instruct-4Bit-GPTQ / gemma_quantize.ipynb

Granther's picture

Upload gemma_quantize.ipynb with huggingface_hub

41dacb0 verified 5 months ago

576 kB

Rendering notebook...