adriabama06
/

Llama-3.2-1B-Instruct-GPTQ-8bit-128g

Text Generation

8-bit precision

Model card Files Files and versions Community

Edit model card

GPTQ Version of meta-llama/Llama-3.2-1B: 8 bit, 128 groupsize
✅ Tested on vLLM

Downloads last month: 353

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for adriabama06/Llama-3.2-1B-Instruct-GPTQ-8bit-128g

Base model

meta-llama/Llama-3.2-1B-Instruct

Quantized

(140)

this model