John6666
/

Llama-3.2-3B-Instruct-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Quants of unsloth/Llama-3.2-3B-Instruct.

Downloads last month: 87

Safetensors

Model size

1.14B params

Tensor type

F32

·

BF16

·

U8

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Model tree for John6666/Llama-3.2-3B-Instruct-bnb-4bit

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

unsloth/Llama-3.2-3B-Instruct

Quantized

(50)

this model