Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

154

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 69

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 828 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16 • 5.52k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 190

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 1.22k • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 402 • 1

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25 • 11

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Updated Sep 26 • 32

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 357 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated Sep 26 • 2.06k

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 32

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 11 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 8 • 1

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 29.5k • 1

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 9

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Sep 26

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 9

brunopio/Llama-3.2-3B-Instruct-nbits4-GS64-Axis1-HQQ

Updated Sep 26 • 3

brunopio/Llama-3.2-3B-Instruct-nbits4-GSNone-Axis0-HQQ

Updated Sep 26 • 2

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 17 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 132 • 1

pingzhou/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 6

rohanprichard/Llama-3.2-3B-Instruct-MLC

Updated Sep 27 • 3

Kondara/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 27 • 21

argearriojas/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 27 • 6

mayanksharma3/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 27 • 85

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1 • 227 • 3

BitStreamX/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 27 days ago • 169

pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF

Text Generation • Updated 22 days ago • 181