Edit Models filters

Model Tree

Qwen/Qwen2.5-3B

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

64

Base only

Active filters: Qwen/Qwen2.5-3B

bartowski/Qwen2.5-3B-GGUF

Text Generation • 3B • Updated Sep 15, 2024 • 15.4k • 6

CalamitousFelicitousness/Qwen2.5-3B-Instruct-fp8-dynamic

Text Generation • 3B • Updated Sep 18, 2024 • 195

unsloth/Qwen2.5-3B-bnb-4bit

Text Generation • 3B • Updated Apr 28, 2025 • 2.55k • 4

QuantFactory/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 19, 2024 • 1.11k • 3

punk778/Qwen2.5-3B-Q4_0-GGUF

Text Generation • 3B • Updated Sep 19, 2024 • 130

ThomasBaruzier/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 28, 2025 • 3.04k • 1

RagnarokChan/Qwen2.5-3B-Q4_0-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 18

RagnarokChan/Qwen2.5-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 69

POWERHACK/TheoVersion2

Text Generation • 0.7B • Updated Apr 28, 2025 • 20

mradermacher/Qwen2.5-3B-GGUF

3B • Updated Aug 1, 2025 • 1.23k

mradermacher/Qwen2.5-3B-i1-GGUF

3B • Updated Oct 11, 2024 • 2.01k

POWERHACK/Qwen2.5-3B-Q8_0-GGUF

Text Generation • 3B • Updated Sep 27, 2024 • 29

QuantFactory/raspberry-3B-GGUF

3B • Updated Oct 7, 2024 • 699 • 4

RedHatAI/Qwen2.5-3B-quantized.w8a16

Text Generation • 3B • Updated Nov 26, 2024 • 108

osllmai-community/Qwen2.5-3B-bnb-4bit

Text Generation • 3B • Updated Jan 24, 2025 • 20

Volko76/Qwen2.5-Coder-3B-GGUF

Text Generation • 3B • Updated Apr 27, 2025 • 223

RedHatAI/Qwen2.5-3B-FP8-dynamic

Text Generation • 3B • Updated Dec 3, 2024 • 311 • 1

RedHatAI/Qwen2.5-3B-quantized.w8a8

Text Generation • 3B • Updated Dec 3, 2024 • 17 • 1

drmcbride/Qwen2.5-3B-Q8_0-GGUF

Text Generation • 3B • Updated Dec 12, 2024 • 21

RedHatAI/Qwen2.5-3B-quantized.w4a16

Text Generation • 3B • Updated Aug 5 • 28 • 1

itlwas/Qwen2.5-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 44

QuantFactory/Dolphin3.0-Qwen2.5-3b-GGUF

3B • Updated Jan 5, 2025 • 1.41k • 3

JustineF/Qwen2.5-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 7, 2025 • 27

Lucy-in-the-Sky/Qwen2.5-3B-Q8_0-GGUF

Text Generation • 3B • Updated Apr 29, 2025 • 16

unsloth/Qwen2.5-3B-unsloth-bnb-4bit

Text Generation • 3B • Updated Apr 28, 2025 • 3.8k

EasierAI/Qwen-2.5-3B

Text Generation • 3B • Updated Apr 28, 2025 • 411

DevQuasar-13/Qwen.Qwen2.5-3B-GGUF

Text Generation • 3B • Updated Apr 27, 2025 • 346 • 1

Mungert/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 24, 2025 • 2.38k • 5

zhitels/Qwen2.5-3B-4bit

Text Generation • 3B • Updated Apr 28, 2025 • 21

LakithGR/QWEN2.5-3b-DAP

3B • Updated Mar 30, 2025 • 14 • 1