Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,842

Full-text search

Active filters: 4-bit

Qwen/QwQ-32B-AWQ

Text Generation • Updated 16 days ago • 193k • 99

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 21 days ago • 358 • 2

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 17 days ago • 2.03k • 8

unsloth/gemma-3-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 14 days ago • 91.7k • 6

mlx-community/QwQ-DeepSeek-R1-SkyT1-Flash-Lightest-32B-mlx-4Bit

Text Generation • Updated 13 days ago • 1.04k • 6

unsloth/gemma-3-27b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 14 days ago • 14.8k • 5

unsloth/c4ai-command-a-03-2025-unsloth-bnb-4bit

Text Generation • Updated 13 days ago • 340 • 3

OPEA/gemma-3-27b-it-int4-AutoRound-cpu

Updated 7 days ago • 44 • 2

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated 5 days ago • 497 • 2

unsloth/Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit

Updated 8 days ago • 5.22k • 4

OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym

Updated 8 days ago • 156 • 3

OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym

Updated 8 days ago • 2.7k • 4

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 116 • 219

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 493 • 193

TheBloke/gpt4-x-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 29 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.71k • 318

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.26k • 163

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 791 • 577

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 214 • 85

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 26 • 13

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 360 • 176

TheBloke/WizardLM-33B-V1.0-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 74 • 43

TheBloke/airoboros-33B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 64 • 27

TheBloke/WizardLM-13B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 108 • 46

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 126 • 146

TheBloke/Chronos-Hermes-13B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 57 • 39

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 84 • 15

TheBloke/Chronoboros-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 108 • 29

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 183 • 5

TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 711 • 121