Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

32,501

Full-text search

Active filters: 4-bit

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 9 days ago • 34k • 53

ginipick/QwQ-32B-NF4

Text Generation • Updated Mar 21 • 135 • 27

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 5 days ago • 4.29k • 9

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 5 days ago • 1.33k • 8

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • Updated 2 days ago • 8 • 6

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 75.1k • 65

fantos/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 20 • 406 • 18

Qwen/Qwen3-4B-AWQ

Text Generation • Updated 9 days ago • 1.6k • 4

mlx-community/Qwen3-4B-4bit

Text Generation • Updated 19 days ago • 7.01k • 6

mlx-community/Qwen3-30B-A3B-4bit-DWQ

Text Generation • Updated 12 days ago • 510 • 19

mlx-community/Qwen3-30B-A3B-4bit-DWQ-0508

Text Generation • Updated 9 days ago • 374 • 11

mlx-community/Qwen3-30B-A3B-4bit-DWQ-05082025

Text Generation • Updated 9 days ago • 213 • 5

OrionCAF/TurkishLaw

Text Generation • Updated 2 days ago • 4 • 3

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 206k • 67

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 55.2k • 56

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 21.3k • 33

unsloth/gemma-3-4b-it-bnb-4bit

Image-Text-to-Text • Updated 5 days ago • 14.6k • 8

lmstudio-community/Qwen3-30B-A3B-MLX-4bit

Text Generation • Updated 18 days ago • 4.08k • 19

mlx-community/Qwen3-235B-A22B-4bit

Text Generation • Updated 18 days ago • 929 • 6

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 18 days ago • 135k • 3

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • Updated 17 days ago • 474 • 2

mlx-community/Qwen3-235B-A22B-mixed-3-6bit

Text Generation • Updated 8 days ago • 88 • 2

Qwen/Qwen2.5-Omni-7B-GPTQ-Int4

Any-to-Any • Updated 2 days ago • 349 • 2

TheBloke/llama2_7b_chat_uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 101 • 69

TheBloke/Airoboros-L2-13B-2.2-GPTQ

Text Generation • Updated Sep 27, 2023 • 8 • 5

TheBloke/airoboros-l2-13B-2.2.1-AWQ

Text Generation • Updated Nov 9, 2023 • 34 • 1

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 27.6k • 11

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 87 • 16

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31, 2024 • 35 • 20

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31, 2024 • 159 • 21