Edit Models filters

text-generation-inference

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

text-embeddings-inference

Carbon Emissions

Models

2,458

Full-text search

Active filters: qwen2

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated 16 days ago • 2.89k • 10

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated 20 days ago • 27.2k • 11

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated 16 days ago • 303 • 2

Qwen/Qwen2-0.5B-Instruct-AWQ

Text Generation • Updated 20 days ago • 492 • 1

Qwen/Qwen2-0.5B-Instruct-MLX

Text Generation • Updated 20 days ago • 311 • 4

Qwen/Qwen2-1.5B-Instruct-MLX

Text Generation • Updated 20 days ago • 378 • 2

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated 20 days ago • 669 • 7

mlx-community/Qwen2-7B-Instruct-8bit

Text Generation • Updated 20 days ago • 24 • 2

mlx-community/Qwen2-7B-8bit

Text Generation • Updated 20 days ago • 7 • 1

mlx-community/Qwen2-72B-Instruct-4bit

Text Generation • Updated 19 days ago • 14 • 1

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated 20 days ago • 2.44k • 1

unsloth/Qwen2-1.5B

Text Generation • Updated 20 days ago • 4.36k • 1

unsloth/Qwen2-7B

Text Generation • Updated 20 days ago • 1.15k • 1

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated 20 days ago • 9.22k • 2

LoneStriker/Qwen2-7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated 20 days ago • 5 • 1

unsloth/Qwen2-7B-Instruct

Text Generation • Updated 20 days ago • 2.18k • 2

unsloth/Qwen2-72B-bnb-4bit

Text Generation • Updated 20 days ago • 185 • 1

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated 20 days ago • 533 • 3

mlx-community/dolphin-2.9.2-qwen2-72b-4bit

Updated 19 days ago • 8 • 1

mlx-community/dolphin-2.9.2-qwen2-72b-8bit

Updated 19 days ago • 8 • 2

bullerwins/Qwen2-72B-Instruct_exl2_8.0bpw

Text Generation • Updated 19 days ago • 9 • 1

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated 20 days ago • 3.48k • 1

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated 15 days ago • 48 • 3

denru/Qwen2-72B-Instruct-4_0bpw-h6-exl2-pippa

Text Generation • Updated 19 days ago • 1 • 1

LoneStriker/Qwen2-72B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated 19 days ago • 6 • 1

LoneStriker/Qwen2-72B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated 19 days ago • 23 • 1

second-state/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 19 days ago • 1.79k • 1

gaianet/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated 19 days ago • 535 • 1

LoneStriker/Qwen2-72B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated 19 days ago • 3 • 1

gbueno86/Qwen2-72B-Instruct-exl2-8.0bpw

Text Generation • Updated 19 days ago • 1 • 1