Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

1,960

Full-text search

Active filters: chat

bartowski/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 7 • 1.25k • 15

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 6 • 18 • 5

NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 6 • 21 • 1

Zoyd/Qwen_Qwen2-7B-Instruct-4_0bpw_exl2

Text Generation • Updated Jun 6 • 7

Zoyd/Qwen_Qwen2-7B-Instruct-3_5bpw_exl2

Text Generation • Updated Jun 6 • 4

bartowski/Qwen2-7B-Instruct-exl2

Text Generation • Updated Jun 6 • 5 • 4

Zoyd/Qwen_Qwen2-7B-Instruct-3_75bpw_exl2

Text Generation • Updated Jun 6 • 4

legraphista/Qwen2-7B-Instruct-IMat-GGUF

Text Generation • Updated Jun 6 • 3k • 4

mlx-community/Qwen2-0.5B-Instruct-4bit

Text Generation • Updated Jun 6 • 17 • 1

legraphista/Qwen2-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Jun 6 • 3.21k

Zoyd/Qwen_Qwen2-7B-Instruct-6_0bpw_exl2

Text Generation • Updated Jun 6 • 5

Zoyd/Qwen_Qwen2-7B-Instruct-4_25bpw_exl2

Text Generation • Updated Jun 6 • 4

Zoyd/Qwen_Qwen2-7B-Instruct-5_0bpw_exl2

Text Generation • Updated Jun 6 • 12

legraphista/Qwen2-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Jun 6 • 7.43k • 1

Zoyd/Qwen_Qwen2-7B-Instruct-6_5bpw_exl2

Text Generation • Updated Jun 6 • 3

Zoyd/Qwen_Qwen2-7B-Instruct-8_0bpw_exl2

Text Generation • Updated Jun 6 • 6

bullerwins/Qwen2-72B-Instruct_exl2_8.0bpw

Text Generation • Updated Jun 7 • 2 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 6 • 33 • 1

afrideva/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 269 • 1

afrideva/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 232 • 2

bullerwins/Qwen2-72B-Instruct_exl2_6.0bpw

Text Generation • Updated Jun 7 • 3

bullerwins/Qwen2-72B-Instruct_exl2_5.0bpw

Text Generation • Updated Jun 7 • 6

bullerwins/Qwen2-72B-Instruct_exl2_4.0bpw

Text Generation • Updated Jun 7 • 3

legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF

Text Generation • Updated Jun 21 • 538 • 3

mradermacher/Qwen2-1.5B-Instruct-GGUF

Updated Jun 6 • 291

mradermacher/Qwen2-7B-Instruct-GGUF

Updated Jun 6 • 575

mradermacher/Qwen2-0.5B-Instruct-GGUF

Updated Jun 6 • 777

mradermacher/Qwen2-7B-Instruct-i1-GGUF

Updated Aug 2 • 1.39k

MCZK/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 7 • 202

legraphista/Qwen2-72B-Instruct-IMat-GGUF

Text Generation • Updated Jun 7 • 2.95k • 1