Edit Models filters

Model Tree

Qwen/Qwen2.5-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

91

Full-text search

Active filters: Qwen/Qwen2.5-7B-Instruct

Triangle104/Qwen2.5-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 19 • 10

Triangle104/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 19 • 7

DrNicefellow/Qwen2.5-7B-Instruct-4.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Updated Sep 20 • 7 • 1

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

Updated Sep 20 • 6

DrNicefellow/Qwen2.5-7B-Instruct-6.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20 • 3

DrNicefellow/Qwen2.5-7B-Instruct-2.0bpw-exl2

Updated Sep 20 • 10

DrNicefellow/Qwen2.5-7B-Instruct-1.0bpw-exl2

Updated Sep 20 • 6

DrNicefellow/Qwen2.5-7B-Instruct-5.5bpw-exl2

Updated Sep 20 • 6

DrNicefellow/Qwen2.5-7B-Instruct-4.5bpw-exl2

Updated Sep 20 • 7

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 5

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 15 • 1

mukel/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 27 • 27

idasummer/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 24 • 4

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

Updated 6 days ago • 11

QuantFactory/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Sep 25 • 254 • 1

mradermacher/Qwen2.5-7B-Instruct-GGUF

Updated Oct 11 • 301 • 2

mradermacher/Qwen2.5-7B-Instruct-i1-GGUF

Updated Oct 11 • 274 • 1

aswqazx/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 27 • 5

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27 • 4

Kondara/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28 • 4

VPTQ-community/Qwen2.5-7B-Instruct-v16-k65536-65536-woft

Updated 6 days ago • 57 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

Updated 6 days ago • 12

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

Updated 6 days ago • 14

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

Updated 6 days ago • 95

mashima/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 1 • 7

QuantFactory/Replete-LLM-V2.5-Qwen-7b-GGUF

Updated Oct 2 • 90 • 1

Kotokin/Replete-LLM-V2.5-Qwen-7b-exl2-4bpw

Text Generation • Updated Oct 1 • 11

jacobcarajo/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2 • 5