Edit Models filters

Model Tree

Qwen/Qwen2.5-72B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

50

Full-text search

Active filters: Qwen/Qwen2.5-72B-Instruct

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft

Updated 6 days ago • 20 • 4

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-65536-woft

Updated 6 days ago • 22 • 1

gghfez/Magnum-v1-72b-Qwen2.5-exl2-4.5bpw

Updated Oct 2 • 4

gghfez/Magnum-v1-72b-Qwen2.5-exl2-8.0bpw

Updated Oct 2 • 5

mlc-ai/Qwen2.5-72B-Instruct-q4f32_1-MLC

Updated Oct 3 • 3

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 7

mav23/Rombos-LLM-V2.5-Qwen-72b-GGUF

Updated Oct 14 • 35

GGorman/Qwen2.5-72B-Instruct-Q8-mlx

Text Generation • Updated Oct 19 • 12

CED6688/magnum-v4-72b-AWQ

Text Generation • Updated 29 days ago • 56

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw

Text Generation • Updated 21 days ago • 5

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw

Text Generation • Updated 21 days ago • 6

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.50bpw

Updated 20 days ago • 11

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.25bpw

Updated 20 days ago • 7

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • Updated 20 days ago • 77

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated 20 days ago • 151

XelotX/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated 18 days ago • 69

LatentWanderer/Rombos-LLM-V2.5-Qwen-72b-6.5bpw-h8-exl2

Text Generation • Updated 11 days ago • 4

bullerwins/Athene-V2-Chat-exl2_4.0bpw

Text Generation • Updated 8 days ago • 24

bullerwins/Athene-V2-Chat-exl2_5.0bpw

Text Generation • Updated 8 days ago • 12

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated 6 days ago • 16