Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,250

Full-text search

Active filters: exl2

LoneStriker/Qwen2-72B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Jun 7 • 4 • 2

LoneStriker/Qwen2-72B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Jun 7 • 7

LoneStriker/Qwen2-72B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Jun 7 • 3

denru/L3-MS-Astoria-70b-4_0bpw-h6-exl2-pippa

Text Generation • Updated Jun 7 • 1 • 1

gbueno86/Qwen2-72B-Instruct-exl2-8.0bpw

Text Generation • Updated Jun 7 • 1 • 1

gbueno86/Qwen2-72B-Instruct-exl2-2.05bpw

Text Generation • Updated Jun 7 • 1

ZeroFLN/Stheno

Text Generation • Updated Jun 8 • 1

LoneStriker/IceCaffeLatteRP-7b-3.0bpw-h6-exl2

Text Generation • Updated Jun 8 • 1

LoneStriker/IceCaffeLatteRP-7b-4.0bpw-h6-exl2

Text Generation • Updated Jun 8 • 39

LoneStriker/IceCaffeLatteRP-7b-5.0bpw-h6-exl2

Text Generation • Updated Jun 8 • 2

LoneStriker/IceCaffeLatteRP-7b-6.0bpw-h6-exl2

Text Generation • Updated Jun 8 • 2

LoneStriker/IceCaffeLatteRP-7b-7.5bpw-h6-exl2

Text Generation • Updated Jun 8 • 1

LoneStriker/IceCaffeLatteRP-7b-8.0bpw-h8-exl2

Text Generation • Updated Jun 8 • 1

IntervitensInc/Qwen2-72b-4.25bpw-exl2

Text Generation • Updated Jun 8 • 1

kim512/TooManyMixRolePlay-7B-Story_V3.5-6.0bpw-h6-exl2

Text Generation • Updated Jun 8 • 1

kim512/TooManyMixRolePlay-7B-Story_V3.5-8.0bpw-h8-exl2

Text Generation • Updated Jun 8 • 2

JayhC/L3-Aethora-15B-8bpw-h8-exl2

Text Generation • Updated Jun 8 • 4

atcsecure/dolphin-2.9.2-qwen72b-8.0bpw-h8-exl2

Text Generation • Updated Jun 9 • 1 • 2

aspirina765/Daredevil-8B-abliterated-5.0bpw-exl2

Updated Jun 9 • 1

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-3.0bpw-h6-exl2

Text Generation • Updated Jun 10 • 2

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-3.5bpw-h6-exl2

Text Generation • Updated Jun 10 • 2

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-4.0bpw-h6-exl2

Text Generation • Updated Jun 10 • 1 • 1

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-4.5bpw-h6-exl2

Text Generation • Updated Jun 10 • 2

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-6.0bpw-h6-exl2

Text Generation • Updated Jun 10 • 1

kim512/sunfall-midnight-miqu-v0.2-v1.5-70B-8.0bpw-h8-exl2

Text Generation • Updated Jun 10 • 2

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_6.0bpw

Text Generation • Updated Jun 10 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_5.5bpw

Text Generation • Updated Jun 10 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_5.0bpw

Text Generation • Updated Jun 10 • 3

altomek/Stheno-Mix-L2-20B-8bpw-EXL2

Text Generation • Updated 16 days ago • 6

FuturisticVibes/Mixtral-8x22B-Instruct-v0.1-8.0bpw-h8-exl2

Text Generation • Updated Jun 12 • 1 • 1