Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

2,885

Full-text search

Active filters: exl2

blockblockblock/Qwen2-72B-Instruct-bpw4.6-exl2

Text Generation • Updated Jun 12 • 6

blockblockblock/Qwen2-72B-Instruct-bpw4.8-exl2

Text Generation • Updated Jun 12 • 10

blockblockblock/Qwen2-72B-Instruct-bpw5-exl2

Text Generation • Updated Jun 12 • 11

Orion-zhen/Qwen2-72B-Instruct-2.0bpw-h-novel-exl2

Text Generation • Updated Jun 12 • 24

blockblockblock/Qwen2-72B-Instruct-bpw5.5-exl2

Text Generation • Updated Jun 12 • 12 • 1

blockblockblock/Qwen2-72B-Instruct-bpw6-exl2

Text Generation • Updated Jun 12 • 14

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-2.4bpw-h6-exl2

Text Generation • Updated Jun 12 • 9

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-3.5bpw-h6-exl2

Text Generation • Updated Jun 12 • 7

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.0bpw-h6-exl2

Text Generation • Updated Jun 12 • 7

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.65bpw-h6-exl2

Text Generation • Updated Jun 12 • 20 • 1

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-5.0bpw-h6-exl2

Text Generation • Updated Jun 12 • 21

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-6.0bpw-h6-exl2

Text Generation • Updated Jun 12 • 30

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-2.25bpw-h6-exl2

Text Generation • Updated Jun 12 • 8

Statuo/EtherealRainbow-v0.2-8B_EXL2_4BPW

Text Generation • Updated Jun 13 • 10

Statuo/EtherealRainbow-v0.2-8B_EXL2_6BPW

Text Generation • Updated Jun 13 • 7

Statuo/EtherealRainbow-v0.2-8B_EXL2_8BPW

Text Generation • Updated Jun 13 • 17 • 3

Orion-zhen/codestral-6_5bpw-code-h8-exl2

Text Generation • Updated Jun 13 • 22

LoneStriker/Maiden-Unquirked-20B-3.0bpw-h6-exl2

Text Generation • Updated Jun 13 • 12 • 1

LoneStriker/Maiden-Unquirked-20B-4.0bpw-h6-exl2

Text Generation • Updated Jun 13 • 9

LoneStriker/Maiden-Unquirked-20B-4.55bpw-h6-exl2

Text Generation • Updated Jun 13 • 6

LoneStriker/Maiden-Unquirked-20B-4.25bpw-h6-exl2

Text Generation • Updated Jun 13 • 8

LoneStriker/Maiden-Unquirked-20B-5.0bpw-h6-exl2

Text Generation • Updated Jun 13 • 16

bullerwins/L3-70B-Euryale-v2.1_exl2_8.0bpw

Text Generation • Updated Jun 14 • 92 • 1

bullerwins/L3-70B-Euryale-v2.1_exl2_6.0bpw

Text Generation • Updated Jun 14 • 33 • 1

bullerwins/L3-70B-Euryale-v2.1_exl2_5.0bpw

Text Generation • Updated Jun 14 • 36

bullerwins/L3-70B-Euryale-v2.1_exl2_4.0bpw

Text Generation • Updated Jun 14 • 49 • 1

LoneStriker/Maiden-Unquirked-20B-6.0bpw-h6-exl2

Text Generation • Updated Jun 13 • 25 • 2

denru/L3-70B-Euryale-v2.1-4_0bpw-h6-exl2-pippa

Text Generation • Updated Jun 14 • 20

bullerwins/Meta-Llama-3-8B-Instruct_exl2_8.0bpw

Text Generation • Updated Jun 14 • 14

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_2.8bpw

Text Generation • Updated Jun 15 • 10