Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

2,884

Full-text search

Active filters: exl2

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_3.0bpw

Text Generation • Updated Jun 15 • 16

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_3.5bpw

Text Generation • Updated Jun 15 • 8

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_4.0bpw

Text Generation • Updated Jun 15 • 17

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_4.5bpw

Text Generation • Updated Jun 15 • 16

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_5.0bpw

Text Generation • Updated Jun 22 • 7

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_5.5bpw

Text Generation • Updated Jun 15 • 7

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15 • 11

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated Jun 19 • 6

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.2-exl2

Text Generation • Updated Jun 15 • 7

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.4-exl2

Text Generation • Updated Jun 15 • 6

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.6-exl2

Text Generation • Updated Jun 15 • 7

blockblockblock/gpt2-bpw2.25-exl2

Text Generation • Updated Jun 15 • 6

cgus/Qwen2-7B-Instruct-abliterated-exl2

Text Generation • Updated Jun 24 • 8

cgus/Qwen2-1.5B-Instruct-abliterated-exl2

Text Generation • Updated Jun 24 • 10

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 15 • 12

gghfez/WizardLM-2-8x22B-Beige-exl2_5.0bpw

Text Generation • Updated Jun 18 • 11

LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.25bpw-h6-exl2

Text Generation • Updated Jun 15 • 20 • 2

LoneStriker/WizardLM-2-8x22B-Beige-2.4bpw-h6-exl2

Text Generation • Updated Jun 15 • 16

LoneStriker/WizardLM-2-8x22B-Beige-3.0bpw-h6-exl2

Text Generation • Updated Jun 15 • 11

LoneStriker/WizardLM-2-8x22B-Beige-4.0bpw-h6-exl2

Text Generation • Updated Jun 15 • 26

LoneStriker/WizardLM-2-8x22B-Beige-5.0bpw-h6-exl2

Text Generation • Updated Jun 15 • 27

LoneStriker/WizardLM-2-8x22B-Beige-6.0bpw-h6-exl2

Text Generation • Updated Jun 15 • 29

denru/Tess-v2.5.2-Qwen2-72B-4_0bpw-h6-exl2-pippa

Text Generation • Updated Jun 16 • 17 • 1

DeusImperator/L3-70B-Euryale-v2.1_exl2_2.3bpw

Text Generation • Updated Jun 16 • 78

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17 • 8

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17 • 8

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17 • 7

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17 • 13

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_5.0bpw_h8

Text Generation • Updated Jun 18 • 8