Edit Models filters

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

text-embeddings-inference

Carbon Emissions

Models

2,499

Full-text search

Active filters: exl2

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_4.0bpw-h8

Text Generation • Updated 13 days ago • 2

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_2.8bpw

Text Generation • Updated 13 days ago

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_3.0bpw

Text Generation • Updated 13 days ago

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_3.5bpw

Text Generation • Updated 13 days ago • 2

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_4.5bpw-h8

Text Generation • Updated 13 days ago • 10

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_5.0bpw-h8

Text Generation • Updated 13 days ago

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_4.0bpw

Text Generation • Updated 12 days ago • 8

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_4.5bpw

Text Generation • Updated 12 days ago

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_5.0bpw

Text Generation • Updated 6 days ago

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_5.5bpw

Text Generation • Updated 12 days ago • 1

TeeZee/BigMaid-20B-v2.0-bpw8.0-h8-exl2

Text Generation • Updated 13 days ago • 2

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_5.5bpw-h8

Text Generation • Updated 13 days ago

grimjim/Llama-3-Oasis-v1-OAS-8B-8bpw_h8_exl2

Text Generation • Updated 8 days ago

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.2-exl2

Text Generation • Updated 13 days ago

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.4-exl2

Text Generation • Updated 13 days ago

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw4.6-exl2

Text Generation • Updated 13 days ago

blockblockblock/gpt2-bpw2.25-exl2

Text Generation • Updated 13 days ago

cgus/Qwen2-7B-Instruct-abliterated-exl2

Text Generation • Updated 4 days ago

cgus/Qwen2-1.5B-Instruct-abliterated-exl2

Text Generation • Updated 4 days ago • 15

TeeZee/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated 12 days ago • 1

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_6.0bpw-h8

Text Generation • Updated 12 days ago • 3

gghfez/WizardLM-2-8x22B-Beige-exl2_5.0bpw

Text Generation • Updated 9 days ago • 17

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_6.5bpw-h8

Text Generation • Updated 12 days ago

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_7.0bpw-h8

Text Generation • Updated 12 days ago

BigHuggyD/CohereForAI_c4ai-command-r-plus-exl2_7.5bpw-h8

Text Generation • Updated 12 days ago

LoneStriker/WizardLM-2-8x22B-Beige-2.4bpw-h6-exl2

Text Generation • Updated 12 days ago • 6

LoneStriker/WizardLM-2-8x22B-Beige-3.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 15

LoneStriker/WizardLM-2-8x22B-Beige-4.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 86

LoneStriker/WizardLM-2-8x22B-Beige-5.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 10

LoneStriker/WizardLM-2-8x22B-Beige-6.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 2