Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,249

Full-text search

Active filters: exl2

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw2.25-exl2

Text Generation • Updated Aug 1 • 1

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw2.5-exl2

Text Generation • Updated Jun 22

blockblockblock/TinyLlama_v1.1-bpw2.25-exl2

Text Generation • Updated Jun 22 • 1

Sinensis/DarkForest-20B-v3.0-bpw3.5-h6-exl2

Text Generation • Updated Jun 22 • 6

Sinensis/DarkForest-20B-v3.0-bpw4.0-h6-exl2

Text Generation • Updated Jun 22 • 3

blockblockblock/TinyLlama_v1.1-bpw2.5-exl2

Text Generation • Updated Jun 22

blockblockblock/gpt2-bpw6-exl2

Text Generation • Updated Jun 22

blockblockblock/gpt2-bpw5.5-exl2

Text Generation • Updated Jun 22 • 1

blockblockblock/gpt2-bpw5-exl2

Text Generation • Updated Jun 22 • 2

Sinensis/DarkForest-20B-v3.0-bpw4.5-h6-exl2

Text Generation • Updated Jun 22 • 1

Sinensis/DarkForest-20B-v3.0-bpw5.0-h6-exl2

Text Generation • Updated Jun 22 • 1

Sinensis/DarkForest-20B-v3.0-bpw6.0-h8-exl2

Text Generation • Updated Jun 22 • 3

Sinensis/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 22 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_5.0bpw

Text Generation • Updated Jun 23

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_6.0bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_8.0bpw

Text Generation • Updated Jun 23 • 1

Pyroserenus/L3-8B-Stheno-v3.3-32K-6.9bpw-h8-exl2

Text Generation • Updated Jun 24 • 1

Pyroserenus/L3-8B-Stheno-v3.3-32K-8.0bpw-h8-exl2

Text Generation • Updated Jun 24 • 11 • 3

grimjim/llama-3-Nephilim-v1-8B-6.5bpw_h6_exl2

Text Generation • Updated 19 days ago • 4

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_3.0bpw

Text Generation • Updated Jun 23 • 2

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_3.5bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_4.0bpw

Text Generation • Updated Jun 23

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_4.5bpw

Text Generation • Updated Jun 23

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_5.0bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_5.5bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_6.0bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_6.5bpw

Text Generation • Updated Jun 23 • 2

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 1

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.5bpw

Text Generation • Updated Jun 23