Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,870

Full-text search

Active filters: 5-bit

bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw

Updated Aug 24, 2024 • 7

SicariusSicariiStuff/2B-ad-EXL2-5.0bpw

Updated Aug 26, 2024 • 3

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6, 2024 • 142 • 1

pigfoot/Llama-3-Taiwan-8B-Instruct-V1-5bpw-exl2

Text Generation • Updated Aug 30, 2024 • 9

LoneStriker/LongWriter-llama3.1-8b-5.0bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 5

MikeRoz/c4ai-command-r-plus-08-2024-5.0bpw-h8-exl2

Text Generation • Updated Sep 1, 2024 • 5 • 2

bullerwins/c4ai-command-r-08-2024-exl2_5.0bpw

Text Generation • Updated Aug 31, 2024 • 11 • 1

Proverbial1/Luminum-v0.1-123B_exl2_5.0bpw_h8

Text Generation • Updated Sep 1, 2024 • 19

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_5.0bpw_h6

Text Generation • Updated Sep 1, 2024 • 3

bullerwins/c4ai-command-r-plus-08-2024-exl2_5.0bpw

Text Generation • Updated Sep 2, 2024 • 4

bigstorm/Mistral-Large-Instruct-2407-5.0bpw-8hb-exl2

Updated Sep 4, 2024 • 3

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_5.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 12

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 855k • 2

LoneStriker/Yi-Coder-9B-Chat-5.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 4

LoneStriker/Yi-Coder-9B-5.0bpw-h6-exl2

Updated Sep 4, 2024 • 3

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated Sep 6, 2024 • 4 • 1

LoneStriker/Reflection-Llama-3.1-70B-5.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 4

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11, 2024 • 89.9k • 4

async0x42/Meta-Llama-3.1-8B-exl2_5bpw

Text Generation • Updated Sep 8, 2024 • 4

schnapper79/lumikabra-123B_v0.4-exl2-5.0bpw

Text Generation • Updated Sep 9, 2024 • 9

MikeRoz/mattshumer_ref_70_e3-5.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 5

riveRiPH/MN-12B-Lyra-v4-5bpw-h6-exl2

Updated Sep 9, 2024 • 7 • 1

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10, 2024 • 20

schnapper79/lumikabra-123B_v0.1-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 7

schnapper79/lumikabra-123B_v0.3-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 8

async0x42/Merged-RP-Stew-V2-34B-exl2_5bpw

Updated Sep 10, 2024 • 3

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11, 2024 • 57 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-5.0bpw

Updated Sep 11, 2024 • 5

MikeRoz/TheDrummer_Donnager-70B-v1-5.0bpw-h6-exl2

Updated Sep 15, 2024 • 1

LoneStriker/Mistral-Small-Instruct-2409-5.0bpw-h6-exl2

Updated Sep 17, 2024 • 7 • 1