Edit Models filters

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

878

Full-text search

Active filters: 6-bit

FuturisticVibes/Coomand-R-35B-v1-6.0bpw-h8-exl2

Text Generation • Updated 17 days ago • 4 • 1

FallenMerick/Iced-Lemon-Cookie-7B-GGUF

Text Generation • Updated 20 days ago • 98

lucyknada/refuelai_Llama-3-Refueled-exl2-6.0bpw

Text Generation • Updated 20 days ago • 1

LoneStriker/Llama-3-Refueled-6.0bpw-h6-exl2

Text Generation • Updated 20 days ago • 4

blockblockblock/llama-3-70B-Instruct-abliterated-bpw6-exl2

Text Generation • Updated 20 days ago

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-10fail-1000total-exl2-6.0bpw

Text Generation • Updated 20 days ago • 4

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-500total-exl2-6.0bpw

Text Generation • Updated 19 days ago

LoneStriker/Buzz-8b-Large-v0.5-6.0bpw-h6-exl2

Text Generation • Updated 20 days ago • 2

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-3000total-exl2-6.0bpw

Text Generation • Updated 19 days ago

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated 19 days ago • 4.32k • 2

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-33fail-3000total-6.0bpw-EXL2

Text Generation • Updated 19 days ago • 4

LoneStriker/bagel-8b-v1.0-6.0bpw-h6-exl2

Text Generation • Updated 19 days ago • 2

blockblockblock/Llama3-TenyxChat-70B-bpw6-exl2

Text Generation • Updated 19 days ago

LoneStriker/airoboros-70b-3.3-6.0bpw-h6-exl2

Text Generation • Updated 19 days ago • 3

LoneStriker/dolphin-2.9.1-llama-3-8b-6.0bpw-h6-exl2

Text Generation • Updated 18 days ago • 1

blockblockblock/Dark-Miqu-70B-bpw6-exl2

Text Generation • Updated 17 days ago • 3

blockblockblock/neo_7b-bpw6-exl2

Text Generation • Updated 17 days ago

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-34fail-3000total-bf16-6.0bpw-EXL2

Text Generation • Updated 17 days ago • 2

lucyknada/Edgerunners_yi-9b-may-ortho-baukit-30fail-3000total-bf16-6.0bpw-EXL2

Text Generation • Updated 17 days ago

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated 17 days ago • 1.85k • 5

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated 16 days ago • 526 • 6

lucyknada/01-ai_Yi-1.5-34B-Chat-6.0bpw-EXL2

Text Generation • Updated 16 days ago • 8

lucyknada/Edgerunners_meta-llama-3-8b-instruct-hf-ortho-baukit-5fail-3000total-bf16-6.0bpw-EXL2

Text Generation • Updated 16 days ago

blockblockblock/llama-3-cat-8b-instruct-v1-bpw6-exl2

Text Generation • Updated 16 days ago • 26 • 1

FuturisticVibes/L3-Arcania-4x8b-6.0bpw-h8-exl2

Text Generation • Updated 15 days ago • 1

BigHuggyD/jukofyork_Deep-Miqu-120B-6.0bpw-h8-exl2

Text Generation • Updated 14 days ago • 3

FallenMerick/Space-Whale-Lite-13B-GGUF

Text Generation • Updated 12 days ago • 102

Zoyd/suzume-llama-3-8B-multilingual-6_0bpw-exl2

Text Generation • Updated 11 days ago • 1

Statuo/LemonKunoichiWizardv3_6bpw

Text Generation • Updated 11 days ago

LoneStriker/dolphin-2.9.1-yi-1.5-34b-6.0bpw-h6-exl2

Text Generation • Updated 11 days ago • 1