Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,774

Full-text search

Active filters: 8-bit

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 19 days ago • 272k • 135

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 11 days ago • 200k • 33

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated about 23 hours ago • 11k • 4

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 10 days ago • 2.68k • 5

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 9.87k • 106

Kameshr/LLAMA-3-Quantized

Text Generation • Updated about 1 month ago • 135 • 2

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 21 days ago • 18.9k • 10

Zoyd/Sao10K_L3-8B-Stheno-v3.1-8_0bpw_exl2

Text Generation • Updated 9 days ago • 104 • 3

Zoyd/openchat_openchat-3.6-8b-20240522-8_0bpw_exl2

Text Generation • Updated 7 days ago • 2 • 2

bullerwins/Codestral-22B-v0.1-exl2_8.0bpw

Text Generation • Updated 4 days ago • 7 • 2

dwdcth/chatglm3-6b-int4

Feature Extraction • Updated Nov 2, 2023 • 86 • 6

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 34 • 7

01-ai/Yi-6B-Chat-8bits

Text Generation • Updated 3 days ago • 958 • 9

lemonilia/Limamono-Mistral-7B-v0.50

Text Generation • Updated Mar 1 • 144 • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 35 • 9

maitreyaz/OpenHathi-quantised-8bit-Base

Text Generation • Updated Feb 2 • 4 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.18k • 37

nuvocare/NuvoChat

Text Generation • Updated Apr 30 • 24 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 11.9k • 72

Dracones/c4ai-command-r-plus_exl2_8.0bpw

Text Generation • Updated Apr 13 • 22 • 2

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 4.48k • 74

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 4.93k • 51

OpenGVLab/InternVL-Chat-V1-5-Int8

Visual Question Answering • Updated 4 days ago • 20.6k • 56

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 16 days ago • 1.65k • 4

afrizalha/Kancil-V0-llama3

Text Generation • Updated 2 days ago • 103 • 3

LoneStriker/Llama-3-Refueled-8.0bpw-h8-exl2

Text Generation • Updated 25 days ago • 7 • 1

LoneStriker/bagel-8b-v1.0-8.0bpw-h8-exl2

Text Generation • Updated 23 days ago • 3 • 2

DeusImperator/L3-8B-Stheno-v3.1_exl2_8bpw_rpcal_mk2

Text Generation • Updated 12 days ago • 38 • 1

FuturisticVibes/Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated 8 days ago • 6 • 1

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF

Text Generation • Updated 10 days ago • 2.82k • 2