Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,881

Full-text search

Active filters: 4-bit

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 4 days ago • 1.74k • 11

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 1.64k • 11

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 1.41k • 10

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 8.89k • 199

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 19 days ago • 369k • 128

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated 7 days ago • 23.8k • 8

amirMohammadi/Dorna-Llama3-8B-Instruct-Quantized4Bit

Text Generation • Updated 5 days ago • 382 • 8

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 7 days ago • 14.5k • 45

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 7 days ago • 825 • 7

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 7 days ago • 70.2k • 6

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 7 days ago • 73k • 6

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 331 • 5

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.14k • 308

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated 12 days ago • 66 • 5

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 45k • 253

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated May 5 • 9.11k • 38

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 22 days ago • 412k • 37

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated 15 days ago • 15.5k • 9

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated 7 days ago • 91 • 3

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 208 • 176

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 10 • 13

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 5.64k • 76

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 30 days ago • 120k • 139

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 28 days ago • 326k • 87

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 77.5k • 54

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 6.72k • 8

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated 28 days ago • 13.9k • 31

Dogge/llama-3-70B-instruct-uncensored-lora

Text Generation • Updated Apr 20 • 19 • 4

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 3.53k • 53

neph1/llama-3-instruct-bellman-8b-swedish

Text Generation • Updated 4 days ago • 374 • 2