Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,302

Full-text search

Active filters: 4-bit

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Mar 24 • 12.7k • 12

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 8.26k • 26

PrunaAI/mistralai-Mistral-7B-Instruct-v0.2-bnb-4bit-smashed

Text Generation • Updated Apr 10 • 41 • 1

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Apr 18 • 1.51k • 3

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 1.33k • 54

meetkai/functionary-medium-v2.4-AWQ

Text Generation • Updated Apr 12 • 32 • 3

KnutJaegersberg/jamba-bagel-4bit

Text Generation • Updated Apr 12 • 5 • 2

Dracones/WizardLM-2-8x22B_exl2_4.0bpw

Text Generation • Updated Apr 16 • 25 • 2

yentinglin/Taiwan-LLM-8x7B-DPO-awq

Text Generation • Updated Apr 18 • 1 • 1

mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • Updated Apr 18 • 1.46k • 10

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 4.84k • 74

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Apr 19 • 17k • 17

mgoin/Meta-Llama-3-70B-Instruct-Marlin

Text Generation • Updated Apr 19 • 455 • 6

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 83k • 49

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 20k • 6

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 942 • 4

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 8.12k • 20

Dogge/llama-3-70B-instruct-uncensored-4bit

Text Generation • Updated Apr 20 • 94 • 2

empower-dev-staging/empower-functions-llama3-70b-parallel-all-linear

Updated Apr 25 • 1

study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4

Text Generation • Updated Apr 23 • 204 • 5

hikikomoriHaven/llama3-8b-hikikomori-v0.3

Text Generation • Updated Apr 25 • 743 • 4

ruslanmv/llama3-8B-medical

Text Generation • Updated 17 days ago • 559 • 8

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Apr 24 • 5.29k • 51

Neurai/NeuraChatLlama3_8b

Text Generation • Updated Apr 25 • 37 • 5

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-AWQ-4bit-smashed

Text Generation • Updated about 1 month ago • 299 • 4

stylellm/ShuiHuZhuan-6b-AWQ

Text Generation • Updated 29 days ago • 27 • 1

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30 • 74.2k • 7

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 674 • 6

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 9 days ago • 72k • 12

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 15 days ago • 1.65k • 4