Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,356

Full-text search

Active filters: 4-bit

solidrust/Garbage_9B-AWQ

Text Generation • Updated Apr 25

HirCoir/MiniChat-1.5-3B-Sorah-4bit

Text Generation • Updated Apr 25 • 4

abednegokam/maduniai

Text Generation • Updated Apr 25

RichardErkhov/alpindale_-_gemma-2b-it-4bits

Text Generation • Updated Apr 25

Weni/WeniGPT-Agents-Mistral-1.0.17-SFT-AWQ

Text Generation • Updated Apr 25 • 1

solidrust/Maverick-7B-AWQ

Text Generation • Updated Apr 25

solidrust/Opus-Samantha-Llama-3-8B-AWQ

Text Generation • Updated Apr 25 • 1

solidrust/L3-TheSpice-8b-v0.8.3-AWQ

Text Generation • Updated Apr 25 • 1

1024m/LLAMA3-01-EXALT-1A-4bit

Text Generation • Updated Apr 25 • 2 • 1

solidrust/Llama-3-Smaug-8B-AWQ

Text Generation • Updated Apr 25 • 3 • 1

solidrust/internistai-base-7b-v0.2-AWQ

Text Generation • Updated Apr 25

sundeepkadakia/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Apr 25 • 5.24k

solidrust/L3-TheSpice-8b-v0.1.3-AWQ

Text Generation • Updated Apr 25 • 11

solidrust/Llama-3-8B-Lexi-Uncensored-AWQ

Text Generation • Updated Apr 28 • 42 • 3

LoneStriker/dolphin-2.9-llama3-70b-4.0bpw-h6-exl2

Text Generation • Updated Apr 25 • 2 • 1

solidrust/L3-TheSpice-8b-v0.1.2-AWQ

Text Generation • Updated Apr 25

solidrust/TheSpice-7b-FT-v0.3.1-AWQ

Text Generation • Updated Apr 25 • 2

solidrust/TheSpice-7b-FT-ExperimentalOrca-AWQ

Text Generation • Updated Apr 25

solidrust/Thespis-7b-v0.2-SFTTest-3Epoch-AWQ

Text Generation • Updated Apr 25

solidrust/bigyi-15b-AWQ

Text Generation • Updated Apr 25

alokabhishek/Meta-Llama-3-8B-Instruct-bnb-4bit

Text Generation • Updated Apr 26 • 155 • 1

wallaceblaia/mistral-icm-04-1

Text Generation • Updated Apr 25 • 2

solidrust/Llama-3-8B-LexiFun-Uncensored-V1-AWQ

Text Generation • Updated Apr 26 • 3 • 1

Weni/WeniGPT-Agents-Mistral-1.0.19-SFT-AWQ

Text Generation • Updated Apr 26 • 1

Weni/WeniGPT-Agents-Mistral-1.0.18-SFT-AWQ

Text Generation • Updated Apr 26

heejincs/mistral-7b-qlora-arc

Text Generation • Updated Apr 26 • 1

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-4bits

Text Generation • Updated Apr 26

RichardErkhov/cognitivecomputations_-_dolphin-2.6-mistral-7b-dpo-4bits

Text Generation • Updated Apr 26

teehee0918/Llama-2-7b-chat-hf-AWQ

Text Generation • Updated Apr 26 • 20

bartowski/Llama-3-8B-LexiFun-Uncensored-V1-AWQ

Text Generation • Updated Apr 26 • 1