Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

10,336

Full-text search

Active filters: bitsandbytes

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 843 • 18

unclecode/folrence-2-large-4bit

Text Generation • Updated Jun 26 • 157 • 2

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-bnb-4bit

Text Generation • Updated Jun 27 • 36 • 1

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Sep 3 • 26.2k • 22

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3 • 3.47k • 12

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated 17 days ago • 1.39k • 18

macadeliccc/gemma-2b-pubmed-classifier

Text Generation • Updated Jun 30 • 20 • 1

Shaleen123/gemma2-9b-medical

Text Generation • Updated Jul 4 • 172 • 3

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11 • 6.38k • 10

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 21.7k • 22

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 3 • 267k • 75

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 244k • 36

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 12.2k • 19

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated 11 days ago • 140 • 11

unsloth/Mistral-Large-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 280 • 9

SathwikBalu/model

Text Generation • Updated Jul 29 • 3 • 1

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3 • 26.1k • 13

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 26 days ago • 44.1k • 60

SathwikBalu/Health-model

Text Generation • Updated Aug 7 • 10 • 1

llama-duo/llama3-8b-coding-gpt4o-100k

Updated Aug 10 • 59 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 80.5k • 9

mariaAlvi123/Llama3.1-4B-instruct-quantized

Text Generation • Updated Aug 21 • 50 • 1

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.67k • 34

cmarkea/CodeLlama-70b-Instruct-hf-4bit

Text Generation • Updated Sep 19 • 2 • 1

cmarkea/Meta-Llama-3.1-70B-Instruct-4bit

Text Generation • Updated Sep 19 • 77 • 1

SathwikBalu/Retailmodel

Text Generation • Updated Aug 30 • 4 • 1

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Sep 4 • 41 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 145 • 11

Solshine/jais-adapted-7b-chat-Natural-Farmer-lora-tuned-model-full

Text Generation • Updated Sep 4 • 7 • 4

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4 • 6.75k • 2