Edit Models filters

Inference Providers

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

32,076

Full-text search

Active filters: bitsandbytes

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 62 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 58 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 70 • 1

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 12 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 16 • 2

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 12 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 35.8k • 11

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 380 • 42

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 27 • 9

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 56 • 16

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 6 • 1

unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 2.96k • 5

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 1.77k • 6

unsloth/c4ai-command-r-plus-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 30 • 3

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 16 • 1

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 218 • 6

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14, 2024 • 16 • 9

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated Nov 22, 2024 • 7.64k • 3

unsloth/Qwen2.5-7B-bnb-4bit

Text Generation • Updated 11 days ago • 22.9k • 4

unsloth/Qwen2.5-72B-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 669 • 1

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 19.1k • 7

unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 15.8k • 1

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 18.3k • 3

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 5.26k • 6

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 11.4k • 11

unsloth/Qwen2.5-1.5B-bnb-4bit

Text Generation • Updated 11 days ago • 11.4k • 1

unsloth/Qwen2.5-0.5B-bnb-4bit

Text Generation • Updated 11 days ago • 17.2k • 1

nroggendorff/mistral-pro-quantized

Text Generation • Updated Sep 22, 2024 • 66 • 1

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated 11 days ago • 6.7k • 5

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 29.4k • 7