Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,028

Full-text search

Active filters: bitsandbytes

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 2.44k • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 8.99k • 7

unsloth/Qwen2.5-32B-bnb-4bit

Text Generation • Updated Sep 23 • 3.57k • 1

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 16.7k • 1

unsloth/Qwen2.5-Math-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 328 • 1

unsloth/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Sep 30 • 54k • 7

unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 101k • 10

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated Sep 30 • 46.2k • 6

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 231k • 14

SeanScripts/Llama-3.2-11B-Vision-Instruct-nf4

Image-Text-to-Text • Updated Sep 26 • 5.48k • 4

unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 3.8k • 13

SeanScripts/Molmo-72B-0924-nf4

Image-Text-to-Text • Updated Oct 2 • 694 • 4

NetoAISolutions/TSLAM-4B

Updated 24 days ago • 309 • 3

sunilrufus/Mistral_Instruct_Nemo_12B_quantized_w8a8

Text Generation • Updated Sep 30 • 312 • 1

ThetaCursed/Ovis1.6-Gemma2-9B-bnb-4bit

Updated Oct 1 • 191 • 5

emre570/llama3.2-1b-tr-qlora

Text Generation • Updated Oct 2 • 54 • 2

zamal/Molmo-7B-GPTQ-4bit

Updated Oct 4 • 471 • 3

thanhkt/codegemma-7B-ManimGen

Text Generation • Updated Oct 14 • 58 • 1

John6666/Llama-3.1-8B-Lexi-Uncensored-V2-nf4

Text Generation • Updated Oct 13 • 1.53k • 6

John6666/llama-joycaption-alpha-two-hf-llava-nf4

Image-Text-to-Text • Updated Oct 16 • 1.42k • 8

shrujan142/loomina_ai

Text Generation • Updated Oct 16 • 52 • 1

unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation • Updated Oct 17 • 13.1k • 18

Ayush12a/llama3.1_finetuned_on_indian_legal_dataset

Text Generation • Updated Oct 21 • 201 • 3

amornpan/openthaigpt-MedChatModelv11

Text Generation • Updated 20 days ago • 481 • 2

diffusers/t5-nf4

Updated Oct 22 • 9.58k • 1

ascktgcc/Mistral-Nemo-Japanese-Instruct-2408-bnb-4bit

Text Generation • Updated Oct 22 • 20 • 1

sayakpaul/sd35-large-nf4

Text-to-Image • Updated 27 days ago • 5

rwitz/cat0.1

Text Generation • Updated Oct 23 • 31 • 1

YouSSeung/Llama-YSH-ko-3-8B

Updated 29 days ago • 43 • 1

ronmasas/omniparser-8bit

Updated 28 days ago • 17 • 2