Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,028

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 37.8k • 51

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 650k • 41

LeonardPuettmann/LlaMaestra-3.2-1B-Instruct-v0.1-4bit

Translation • Updated about 11 hours ago • 9 • 3

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 98.8k • 130

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated 1 day ago • 33k • 25

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 1 day ago • 315k • 81

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26 • 1.62k • 18

thwin27/Aria-sequential_mlp-bnb_nf4

Image-Text-to-Text • Updated about 1 month ago • 651 • 10

imnotednamode/mochi-1-preview-mix-nf4-small

Updated 11 days ago • 120 • 7

KnutJaegersberg/Athene-V2-Chat-72B-4bit

Text Generation • Updated 8 days ago • 75 • 3

SandeepKumarRudhravaram/gemma2b_lungcancerqa

Text Generation • Updated 5 days ago • 149 • 2

unsloth/Pixtral-12B-2409-bnb-4bit

Image-Text-to-Text • Updated 2 days ago • 353 • 2

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 378 • 7

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 2.56k • 8

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 10.1k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 152 • 10

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 281 • 3

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 875 • 22

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 26 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 187 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 593 • 172

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 8 • 1

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 89 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 79 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 3 • 1

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 144 • 4

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 459 • 23

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 43 • 1

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 46 • 3

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 25 • 3