Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

11,915

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated 9 minutes ago • 36.1k • 48

CoRover/BharatGPT-3B-Indic

Text Generation • Updated about 4 hours ago • 8 • 7

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 616k • 41

imnotednamode/mochi-1-preview-mix-nf4-small

Updated 9 days ago • 110 • 7

KnutJaegersberg/Athene-V2-Chat-72B-4bit

Text Generation • Updated 6 days ago • 69 • 3

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 133 • 4

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 20.4k • 26

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26 • 1.64k • 18

Ayush12a/llama3.1_finetuned_on_indian_legal_dataset

Text Generation • Updated Oct 21 • 204 • 3

thwin27/Aria-sequential_mlp-bnb_nf4

Image-Text-to-Text • Updated 29 days ago • 621 • 10

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated 7 days ago • 97 • 2

SandeepKumarRudhravaram/gemma2b_lungcancerqa

Text Generation • Updated 3 days ago • 138 • 2

unsloth/Pixtral-12B-2409-bnb-4bit

Image-Text-to-Text • Updated about 4 hours ago • 8 • 2

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 389 • 7

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 2.57k • 8

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 10.5k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 123 • 10

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 252 • 3

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 757 • 22

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 18 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 162 • 9

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 3 • 1

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 79 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 79 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 4 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated about 1 month ago • 716k • 182

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 101k • 129

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 508 • 23

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 50 • 1

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 35 • 3