Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,028

Full-text search

Active filters: bitsandbytes

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3.07k • 26

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 54 • 8

shaheerzk/text_to_sql

Text Generation • Updated 29 days ago • 150 • 1

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4 • 84 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 34 • 3

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 110 • 7

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.7k • 23

unclecode/folrence-2-large-4bit

Text Generation • Updated Jun 26 • 663 • 3

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 1.45k • 21

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3 • 521 • 8

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated 1 day ago • 29.1k • 20

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3 • 6.32k • 8

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11 • 6.56k • 11

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 20.6k • 24

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 1 day ago • 8.73k • 28

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 20.2k • 26

SoumilB7/L3_8B_Solana_Smart_Contract_Analyser

Text Generation • Updated Aug 22 • 17 • 1

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 76.1k • 67

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 22 • 1

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 197 • 3

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 931 • 35

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 133 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 155 • 12

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 8 • 56 • 15

bagwai/fine-tuned-gemma-7b-Hausa

Text Classification • Updated Sep 8 • 1 • 2

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12 • 63 • 1

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14 • 5 • 6

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 67.6k • 6

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 5.49k • 3

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 10.4k • 2