Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

8,066

Full-text search

Active filters: bitsandbytes

openbmb/MiniCPM-V-2_6-int4

Visual Question Answering • Updated 10 days ago • 14.5k • 31

tiiuae/falcon-mamba-7b-instruct-4bit

Updated 3 days ago • 225 • 11

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated 3 days ago • 143 • 10

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 2 days ago • 239k • 38

rwitz/Femme-v0.1

Text Generation • Updated 5 days ago • 76 • 7

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 2 days ago • 532k • 171

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 176k • 28

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated 2 days ago • 3.36k • 17

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 197k • 120

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 27 days ago • 212k • 66

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1 • 353 • 14

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 11.3k • 3

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Jul 1 • 1.26k • 12

sayakpaul/t5-efficient-tiny-safetensors

Text2Text Generation • Updated 5 days ago • 33 • 2

zweack/meta-llama-2-7b-chat-hf_4bit_quantized

Text Generation • Updated Nov 22, 2023 • 216 • 2

fhai50032/Johan-7B-v0.1

Text Generation • Updated Jan 30 • 14 • 2

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 223 • 10

Doctor-Shotgun/limarp-miqu-1-70b-qlora

Updated Feb 1 • 12 • 4

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 362 • 3

Shashwath01/Idefic_medical_VQA_merged_4bit

Updated 12 days ago • 8 • 4

areegtarek/idefics-9b-instruct-all-v2

Updated Mar 24 • 3 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated 5 days ago • 2.75k • 228

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 2 • 1

Dogge/llama-3-70B-instruct-uncensored-lora

Text Generation • Updated Apr 20 • 129 • 4

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • Updated Apr 29 • 86 • 2

PrunaAI/Einstein-v6.1-Llama3-8B-bnb-4bit-smashed

Text Generation • Updated 16 days ago • 60 • 1

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 122 • 2

ecastera/eva-dolphin-llama3-8b-spanish

Text Generation • Updated Jun 14 • 66 • 2

RichardErkhov/NeverSleep_-_Noromaid-13b-v0.1.1-4bits

Text Generation • Updated May 10 • 23 • 1

dilanbakr/mistral-updated-model-for-qa_scoresystem-evaluation

Text Generation • Updated May 20 • 36 • 1