Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,476

Full-text search

Active filters: 4-bit

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 233 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 227 • 1

openbmb/MiniCPM-2B-dpo-int4

Text Generation • Updated Apr 7 • 95 • 5

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 345 • 1

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 3.58k • 35

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 1.05k • 11

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 478 • 13

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 1.08k • 2

robinsmits/Mistral-Instruct-7B-v0.2-ChatAlpacaV2-4bit

Text Generation • Updated Feb 13 • 1.84k • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 3.81k • 11

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.05k • 38

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 804 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 370 • 7

lucifertrj/pubmed_gemma

Text Generation • Updated Feb 21 • 90 • 1

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Apr 18 • 8.66k • 13

kuotient/Seagull-13b-translation-AWQ

Translation • Updated Feb 24 • 3 • 1

dyang415/mixtral-lora-v0

Updated Feb 28 • 1 • 1

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 2.87k • 161

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 274 • 4

speakleash/Bielik-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Apr 4 • 4.77k • 5

yixuantt/InvestLM-mistral-AWQ

Text Generation • Updated Apr 4 • 84 • 2

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30 • 1.77k • 14

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 3.38k • 74

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Apr 15 • 4.95k • 29

Weyaxi/Einstein-v4-Qwen-1.5-32B-adapter-checkpoints

Text Generation • Updated 2 days ago • 1 • 1

HuggingFaceM4/idefics2-8b-AWQ

Image-Text-to-Text • Updated May 6 • 1.24k • 26

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30 • 871 • 8

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.11k • 69

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 4.74k • 108

solidrust/CreativeSmart-2x7B-AWQ

Text Generation • Updated Apr 17