Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,310

Full-text search

Active filters: 4-bit

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 4 days ago • 6.56k • 32

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 10 days ago • 179k • 33

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 18 days ago • 277k • 134

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 18.2k • 185

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 7 days ago • 393k • 115

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 16 days ago • 273k • 82

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 340 • 12

THUDM/cogvlm2-llama3-chinese-chat-19B-int4

Text Generation • Updated 9 days ago • 578 • 5

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.3-GGUF

Text Generation • Updated 9 days ago • 2.66k • 5

MaziyarPanahi/Codestral-22B-v0.1-GGUF

Text Generation • Updated about 5 hours ago • 361 • 4

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 18.1k • 44

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated 12 days ago • 61 • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated 9 days ago • 1.12k • 3

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated 3 days ago • 647 • 3

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 26.1k • 303

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 9.95k • 159

alpindale/c4ai-command-r-plus-GPTQ

Text Generation • Updated Apr 17 • 33k • 20

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 10k • 106

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 83k • 50

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 20 days ago • 18.8k • 10

atena77/dolphin-2.9-llama3-8bQ

Text Generation • Updated 18 days ago • 62 • 2

uiyong/kospi_report_model_0517

Text Generation • Updated 12 days ago • 42 • 2

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated 10 days ago • 4.69k • 6

KnutJaegersberg/granite-34b-code-instruct-awq

Text Generation • Updated 8 days ago • 14 • 3

parsawar/Llama2_quantize_4bit

Text Generation • Updated 6 days ago • 44 • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 19k • 185

TheBloke/guanaco-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.01k • 75

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.51k • 266

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.64k • 546

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17.1k • 67