Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,578

Full-text search

Active filters: 4-bit

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-AWQ

Text Generation • Updated Jan 5 • 64 • 6

TheBloke/medicine-chat-GPTQ

Text Generation • Updated Jan 10 • 16.6k • 6

TheBloke/laser-dolphin-mixtral-2x7b-dpo-AWQ

Text Generation • Updated Jan 15 • 16k • 9

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 208 • 6

ashishkgpian/full_v4_astromistral_final

Text2Text Generation • Updated Feb 5 • 4 • 1

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Mar 22 • 129k • 26

MaziyarPanahi/mistral-7b-finetuned-orca-dpo-v2-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Feb 7 • 143 • 5

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 68 • 16

TheBloke/CodeLlama-70B-Instruct-GPTQ

Text Generation • Updated Jan 31 • 16.6k • 10

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 540 • 13

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 25k • 41

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated 20 days ago • 5.95k • 18

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Generation • Updated Feb 4 • 286 • 4

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated 20 days ago • 301 • 7

panoyo9829/llava-1.6-gptq-4bit

Text Generation • Updated Mar 12 • 41 • 1

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated 12 days ago • 12.2k • 12

Shashwath01/Idefic_medical_VQA_merged_4bit

Visual Question Answering • Updated Mar 5 • 102 • 2

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • Updated Mar 11 • 651 • 10

OmarAlsaabi/AceGPT-v1.1-13B-Chat-AWQ

Text Generation • Updated Mar 7 • 5 • 1

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • Updated 20 days ago • 2.8k • 45

MaziyarPanahi/Starling-LM-7B-beta-GPTQ

Text Generation • Updated Mar 29 • 61 • 4

styalai/phi-2_quantize_gptq

Text Generation • Updated Mar 31 • 33 • 2

jwnder/core42_jais-30b-chat-v3-bnb-4bit

Text Generation • Updated Apr 7 • 312 • 2

MTSAIR/multi_verse_model_GPTQ

Text Generation • Updated Apr 7 • 742 • 1

TechxGenus/starcoder2-7b-AWQ

Text Generation • Updated Apr 12 • 44 • 1

titan087/Rhea-72b-v0.5-exl2-4bpw

Text Generation • Updated Apr 13 • 3 • 1

mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • Updated Apr 18 • 2.27k • 8

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated about 1 month ago • 15.7k • 15

mgoin/Meta-Llama-3-70B-Instruct-Marlin

Text Generation • Updated Apr 19 • 413 • 5

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated 15 days ago • 10.3k • 35