Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,510

Full-text search

Active filters: 4-bit

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated 20 days ago • 610 • 58

TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 14, 2023 • 5.53k • 54

TheBloke/Ana-v1-m7-AWQ

Text Generation • Updated Dec 13, 2023 • 6 • 2

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 8 • 1

TheBloke/dolphin-2.6-mixtral-8x7b-AWQ

Text Generation • Updated Dec 22, 2023 • 53 • 13

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Mar 22 • 52.6k • 23

TheBloke/dolphin-2.6-mistral-7B-GPTQ

Text Generation • Updated Dec 28, 2023 • 39.6k • 9

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Mar 22 • 16.8k • 9

TheBloke/bagel-dpo-34b-v0.2-AWQ

Text Generation • Updated Jan 2 • 92 • 6

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-AWQ

Text Generation • Updated Jan 5 • 71 • 6

TheBloke/medicine-chat-GPTQ

Text Generation • Updated Jan 10 • 16.6k • 6

TheBloke/Nous-Capybara-limarpv3-34B-GPTQ

Text Generation • Updated Jan 11 • 12 • 3

TheBloke/laser-dolphin-mixtral-2x7b-dpo-AWQ

Text Generation • Updated Jan 15 • 16.1k • 9

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ

Text Generation • Updated Jan 16 • 7.73k • 20

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 210 • 6

MaziyarPanahi/Turdus-GPTQ

Text Generation • Updated Jan 18 • 7 • 5

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Mar 22 • 133k • 26

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 68 • 16

TheBloke/CodeLlama-70B-Instruct-GPTQ

Text Generation • Updated Jan 31 • 16.6k • 10

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 608 • 13

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 25k • 41

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated 19 days ago • 5.4k • 18

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated 19 days ago • 2.03k • 11

MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF

Text Generation • Updated Feb 4 • 227 • 2

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated 19 days ago • 8.92k • 34

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated 19 days ago • 2.88k • 19

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated 19 days ago • 1.58k • 17

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated 19 days ago • 310 • 7

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 254 • 6

panoyo9829/llava-1.6-gptq-4bit

Text Generation • Updated Mar 12 • 40 • 1