Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,317

Full-text search

Active filters: 4-bit

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 452 • 175

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 945 • 128

TheBloke/Chronos-Hermes-13B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 4 • 38

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 10.6k • 162

TheBloke/GodziLLa2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 4 • 4

TheBloke/em_german_7b_v01-AWQ

Text Generation • Updated Nov 9, 2023 • 13 • 2

TheBloke/Mistral-7B-Claude-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 6 • 4

TheBloke/openchat_3.5-GPTQ

Text Generation • Updated Nov 2, 2023 • 691 • 16

TheBloke/Nous-Capybara-34B-AWQ

Text Generation • Updated Nov 15, 2023 • 12 • 13

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated 3 days ago • 431 • 59

01-ai/Yi-6B-Chat-4bits

Text Generation • Updated 3 days ago • 888 • 18

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 98.7k • 37

TheBloke/Mixtral-8x7B-MoE-RP-Story-AWQ

Text Generation • Updated Dec 22, 2023 • 9 • 2

TheBloke/Nous-Hermes-2-Yi-34B-AWQ

Text Generation • Updated Dec 26, 2023 • 102 • 7

TheBloke/bagel-dpo-34b-v0.2-AWQ

Text Generation • Updated Jan 2 • 21 • 7

TheBloke/Nous-Capybara-limarpv3-34B-GPTQ

Text Generation • Updated Jan 11 • 55 • 4

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • Updated Jan 16 • 38.6k • 25

AshishK/AK-openhathi-gptq-4bit

Text Generation • Updated Jan 24 • 3 • 1

TheBloke/CodeLlama-70B-Instruct-GPTQ

Text Generation • Updated Jan 31 • 16.7k • 11

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30 • 2.91k • 12

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • Updated Apr 30 • 5.79k • 6

HIT-SCIR/huozi3-awq

Text Generation • Updated Feb 9 • 4 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 1.62k • 8

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 1.24k • 37

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated 24 days ago • 13.4k • 13

Intel/phi-2-int4-inc

Text Generation • Updated 2 days ago • 69 • 2

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Mar 21 • 168 • 6

neuralmagic/OpenHermes-2.5-Mistral-7B-marlin

Text Generation • Updated Mar 6 • 1.26k • 2

zamal/gemma-7b-finetuned

Text Generation • Updated Mar 19 • 47 • 4

Neurai/NeuraOrcaGemma7b

Text Generation • Updated Mar 29 • 247 • 10