Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10,055

Full-text search

Active filters: 4-bit

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 10 days ago • 6 • 2

vcadillo/glm-4v-9b-4-bits

Feature Extraction • Updated 8 days ago • 69 • 1

Orion-zhen/Qwen2-72B-Instruct-mix-calibration-4b-exl2

Text Generation • Updated 5 days ago • 5 • 1

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 5 days ago • 7 • 2

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 12 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.48k • 547

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 195 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 105 • 17

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 905 • 130

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 105 • 4

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 23.8k • 358

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 14 • 13

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • Updated Sep 27, 2023 • 32 • 16

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 76 • 8

baichuan-inc/Baichuan2-7B-Chat-4bits

Text Generation • Updated Dec 24, 2023 • 123 • 56

baichuan-inc/Baichuan2-13B-Chat-4bits

Text Generation • Updated Jan 8 • 177 • 86

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 58 • 42

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 452 • 12

TheBloke/Llama-2-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 10.5k • 24

TheBloke/Llama-2-13B-German-Assistant-v4-AWQ

Text Generation • Updated Nov 9, 2023 • 7 • 2

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 5.41k • 103

HCCRen/Lamma2-gptq-4bit

Text Generation • Updated Sep 30, 2023 • 135 • 1

TheBloke/Llama-2-7B-vietnamese-20k-AWQ

Text Generation • Updated Nov 9, 2023 • 13 • 5

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 22, 2023 • 146k • 32

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 3.38k • 26

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 15k • 6

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 22.3k • 41

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 67.7k • 38

TheBloke/Mythalion-Kimiko-v2-GPTQ

Text Generation • Updated Dec 14, 2023 • 42 • 4

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 8 • 1