Edit Models filters

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,520

Full-text search

Active filters: gptq

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 1 day ago • 1.12k • 11

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 2 days ago • 1.06k • 10

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 1 day ago • 1.02k • 9

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated 1 day ago • 727 • 7

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated 1 day ago • 512 • 6

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 1 day ago • 243 • 5

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 8.89k • 306

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 43.2k • 252

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 9 • 13

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 7.14k • 103

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 9.39k • 8

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated 1 day ago • 87 • 2

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 213 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 132 • 17

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 926 • 129

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 24.3k • 358

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • Updated Sep 27, 2023 • 26 • 16

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 12, 2023 • 70 • 4

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 10.8k • 163

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 185 • 8

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 5.62k • 75

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 43 • 42

TheBloke/MLewd-L2-Chat-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 13 • 30

HCCRen/Lamma2-gptq-4bit

Text Generation • Updated Sep 30, 2023 • 107 • 1

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 22, 2023 • 159k • 32

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 3.6k • 26

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4 • 27 • 14

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 741k • 126

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 24.4k • 41

TheBloke/Mythalion-Kimiko-v2-GPTQ

Text Generation • Updated Dec 14, 2023 • 50 • 4