Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3,371

Full-text search

Active filters: gptq

ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ

Updated 7 days ago • 281 • 20

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.43k • 174

ModelCloud/EXAONE-3.0-7.8B-Instruct-gptq-4bit

Updated 4 days ago • 56 • 3

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 228 • 133

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated 6 days ago • 2.06k • 14

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.23k • 163

TheBloke/guanaco-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 72 • 29

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 870 • 554

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 112 • 178

TheBloke/CAMEL-13B-Role-Playing-Data-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 48 • 7

TheBloke/LLaMa-65B-GPTQ

Text Generation • Updated Sep 20, 2023 • 30 • 5

TheBloke/LLaMa-13B-GPTQ

Text Generation • Updated Sep 20, 2023 • 178 • 5

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 145k • 79

TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 541 • 119

TheBloke/Llama-2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.61k • 83

TheBloke/Vigogne-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 67 • 5

TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 135k • 43

TheBloke/Airoboros-L2-13B-2.1-GPTQ

Text Generation • Updated Sep 27, 2023 • 35 • 11

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 33.7k • 86

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 782 • 23

TheBloke/law-LLM-GPTQ

Text Generation • Updated Sep 27, 2023 • 22 • 3

TheBloke/tora-7B-v1.0-GPTQ

Text Generation • Updated Oct 14, 2023 • 28 • 1

TheBloke/Vigostral-7B-Chat-GPTQ

Text Generation • Updated Oct 24, 2023 • 78 • 3

TheBloke/openchat_3.5-GPTQ

Text Generation • Updated Nov 2, 2023 • 383 • 17

FreedomIntelligence/HuatuoGPT2-7B-4bits

Text Generation • Updated Nov 30, 2023 • 126 • 5

xun/Qwen-Audio-Chat-Int4

Text Generation • Updated Dec 2, 2023 • 24 • 4

TheBloke/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 2.29k • 127

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 250k • 130

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 30.8k • 43

TheBloke/WestLake-7B-v2-GPTQ

Text Generation • Updated Jan 24 • 229 • 8