Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

3,895

Full-text search

Active filters: gptq

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 26 days ago • 5.41k • 21

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 52.9k • 10

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 6 days ago • 9.16k • 19

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 73.9k • 15

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated 2 days ago • 886 • 3

speakleash/Bielik-11B-v2.2-Instruct-GPTQ

Text Generation • Updated 19 days ago • 492 • 3

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 8 days ago • 11.5k • 16

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 10 days ago • 4.21k • 9

openbmb/MiniCPM3-4B-GPTQ-Int4

Text Generation • Updated 10 days ago • 1.01k • 10

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 7.57k • 313

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 91 • 37

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 577 • 135

TheBloke/airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 31 • 31

TheBloke/Chronoboros-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 48 • 28

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 16.8k • 80

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 12k • 259

TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ

Text Generation • Updated Sep 27, 2023 • 24 • 25

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.66k • 181

TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 147k • 44

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 56 • 9

TheBloke/Phind-CodeLlama-34B-v2-GPTQ

Text Generation • Updated Sep 27, 2023 • 164 • 89

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 401 • 26

TheBloke/Mistral-7B-OpenOrca-GPTQ

Text Generation • Updated Oct 16, 2023 • 86.9k • 100

TheBloke/AquilaChat2-34B-16K-GPTQ

Text Generation • Updated Oct 29, 2023 • 16 • 6

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • Updated Nov 2, 2023 • 48 • 13

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 38k • 46

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 129 • 96

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • Updated Jan 16 • 1k • 26

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8 • 159 • 10

javiagu/KULLM3_GPTQ

Text Generation • Updated May 3 • 36 • 1