Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,619

Full-text search

Active filters: gptq

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 4.38k • 11

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 9.81k • 19

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 15.6k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 21.6k • 23

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 7.13k • 7

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 5 days ago • 659 • 1

xmadai/Llama-3.1-405B-Instruct-xMADai-INT4

Text Generation • Updated 24 days ago • 946 • 6

AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4

Image-Text-to-Text • Updated 12 days ago • 1.2k • 7

xmadai/Llama-3.2-3B-Instruct-xMADai-INT4

Text Generation • Updated 29 days ago • 117 • 6

xmadai/Llama-3.2-1B-Instruct-xMADai-4bit

Text Generation • Updated Oct 17 • 117 • 5

xmadai/Mistral-Small-Instruct-2409-xMADai-INT4

Text Generation • Updated 29 days ago • 341 • 5

xmadai/Llama-3.1-8B-Instruct-xMADai-INT4

Text Generation • Updated 29 days ago • 188 • 4

shuyuej/Llama-3.1-Nemotron-70B-Instruct-HF-GPTQ

Updated Oct 22 • 5.47k • 1

tb423/internlm2_5-7b-chat-gptq-c4-8bit

Feature Extraction • Updated about 1 month ago • 1.96k • 1

xmadai/Mistral-Large-Instruct-2407-xMADai-INT4

Text Generation • Updated 24 days ago • 5.6k • 6

xmadai/gemma-2-9b-it-xMADai-INT4

Text Generation • Updated 24 days ago • 35 • 4

AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4

Image-Text-to-Text • Updated 12 days ago • 346 • 4

xmadai/Llama-3.1-Nemotron-70B-Instruct-xMADai-INT4

Text Generation • Updated 24 days ago • 721 • 4

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2

Text Generation • Updated 12 days ago • 92 • 3

arifulFarhad/Rombos-LLM-V2.6-Qwen-14b-gptq-int4

Updated 12 days ago • 128 • 2

divyachand/google-gemma-2-9b-q

Text Generation • Updated 21 days ago • 20 • 1

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated 5 days ago • 3.38k • 5

shuyuej/Ministral-8B-Instruct-2410-GPTQ

Updated 9 days ago • 63 • 1

billatsectorflow/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4-128K

Text Generation • Updated 4 days ago • 30 • 1

TechxGenus/Mistral-Large-Instruct-2411-GPTQ

Updated 3 days ago • 70 • 1

TheBloke/MLewd-ReMM-L2-Chat-20B-GPTQ

Text Generation • Updated Sep 27, 2023 • 133 • 20

TheBloke/Xwin-MLewd-13B-v0.2-GPTQ

Text Generation • Updated Oct 15, 2023 • 177 • 40

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 80 • 20

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 12 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 8 • 68