Edit Models filters

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,615

Full-text search

Active filters: gptq

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 28 • 17

openbmb/MiniCPM-2B-dpo-int4

Text Generation • Updated Apr 7 • 91 • 5

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 3.25k • 35

speakleash/Bielik-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Apr 4 • 4.79k • 5

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.33k • 6

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 3.31k • 16

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.64k • 8

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 10.1k • 23

SrikanthChellappa/Meta-Llama-3-8B-Instruct-GPTQ-4Bit

Text Generation • Updated Apr 22 • 1 • 1

astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 312 • 6

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 9.98k • 13

openerotica/Llama-3-lima-nsfw-16k-test-GPTQ

Text Generation • Updated about 1 month ago • 369

cstr/llama3-8b-spaetzle-v20-int4-inc

Text Generation • Updated 29 days ago • 47 • 3

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated 24 days ago • 109 • 3

Moses25/Mistral-7B-Instruct-32K-GPTQ-INT8

Text Generation • Updated 12 days ago • 17 • 1

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 7 days ago • 373 • 2

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated 7 days ago • 357 • 1

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 7 days ago • 492 • 5

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated 7 days ago • 187 • 2

shadowjourney/sjc-v1

Text Generation • Updated 5 days ago • 62 • 1

aspirina765/Daredevil-8B-abliterated-GPTQ

Text Generation • Updated 8 days ago • 15 • 1

IlyaGusev/saiga_llama3_70b_sft_m1_d5_abliterated_gptq_4bit

Text Generation • Updated 3 days ago • 17 • 1

IlyaGusev/saiga_llama3_70b_sft_m1_d5_abliterated_gptq_3bit

Text Generation • Updated about 17 hours ago • 1

TheBloke/MLewd-L2-Chat-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 10 • 30

TheBloke/Silicon-Maid-7B-GPTQ

Text Generation • Updated Dec 27, 2023 • 19 • 22

TheBloke/MLewd-v2.4-13B-GPTQ

Text Generation • Updated Dec 29, 2023 • 11 • 10

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 32 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 5 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 34 • 39

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 200 • 121