Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3,325

Full-text search

Active filters: gptq

TheBloke/dromedary-65B-lora-GPTQ

Text Generation • Updated Aug 21, 2023 • 11 • 6

TheBloke/gpt4-alpaca-lora_mlp-65B-GPTQ

Text2Text Generation • Updated Aug 21, 2023 • 16 • 14

TheBloke/wizard-mega-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 47 • 107

TheBloke/VicUnlocked-30B-LoRA-GPTQ

Text Generation • Updated Sep 27, 2023 • 23 • 20

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.84k • 162

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 47 • 37

qwopqwop/KoAlpaca-Polyglot-5.8B-GPTQ

Text Generation • Updated May 19, 2023 • 20 • 3

qwopqwop/KoAlpaca-Polyglot-12.8B-GPTQ

Text Generation • Updated May 19, 2023 • 17 • 5

TheBloke/WizardLM-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 62 • 117

digitous/13B-Chimera

Text Generation • Updated May 24, 2023 • 901 • 6

TheBloke/airoboros-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 13 • 13

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • Updated Sep 27, 2023 • 43 • 34

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 921 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 921 • 11

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 16 • 12

TheBloke/guanaco-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 34 • 75

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 927 • 266

TheBloke/guanaco-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 63 • 27

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 12 • 2

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 39 • 21

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 186 • 64

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 105 • 198

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 35 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 47 • 25

TheBloke/Samantha-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 11 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 14 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 11 • 19

disarmyouwitha/koala13b_test

Text Generation • Updated May 29, 2023 • 4

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 27 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 16 • 12