Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,109

Full-text search

Active filters: gptq

TheBloke/airoboros-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 10 • 14

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • Updated Sep 27, 2023 • 24 • 34

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 618 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 608 • 11

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 27 • 12

TheBloke/guanaco-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 39 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 49 • 75

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 638 • 265

TheBloke/guanaco-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 41 • 27

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 8 • 2

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 27 • 21

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 122 • 64

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 25 • 198

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.01k • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 19 • 25

TheBloke/Samantha-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 6 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 10 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 8 • 19

disarmyouwitha/koala13b_test

Text Generation • Updated May 29, 2023 • 6

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 13 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 17 • 12

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 64 • 84

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 201 • 69

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 12 • 11

TheBloke/PMC_LLAMA-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 9 • 4

TheBloke/based-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 8 • 9

TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation • Updated Aug 21, 2023 • 41 • 58

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 807 • 173

TheBloke/airoboros-13b-gpt4-GPTQ

Text Generation • Updated Aug 21, 2023 • 11 • 5

TheBloke/based-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 9 • 1