Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,585

Full-text search

Active filters: 4-bit

TheBloke/dolphin-2.2-yi-34b-200k-AWQ

Text Generation • Updated Dec 8, 2023 • 21 • 2

TheBloke/go-bruins-v2-GPTQ

Text Generation • Updated Dec 10, 2023 • 19 • 3

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 313k • 128

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 17.4k • 12

TheBloke/Norocetacean-20B-10k-GPTQ

Text Generation • Updated Dec 18, 2023 • 20 • 2

TheBloke/SOLAR-10.7B-Instruct-v1.0-uncensored-GPTQ

Text Generation • Updated Dec 19, 2023 • 75 • 12

casperhansen/mixtral-instruct-awq

Text Generation • Updated Feb 11 • 12.3k • 41

TheBloke/dolphin-2.6-mistral-7B-AWQ

Text Generation • Updated Dec 28, 2023 • 98 • 6

TheBloke/Sonya-7B-GPTQ

Text Generation • Updated Dec 31, 2023 • 14 • 2

TheBloke/Kunoichi-7B-GPTQ

Text Generation • Updated Jan 5 • 62 • 15

TheBloke/Rosa_v2_7B-GPTQ

Text Generation • Updated Jan 5 • 15 • 2

TheBloke/openchat-3.5-0106-GPTQ

Text Generation • Updated Jan 10 • 122 • 6

TheBloke/medicine-LLM-GPTQ

Text Generation • Updated Jan 15 • 20 • 12

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 533 • 9

FPHam/Sarah_StoryTeller_13b-GPTQ

Text Generation • Updated Jan 24 • 11 • 1

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 1.71k • 49

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30 • 4.88k • 19

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 85 • 15

nateraw/defog-sqlcoder-70b-alpha-awq

Text Generation • Updated Feb 8 • 11 • 1

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 1.12k • 3

MaziyarPanahi/gemma-2b-GGUF

Text Generation • Updated Feb 27 • 426 • 6

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Apr 18 • 7.2k • 16

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10 • 240 • 6

Cyleux/command-r-gptq

Text Generation • Updated May 4 • 116 • 5

peiya/NSFW_DPO_Noromaid-7b-AWQ

Text Generation • Updated Mar 29 • 25 • 1

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8 • 216 • 7

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30 • 693 • 16

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated 22 days ago • 17.7k • 32

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30 • 3.32k • 10

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 2.32k • 71