Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,872

Full-text search

Active filters: 4-bit

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 226 • 2

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 25 • 17

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 3.91k • 35

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 433 • 12

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 2.76k • 10

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 668 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 348 • 7

lucifertrj/pubmed_gemma

Text Generation • Updated Feb 21 • 46 • 1

kuotient/Seagull-13b-translation-AWQ

Translation • Updated Feb 24 • 5 • 1

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 5.78k • 160

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 217 • 4

yixuantt/InvestLM-mistral-AWQ

Text Generation • Updated Apr 4 • 131 • 2

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30 • 3.5k • 14

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated Apr 15 • 4.24k • 29

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30 • 1.65k • 8

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 7.68k • 68

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 5.23k • 106

solidrust/CreativeSmart-2x7B-AWQ

Text Generation • Updated Apr 17

solidrust/Confinus-2x7B-AWQ

Text Generation • Updated Apr 17 • 5

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 45.3k • 29

solidrust/Memgpt-3x7b-MOE-AWQ

Text Generation • Updated Apr 18 • 1

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.41k • 6

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 3.76k • 16

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.07k • 1

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.79k • 6

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 10.9k • 22

SrikanthChellappa/Meta-Llama-3-8B-Instruct-GPTQ-4Bit

Text Generation • Updated Apr 22 • 2 • 1

astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 278 • 6

Rorical/0-roleplay

Text Generation • Updated 2 days ago • 1.03k • 3

RichardErkhov/EleutherAI_-_polyglot-ko-12.8b-4bits

Text Generation • Updated Apr 23 • 1 • 1