Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,596

Full-text search

Active filters: 4-bit

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 2.32k • 71

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • Updated Apr 18 • 3.26k • 10

solidrust/Meta-Llama-3-8B-Instruct-hf-AWQ

Text Generation • Updated Apr 22 • 3.5k • 7

mgoin/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 18 • 79 • 2

mgoin/Meta-Llama-3-70B-Instruct-Marlin

Text Generation • Updated Apr 19 • 758 • 6

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 144k • 64

TechxGenus/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Apr 19 • 1.1k • 3

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 4.63k • 15

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.43k • 11

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 5.38k • 24

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 12.8k • 40

Dogge/llama-3-70B-instruct-uncensored-lora

Text Generation • Updated Apr 20 • 349 • 5

SweatyCrayfish/llama-3-8b-quantized

Text Generation • Updated Apr 20 • 5.87k • 5

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 97 • 3

pvbhanuteja/llama-3-70b-instruct-awq

Text Generation • Updated Apr 27 • 3.5k • 1

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • Updated Apr 29 • 116 • 2

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 24 days ago • 58.3k • 20

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • Updated May 3 • 196 • 11

LoneStriker/Llama3-ChatQA-1.5-8B-4.0bpw-h6-exl2

Text Generation • Updated May 2 • 28 • 1

ecastera/eva-dolphin-llama3-8b-spanish

Text Generation • Updated Jun 14 • 27 • 2

vilm/VinaLlama2-14B-GPTQ-Int4

Text Generation • Updated May 15 • 29 • 2

chansung/mental_health_counseling_merged_v0.1

Text Generation • Updated May 29 • 39 • 1

llama-duo/gemma7b-summarize-claude3sonnet-30k

Updated May 22 • 44 • 3

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 5 days ago • 144k • 61

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 182k • 52

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated May 22 • 37.7k • 11

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated May 22 • 25k • 14

julep-ai/dolphin-2.9.1-llama-3-70b-awq

Text Generation • Updated May 23 • 68 • 2

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10 • 8.93k • 11

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated May 25 • 2.38k • 2