Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

18,106

Full-text search

Active filters: 4-bit

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 1.81M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 65.9k • 125

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 409 • 12

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 66.7k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 131k • 165

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 1.9M • 77

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 12 days ago • 82.1k • 131

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 838 • 18

leliuga/Meta-Llama-Guard-2-8B-bnb-4bit

Text Generation • Updated Apr 19 • 20 • 1

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 52 • 6

SweatyCrayfish/llama-3-8b-quantized

Text Generation • Updated Apr 20 • 642 • 10

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 31 • 4

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 179 • 4

MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF

Text Generation • Updated Apr 24 • 68 • 4

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.1-GGUF

Text Generation • Updated Apr 25 • 1.43M • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 230 • 23

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 75 • 1

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 2.28k • 7

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 24 • 4

nm-testing/Llama-2-7b-pruned2.4-Marlin_24

Text Generation • Updated May 15 • 964 • 1

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 23k • 70

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated 12 days ago • 33.8k • 12

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10 • 1.29k • 15

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27 • 42 • 1

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 2.73k • 26

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 48 • 8

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 16 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 43 • 3

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 2.19k • 23

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 1.81M • 10