Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,561

Full-text search

Active filters: 4-bit

compressa-ai/Llama-3-70B-Instruct-OmniQuant

Text Generation • Updated 17 days ago • 2

mridul161203/Meta-llama-3-8B-Qlora-quantized-GPTQ

Text Generation • Updated 22 days ago • 125

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-SFT-4bits

Text Generation • Updated 22 days ago

fergos80/mistral-sigoIAspirantes-Orca-oass-500-gpu

Updated 22 days ago • 33

just1nseo/tulu2-7b-cost-UI-both

Updated 22 days ago • 22

RichardErkhov/NousResearch_-_Genstruct-7B-4bits

Text Generation • Updated 22 days ago • 2

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-DPO-4bits

Text Generation • Updated 22 days ago

uine/multi-practice-fine-tuning-kullm-merge

Text Generation • Updated 22 days ago

pranaysharma/WizardCoder-15B-1.0-GPTQ_TheBloke_Clone

Text Generation • Updated 17 days ago • 2

TETO101/AIRI-70B-V2-INS-AWQ

Text Generation • Updated 22 days ago • 8

Blue-kod/phi4strela

Text Generation • Updated 22 days ago • 16

754geg/kpok

Text Generation • Updated 22 days ago • 10

jamesohe/casaudit3-4bit-p01-base

Text Generation • Updated 22 days ago • 98

chinmayc3/llama3-8b-instruct-awq

Feature Extraction • Updated 22 days ago • 2

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-4bits

Text Generation • Updated 22 days ago

RichardErkhov/NousResearch_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • Updated 22 days ago

1093212290a/idefics-9b-doodles

Updated 22 days ago

uine/single-practice-fine-tuning-eeve-merge

Text Generation • Updated 22 days ago

RichardErkhov/NousResearch_-_Meta-Llama-3-70B-4bits

Text Generation • Updated 22 days ago

Linxier/opt-125m-gptq-4bit

Text Generation • Updated 13 days ago • 3

blockblockblock/Olethros-8B-bpw4-exl2

Text Generation • Updated 22 days ago

lodrick-the-lafted/Olethros-8B-AWQ

Text Generation • Updated 21 days ago • 4

sid-th26/gemma-mcq-question-all-data

Text Generation • Updated 22 days ago • 6

basakerdogan/cyber-jarvis-llama3-4bit

Text Generation • Updated 22 days ago • 8

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated 22 days ago • 25

Alaa18/Assistant_chatbot_Mistral

Text Generation • Updated 12 days ago • 12

solidrust/Llama-3-LewdPlay-8B-evo-AWQ

Text Generation • Updated 17 days ago • 70

RichardErkhov/facebook_-_galactica-125m-4bits

Text Generation • Updated 20 days ago • 1

RichardErkhov/facebook_-_xglm-4.5B-4bits

Text Generation • Updated 20 days ago

solidrust/flammen22C-mistral-7B-AWQ

Text Generation • Updated 17 days ago