Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,854

Full-text search

Active filters: 4-bit

dbaek111/Llama-3-8B-Instruct-Elon_407_HPC_Q_v2

Text Generation • Updated Apr 27

NiCoSav/llama-3-8b-bnb-4bit

Text Generation • Updated May 3 • 1

saksornr/SeaLLM-7B-v2.5-4bit

Text Generation • Updated May 5 • 7 • 1

ssuncheol/Phi-3-mini-128k-instruct-int4

Text Generation • Updated Apr 27

stylellm/SanGuoYanYi-6b-AWQ

Text Generation • Updated May 4 • 10

Dogge/llama-3-translate-enko-4bit

Text Generation • Updated Apr 27 • 51 • 1

fxmeng/PiSSA-Llama-2-7B-r128-4bit-5iter

Text Generation • Updated Apr 27 • 41

compressa-ai/Saiga-Llama-3-8B-AdaQRound

Text Generation • Updated Apr 27 • 6

stelterlab/starchat2-15b-v0.1-AWQ

Text Generation • Updated Apr 27 • 76

Aharneish/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Apr 27 • 2

clarkchan/llama3-8b-alpaca-gpt4-chinese

Text Generation • Updated Apr 29 • 6

MANMEET75/TinyLlama-1.1B-Chat-v1.0-AWQ-4bit

Text Generation • Updated Apr 27 • 1

maitreyaz/Llama-3-8B-AWQ-4bit

Text Generation • Updated Apr 29 • 6

amarard/FinetunedOrpoLlama-3-8B

Text Generation • Updated Apr 27

riveRiPH/Llama-3SOME-8B-v1-BETA-4.0bpw-h8-exl2

Text Generation • Updated May 1 • 1

omertafveez/Gemma-TherapyChatBot

Text Generation • Updated Apr 27 • 8

pvbhanuteja/llama-3-8b-instruct-awq

Text Generation • Updated Apr 27 • 3

pvbhanuteja/llama-3-70b-instruct-awq

Text Generation • Updated Apr 27 • 12

compressa-ai/Llama-3-70B-Instruct-OmniQuant

Text Generation • Updated May 2 • 3

mridul161203/Meta-llama-3-8B-Qlora-quantized-GPTQ

Text Generation • Updated Apr 27 • 58

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-SFT-4bits

Text Generation • Updated Apr 28

fergos80/mistral-sigoIAspirantes-Orca-oass-500-gpu

just1nseo/tulu2-7b-cost-UI-both

RichardErkhov/NousResearch_-_Genstruct-7B-4bits

Text Generation • Updated Apr 28 • 6

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-DPO-4bits

Text Generation • Updated Apr 28

pranaysharma/WizardCoder-15B-1.0-GPTQ_TheBloke_Clone

Text Generation • Updated May 3

TETO101/AIRI-70B-V2-INS-AWQ

Text Generation • Updated Apr 28 • 2

754geg/kpok

Text Generation • Updated Apr 28 • 17

jamesohe/casaudit3-4bit-p01-base

Text Generation • Updated Apr 28 • 5

chinmayc3/llama3-8b-instruct-awq

Feature Extraction • Updated Apr 28 • 4