Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,740

Full-text search

Active filters: 4-bit

Richie1129/llama-3-finetune

Text Generation • Updated May 8 • 8

NotAiLOL/Athena-OrpoMistral-7B-v0.1-4bit

Text Generation • Updated May 10 • 747 • 1

bzhang0426/LLaMA3-70B-qlora-bnb-A61K-2

LoneStriker/Llama-3-Lumimaid-70B-v0.1-alt-4.0bpw-h6-exl2

Text Generation • Updated May 7 • 1

solidrust/Mahou-1.0-llama3-8B-AWQ

Text Generation • Updated May 7

solidrust/Mahou-1.0-mistral-7B-AWQ

Text Generation • Updated May 11

CNBOOMBOOM/llama2-hivetalk-merger-awq

Text Generation • Updated May 7 • 3

bartowski/Llama-3-8B-Instruct-Coder-v2-AWQ

Text Generation • Updated May 7 • 6

animaRegem/gemma-2b-malayalam-model-vllm-4bit

Text Generation • Updated 23 days ago • 2

Evolany-AI/Gemma-2b-Summarize-4bit-v1

Text Generation • Updated May 7

animaRegem/gemma-7b-alpaca-instruct-malayalam-model-vllm-4bit

Text Generation • Updated May 7

solidrust/Code-Llama-3-8B-AWQ

Text Generation • Updated May 7 • 4

KevinMusgrave/Meta-Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated May 7 • 1

animaRegem/llama-3-gaya3-alpaca-instruct-malayalam-model-vllm-4bit

Text Generation • Updated May 7 • 1

halitefe/cosmosgpt2_neural-bridge-rag-dataset-12000_instruct

Text Generation • Updated May 9 • 28 • 1

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 11 • 2

nuebaek/komt_mistral_mss_generation_v2

Text Generation • Updated May 7

LoneStriker/llama-3-70B-Instruct-abliterated-4.0bpw-h6-exl2

Text Generation • Updated May 7 • 5

solidrust/Meta-Llama-3-13B-Instruct-AWQ

Text Generation • Updated May 8 • 5

jn2814/gemma-lora

Text Generation • Updated May 7

jn2814/gemma-q4bit

Text Generation • Updated May 8

jn2814/gemma-flash

Text Generation • Updated May 8

redmojo7/unsloth_llama-3-8b-bnb-4bit_linux

Text Generation • Updated May 9

cgus/NinjaMouse2-2.5B-v0.1-exl2

Text Generation • Updated May 9

mikudev/Llama-3-Lumimaid-8B-v0.1-GTPQ

Text Generation • Updated 29 days ago • 3 • 1

rainjay/Llama3-TAIDE-LX-8B-Chat-Alpha1-4bit

Text Generation • Updated May 8 • 19

obamaTeo/mistral-finetune-16bit-ver9-main-GPTQ

Text Generation • Updated May 8 • 3

SaiKamalKadarla/dragon-mistral-7b-v0-Ryobi

Updated 14 days ago • 433

dinhhung1508/Seallm-7b-v2.5-summary-vietnamese-article-v1-merged_4bit

Text Generation • Updated May 8 • 3

ShakaRover/XiaoYuEr-llama3-train

Text Generation • Updated May 8 • 5