Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,352

Full-text search

Active filters: 4-bit

solidrust/bagel-8b-v1.0-AWQ

Text Generation • Updated about 1 month ago • 10

solidrust/flammen21X-mistral-7B-AWQ

Text Generation • Updated about 1 month ago

solidrust/Llama-3-8B-Instruct-64k-AWQ

Text Generation • Updated May 2 • 9

neotran/sdprompt_tiny_4bit

Text Generation • Updated Apr 28 • 1

dwb2023/mistral-7b-instruct-quantized

Text Generation • Updated Apr 29 • 22

dwb2023/Meta-Llama-3-8B-Instruct-quantized

Text Generation • Updated Apr 29 • 125 • 1

moetezsa/test

Text Generation • Updated Apr 29

Ramikan-BR/tinyllama_PY-CODER-bnb-4bit-lora_4k-v2_q4_k_m

Text Generation • Updated May 1 • 21

chansung/llamaduo_synth_ds_v0.1

Updated Apr 30 • 1 • 1

Aharneish/Llama-Chat-final_merged

Text Generation • Updated Apr 29

kyounghyun/eeve-levware-kor

Text Generation • Updated Apr 29

RichardErkhov/NousResearch_-_Hermes-2-Pro-Mistral-7B-4bits

Text Generation • Updated Apr 29

nayan8625/llama3-8b-ymhafinetuned

Text Generation • Updated Apr 29 • 1

RyotaKadoya1993/PEFT-MoE2

Text Generation • Updated Apr 29

rainjay/Meta-Llama-3-8B-Instruct-4bit

Text Generation • Updated 26 days ago • 37

eunyounglee/EEVE-LLM2Vec-MNTP-1-quant

Feature Extraction • Updated Apr 30 • 2

Nandu2905/Indic-gemma-2b-finetuned-sft-Navarasa-2.0-gptq-4bit

Text Generation • Updated Apr 29 • 1

Rebecca19990101/Llama3-Petro-Instruct-v1

Text Generation • Updated Apr 30 • 763

PrunaAI/cognitivecomputations-dolphin-2.9-llama3-8b-256k-AWQ-4bit-smashed

Text Generation • Updated May 2 • 5

NAV1515/temple12

Text Generation • Updated Apr 29 • 9

Nandu2905/Indic-gemma-2b-finetuned-sft-Navarasa-3.0-gptq-4bit

Text Generation • Updated Apr 29 • 1

TechxGenus/c4ai-command-r-v01-AWQ

Text Generation • Updated Apr 29 • 205

kyounghyun/EEVE2.8B_KO_Finetune_test

Text Generation • Updated Apr 29 • 1

Gurminder/temples

Text Generation • Updated Apr 30 • 5

PrunaAI/shenzhi-wang-Llama3-8B-Chinese-Chat-AWQ-4bit-smashed

Text Generation • Updated May 2 • 43

PrunaAI/NousResearch-Meta-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated May 2

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-AWQ-4bit-smashed

Text Generation • Updated May 2 • 6

hugodk-sch/ap-normistral-7b-sft-qlora

PrunaAI/aaditya-Llama3-OpenBioLLM-8B-AWQ-4bit-smashed

Text Generation • Updated May 2 • 5

noeloco/modeltest1-dpo