Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,263

Full-text search

Active filters: 4-bit

PrunaAI/ajibawa-2023-Scarlett-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated 4 days ago • 2

GalaktischeGurke/quant_test_opt

Text Generation • Updated 15 days ago • 2

PrunaAI/beomi-Llama-3-KoEn-8B-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/RESMPDEV-Wukong-0.1-Mistral-7B-v0.2-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/M4-ai-tau-0.5B-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/openchat-openchat_3.5-AWQ-4bit-smashed

Text Generation • Updated 12 days ago • 1

PrunaAI/snorkelai-Snorkel-Mistral-PairRM-DPO-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/allenai-tulu-2-dpo-13b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/Xwin-LM-Xwin-Math-7B-V1.1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 2

PrunaAI/simecek-cswikimistral_0.1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/cognitivecomputations-dolphin-2.9.2-Phi-3-Medium-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 11

PrunaAI/codellama-CodeLlama-13b-hf-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-28K-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 4

PrunaAI/AI-Sweden-Models-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated 11 days ago • 2

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/mychen76-mistral7b_ocr_to_json_v1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/sail-Sailor-14B-Chat-AWQ-4bit-smashed

Text Generation • Updated about 4 hours ago • 8

PrunaAI/Nexusflow-NexusRaven-V2-13B-AWQ-4bit-smashed

Text Generation • Updated 11 days ago • 3

PrunaAI/TheDrummer-Moistral-11B-v2-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

clgptcapstone/ft-calculator

Text Generation • Updated 14 days ago • 18

piyushsalunke/q4-llama-3

Text Generation • Updated 15 days ago • 30

inflaton/Llama-3-8B-Instruct-Gradient-1048k-MAC-lora

Text Generation • Updated 15 days ago • 6.55k

Weni/ZeroShot-Agents-Llama3-4.0.26-DPO-AWQ

Text Generation • Updated 15 days ago • 4

blockblockblock/llama3-turbcat-instruct-8b-bpw4-exl2

Text Generation • Updated 15 days ago

inflaton/Qwen2-1.5B-Instruct-bnb-4bit-MAC-lora

Text Generation • Updated 12 days ago • 1

Studeni/llama-3-8b-bnb-4bit-robot-instruct

Text Generation • Updated 14 days ago • 88

PrunaAI/TinyLlama-TinyLlama_v1.1-AWQ-4bit-smashed

Text Generation • Updated about 4 hours ago • 1

PrunaAI/dreamgen-opus-v1.2-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1