Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/alfredplpl-Llama-3-8B-Instruct-Ja-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/NousResearch-Llama-2-13b-hf-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/NousResearch-Llama-2-13b-hf-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/NousResearch-Llama-2-13b-hf-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/sail-Sailor-14B-Chat-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-HQQ-2bit-smashed

Text Generation • Updated Aug 2

PrunaAI/zjunlp-knowlm-13b-zhixi-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Doctor-Shotgun-TinyLlama-1.1B-32k-Instruct-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 1

PrunaAI/zjunlp-knowlm-13b-zhixi-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/sail-Sailor-14B-Chat-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/zjunlp-knowlm-13b-zhixi-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/sail-Sailor-14B-Chat-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptbr-decoder-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 1

PrunaAI/codellama-CodeLlama-13b-hf-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 1

PrunaAI/codellama-CodeLlama-13b-hf-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/codellama-CodeLlama-13b-hf-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/AI-Sweden-Models-Llama-3-8B-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Nexusflow-NexusRaven-V2-13B-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/AI-Sweden-Models-Llama-3-8B-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 1

PrunaAI/AI-Sweden-Models-Llama-3-8B-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Tele-AI-telechat-7B-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Tele-AI-telechat-7B-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Nexusflow-NexusRaven-V2-13B-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Nexusflow-NexusRaven-V2-13B-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-28K-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 2