Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4,910

Full-text search

Active filters: pruna-ai

PrunaAI/01-ai-Yi-6B-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/beomi-gemma-mling-7b-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 9

PrunaAI/beomi-gemma-mling-7b-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 15

PrunaAI/arise-sustech-llm4decompile-6.7b-uo-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/arise-sustech-llm4decompile-6.7b-uo-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 6

PrunaAI/arise-sustech-llm4decompile-6.7b-uo-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 14

PrunaAI/lightblue-suzume-llama-3-8B-multilingual-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/vinai-PhoGPT-4B-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 6

PrunaAI/vinai-PhoGPT-4B-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/vinai-PhoGPT-4B-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/rinna-bilingual-gpt-neox-4b-instruction-sft-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/rinna-bilingual-gpt-neox-4b-instruction-sft-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/rinna-bilingual-gpt-neox-4b-instruction-sft-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/maywell-EEVE-Korean-Instruct-10.8B-v1.0-32k-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/fnlp-AnyGPT-chat-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/tokyotech-llm-Swallow-7b-plus-hf-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 6

PrunaAI/beomi-Llama-3-Open-Ko-8B-Instruct-preview-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/zjunlp-OneKE-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 6

PrunaAI/m-a-p-ChatMusician-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/m-a-p-ChatMusician-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/medalpaca-medalpaca-7b-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/allenai-tulu-2-dpo-7b-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/allenai-tulu-2-dpo-7b-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/allenai-tulu-2-dpo-7b-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/gorilla-llm-gorilla-openfunctions-v2-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 9

PrunaAI/chuxin-llm-Chuxin-1.6B-Base-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 6

PrunaAI/rinna-japanese-gpt-neox-3.6b-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 11

PrunaAI/rinna-japanese-gpt-neox-3.6b-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/rinna-japanese-gpt-neox-3.6b-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 8

PrunaAI/liminerity-Mistral-quiet-star-demo-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 8