Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/dicta-il-dictalm-7b-QUANTO-int4bit-smashed

Updated Jul 19 • 2

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 5

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 5

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-HQQ-4bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-QUANTO-int2bit-smashed

Updated Jul 19 • 1

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-QUANTO-int4bit-smashed

Updated Jul 19 • 6

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-QUANTO-float8bit-smashed

PrunaAI/nota-ai-st-vicuna-v1.3-5.5b-ppl-QUANTO-int8bit-smashed

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 10

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 7

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 5

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-QUANTO-int2bit-smashed

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-QUANTO-int8bit-smashed

Updated Jul 19 • 1

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-QUANTO-int4bit-smashed

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-QUANTO-float8bit-smashed

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 5

PrunaAI/maywell-Llama-3-Ko-8B-Instruct-GGUF-smashed

Updated Jul 12 • 261

PrunaAI/Symbol-LLM-Symbol-LLM-13B-Instruct-GGUF-smashed

Updated Jul 12 • 149

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 13

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-HQQ-1bit-smashed

Text Generation • Updated Jul 12 • 10

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-QUANTO-int8bit-smashed

Updated Jul 19 • 4

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-QUANTO-float8bit-smashed

Updated Jul 19 • 2

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-QUANTO-int4bit-smashed

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 12

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-QUANTO-int2bit-smashed

Updated Jul 19 • 4

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-QUANTO-int8bit-smashed

Updated Jul 19 • 4

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-QUANTO-int4bit-smashed

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 13

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-HQQ-2bit-smashed

Text Generation • Updated Jul 12 • 16