Edit Models filters

Model Tree

01-ai/Yi-9B-200K

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

7

Full-text search

Active filters: 01-ai/Yi-9B-200K

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int8bit-smashed

Updated Jul 24 • 6

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int4bit-smashed

Updated Jul 24 • 6

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int2bit-smashed

Updated Jul 24 • 12

PrunaAI/01-ai-Yi-9B-200K-QUANTO-float8bit-smashed

Updated Jul 24 • 9

PrunaAI/01-ai-Yi-9B-200K-HQQ-1bit-smashed

Text Generation • Updated Jul 24 • 13 • 1

PrunaAI/01-ai-Yi-9B-200K-HQQ-2bit-smashed

Text Generation • Updated Jul 24 • 12 • 2

PrunaAI/01-ai-Yi-9B-200K-HQQ-4bit-smashed

Text Generation • Updated Jul 24 • 15