Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Other with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

4,507

Full-text search

Active filters: pruna-ai

PrunaAI/openlynn-Llama-3-Soliloquy-8B-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 8

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-HQQ-2bit-smashed

Text Generation • Updated 19 days ago • 8

PrunaAI/google-gemma-2b-it-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 11

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 4

PrunaAI/google-codegemma-2b-HQQ-4bit-smashed

Text Generation • Updated 12 days ago • 9

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-HQQ-1bit-smashed

Text Generation • Updated 19 days ago • 6

PrunaAI/google-gemma-7b-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 4

PrunaAI/google-gemma-7b-it-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 6

PrunaAI/google-gemma-2b-it-AWQ-4bit-smashed

Text Generation • Updated 19 days ago • 8

PrunaAI/google-codegemma-7b-HQQ-4bit-smashed

Text Generation • Updated 15 days ago • 7

PrunaAI/google-codegemma-7b-it-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 11

PrunaAI/google-gemma-2b-AWQ-4bit-smashed

Text Generation • Updated 19 days ago • 10

PrunaAI/google-codegemma-2b-AWQ-4bit-smashed

Text Generation • Updated 12 days ago • 22

PrunaAI/microsoft-Phi-3-mini-128k-instruct-HQQ-1bit-smashed

Text Generation • Updated 14 days ago • 21

PrunaAI/google-codegemma-7b-it-AWQ-4bit-smashed

Text Generation • Updated 19 days ago • 227

PrunaAI/google-gemma-7b-it-AWQ-4bit-smashed

Text Generation • Updated 19 days ago • 6

PrunaAI/microsoft-Phi-3-mini-128k-instruct-HQQ-2bit-smashed

Text Generation • Updated 14 days ago • 16

PrunaAI/microsoft-Phi-3-mini-4k-instruct-HQQ-1bit-smashed

Text Generation • Updated 19 days ago • 23

PrunaAI/google-gemma-7b-AWQ-4bit-smashed

Text Generation • Updated 19 days ago • 10

PrunaAI/microsoft-Phi-3-mini-4k-instruct-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 21

PrunaAI/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed

Text Generation • Updated 14 days ago • 16

PrunaAI/google-codegemma-7b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 11

PrunaAI/microsoft-Phi-3-mini-4k-instruct-HQQ-2bit-smashed

Text Generation • Updated 19 days ago • 9

PrunaAI/Llama-3-8B-Instruct-Gradient-1048k-GGUF-smashed

Updated 19 days ago • 2.7k • 32

PrunaAI/starcoder2-15b-GGUF-smashed

Updated 19 days ago • 266

PrunaAI/starcoder2-3b-GGUF-smashed

Updated 19 days ago • 204

PrunaAI/starcoder2-7b-GGUF-smashed

Updated 19 days ago • 199

PrunaAI/facebook-opt-125m-HQQ-4bit-smashed

Text Generation • Updated 19 days ago • 4

PrunaAI/starcoder2-15b-instruct-v0.1-GGUF-smashed

Updated 19 days ago • 316

PrunaAI/Llama-3-Soliloquy-8B-v1-24k-GGUF-smashed

Updated 19 days ago • 289