Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Other with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

2,090

Full-text search

Active filters: pruna-ai

PrunaAI/bigscience-bloom-1b7-HQQ-1bit-smashed

Text Generation • Updated Apr 17 • 4

PrunaAI/bigscience-bloomz-560m-HQQ-1bit-smashed

Text Generation • Updated Apr 17 • 2

PrunaAI/bigscience-bloom-3b-HQQ-1bit-smashed

Text Generation • Updated Apr 17 • 4

PrunaAI/bigscience-bloom-1b1-HQQ-1bit-smashed

Text Generation • Updated Apr 17 • 3

PrunaAI/bigscience-bloomz-3b-HQQ-1bit-smashed

Text Generation • Updated Apr 17 • 2

PrunaAI/WizardLM-2-7B-GGUF-smashed

Updated Apr 17 • 631 • 2

PrunaAI/facebook-opt-125m-HQQ-2bit-smashed

Text Generation • Updated Apr 23 • 6 • 1

PrunaAI/gemma-2b-it-GGUF-smashed

Updated Apr 18 • 568 • 2

PrunaAI/gemma-2b-GGUF-smashed

Updated Apr 18 • 556 • 2

PrunaAI/Meta-Llama-3-70B-Instruct-GGUF-smashed

Updated Apr 18 • 207 • 7

PrunaAI/Meta-Llama-3-8B-Instruct-GGUF-smashed

Updated Apr 18 • 237 • 5

PrunaAI/gemma-1.1-2b-it-GGUF-smashed

Updated Apr 25 • 763 • 2

PrunaAI/codegemma-2b-GGUF-smashed

Updated Apr 18 • 507 • 1

PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed

Text Generation • Updated Apr 24 • 172 • 9

PrunaAI/Meta-Llama-3-8b-instruct-AWQ-smashed

Text Generation • Updated Apr 24 • 14 • 4

PrunaAI/codegemma-7b-GGUF-smashed

Updated Apr 18 • 519 • 1

PrunaAI/facebook-opt-125m-QUANTO-int4bit-smashed

Updated 7 days ago

PrunaAI/EleutherAI-pythia-70m-deduped-HQQ-2bit-smashed

Text Generation • Updated Apr 19

PrunaAI/EleutherAI-gpt-neo-125m-HQQ-2bit-smashed

Text Generation • Updated Apr 19

PrunaAI/Llama-3-13B-Instruct-v0.1-GGUF-smashed

Updated Apr 22 • 519

PrunaAI/stablelm-2-12b-GGUF-smashed

Updated Apr 22 • 430 • 1

PrunaAI/Meta-Llama-3-8B-GGUF-smashed

Updated Apr 22 • 522

PrunaAI/Llama-3-11B-GGUF-smashed

Updated Apr 22 • 498

PrunaAI/Llama-3-16B-GGUF-smashed

Updated Apr 23 • 532 • 1

PrunaAI/CodeQwen1.5-7B-Chat-GGUF-smashed

Updated Apr 23 • 770 • 2

PrunaAI/Meta-Llama-Guard-2-8B-GGUF-smashed

Updated Apr 23 • 575 • 2

PrunaAI/dolphin-2.9-llama3-8b-GGUF-smashed

Updated Apr 23 • 808 • 3

PrunaAI/Llama-3-8B-16K-GGUF-smashed

Updated Apr 23 • 551 • 2

PrunaAI/llama3-42b-v0-GGUF-smashed

Updated Apr 23 • 560 • 1

PrunaAI/facebook-opt-125m-AWQ-4bit-smashed

Text Generation • Updated 11 days ago • 3