Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Other with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

4,504

Full-text search

Active filters: pruna-ai

PrunaAI/facebook-xglm-564M-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 12

PrunaAI/hf-tiny-model-private-tiny-random-BloomForCausalLM-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 4

PrunaAI/EleutherAI-pythia-2.8b-deduped-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 7

PrunaAI/Cheng98-llama-160m-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 4

PrunaAI/bigscience-bloom-560m-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 6

PrunaAI/bigscience-bloom-1b7-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 7

PrunaAI/bigscience-bloomz-560m-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 6

PrunaAI/bigscience-bloom-3b-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 7

PrunaAI/bigscience-bloom-1b1-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 11

PrunaAI/bigscience-bloomz-3b-HQQ-1bit-smashed

Text Generation • Updated 18 days ago • 3

PrunaAI/WizardLM-2-7B-GGUF-smashed

Updated 18 days ago • 531 • 2

PrunaAI/facebook-opt-125m-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 11 • 1

PrunaAI/gemma-2b-it-GGUF-smashed

Updated 18 days ago • 323 • 2

PrunaAI/gemma-2b-GGUF-smashed

Updated 18 days ago • 338 • 2

PrunaAI/Meta-Llama-3-70B-Instruct-GGUF-smashed

Updated 18 days ago • 124 • 7

PrunaAI/Meta-Llama-3-8B-Instruct-GGUF-smashed

Updated 18 days ago • 239 • 5

PrunaAI/gemma-1.1-2b-it-GGUF-smashed

Updated 18 days ago • 408 • 2

PrunaAI/codegemma-2b-GGUF-smashed

Updated 18 days ago • 342 • 1

PrunaAI/Meta-Llama-3-70b-instruct-AWQ-smashed

Text Generation • Updated 18 days ago • 117 • 9

PrunaAI/Meta-Llama-3-8b-instruct-AWQ-smashed

Text Generation • Updated 18 days ago • 55 • 4

PrunaAI/codegemma-7b-GGUF-smashed

Updated 18 days ago • 413 • 1

PrunaAI/EleutherAI-pythia-70m-deduped-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 3

PrunaAI/EleutherAI-gpt-neo-125m-HQQ-2bit-smashed

Text Generation • Updated 18 days ago • 4

PrunaAI/Llama-3-13B-Instruct-v0.1-GGUF-smashed

Updated 18 days ago • 670

PrunaAI/stablelm-2-12b-GGUF-smashed

Updated 18 days ago • 205 • 1

PrunaAI/Meta-Llama-3-8B-GGUF-smashed

Updated 18 days ago • 338

PrunaAI/Llama-3-11B-GGUF-smashed

Updated 18 days ago • 394

PrunaAI/Llama-3-16B-GGUF-smashed

Updated 18 days ago • 1.09k • 1

PrunaAI/CodeQwen1.5-7B-Chat-GGUF-smashed

Updated 18 days ago • 651 • 2

PrunaAI/Meta-Llama-Guard-2-8B-GGUF-smashed

Updated 18 days ago • 379 • 2