Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/TinyLlama-TinyLlama-1.1B-step-50K-105b-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/openaccess-ai-collective-tiny-mistral-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/hfl-chinese-llama-2-1.3b-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/Cheng98-llama-160m-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/42dot-42dot_LLM-PLM-1.3B-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/Mistral-22B-v0.2-GGUF-smashed

Updated Aug 2 • 600 • 3

PrunaAI/Mistral-7B-Instruct-v0.2-GGUF-smashed

Updated Aug 2 • 263 • 1

PrunaAI/zephyr-orpo-141b-A35b-v0.1-GGUF-smashed

Updated Aug 2 • 820 • 3

PrunaAI/Poro-34B-GGUF-smashed

Updated Aug 2 • 49

PrunaAI/lynn-7b-alpha-GGUF-smashed

Updated Aug 2 • 457

PrunaAI/facebook-opt-125m-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 24

PrunaAI/facebook-opt-1.3b-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/facebook-opt-350m-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/facebook-opt-2.7b-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/KoboldAI-OPT-2.7B-Erebus-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/TinyLlama-TinyLlama-1.1B-intermediate-step-1195k-token-2.5T-GPTQ-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/codegemma-7b-it-GGUF-smashed

Updated Aug 2 • 251 • 1

PrunaAI/bigscience-bloom-560m-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/bigscience-bloom-1b7-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/bigscience-bloomz-560m-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/bigscience-bloom-1b1-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/bigscience-bloom-3b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/bigscience-bloomz-3b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/openlm-research-open_llama_3b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/facebook-opt-1.3b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/facebook-opt-350m-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 288

PrunaAI/openlm-research-open_llama_3b_v2-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/HuggingFaceM4-tiny-random-LlamaForCausalLM-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/KoboldAI-OPT-2.7B-Erebus-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/fxmarty-tiny-llama-fast-tokenizer-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11