Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/garage-bAInd-Platypus2-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/LeoLM-leo-hessianai-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/TinyLlama-TinyLlama-1.1B-step-50K-105b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/codellama-CodeLlama-7b-Python-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/BioMistral-BioMistral-7B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/TinyLlama-TinyLlama-1.1B-Chat-v0.3-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/luffycodes-vicuna-class-shishya-7b-ep3-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/garage-bAInd-Platypus2-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/LeoLM-leo-hessianai-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/LeoLM-leo-hessianai-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/TinyLlama-TinyLlama-1.1B-step-50K-105b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/GritLM-GritLM-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/LeoLM-leo-hessianai-7b-chat-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 21

PrunaAI/01-ai-Yi-6B-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 24

PrunaAI/cyberagent-calm2-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/BioMistral-BioMistral-7B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 296

PrunaAI/Intel-neural-chat-7b-v3-1-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/deepseek-ai-deepseek-math-7b-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/FredZhang7-distilgpt2-stable-diffusion-v2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/FredZhang7-distilgpt2-stable-diffusion-v2-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/01-ai-Yi-6B-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/cyberagent-calm2-7b-chat-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/gorilla-llm-gorilla-openfunctions-v2-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 7

PrunaAI/deepseek-ai-deepseek-math-7b-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/deepseek-ai-deepseek-math-7b-rl-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 27

PrunaAI/nickypro-tinyllama-15M-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/nickypro-tinyllama-15M-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/Intel-neural-chat-7b-v3-1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/Daoguang-PyCodeGPT-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/Daoguang-PyCodeGPT-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12