Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Other with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

3,926

Full-text search

Active filters: pruna-ai

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 36 • 1

PrunaAI/Llama3-8B-Chinese-Chat-GGUF-smashed

Updated 10 days ago • 8.61k • 28

PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Updated 10 days ago • 8.59k • 63

PrunaAI/lightblue-suzume-llama-3-8B-japanese-GGUF-smashed

Updated 10 days ago • 11.6k • 1

PrunaAI/yodayo-ai-nephra_v1.0-GGUF-smashed

Updated 10 days ago • 332 • 1

PrunaAI/facebook-opt-125m-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 32

PrunaAI/bigscience-bloom-560m-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 4

PrunaAI/bigscience-bloomz-560m-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-1b7-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-1b1-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloomz-3b-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-560m-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-3b-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-1b7-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 5

PrunaAI/bigscience-bloomz-560m-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloomz-7b1-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloom-3b-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 4

PrunaAI/bigscience-bloom-1b1-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 6

PrunaAI/huggyllama-llama-7b-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 6

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/bigscience-bloomz-3b-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/yahma-llama-7b-hf-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/vj1148-llama-2-7b-legal-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/huggyllama-llama-7b-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 22

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/yahma-llama-7b-hf-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 7

PrunaAI/mosaicml-mpt-7b-instruct-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/daryl149-llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • Updated 10 days ago • 7

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 4