Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/Qwen2-72B-Instruct-GGUF-smashed

Updated Aug 2 • 68

PrunaAI/Qwen2-72B-GGUF-smashed

Updated Aug 2 • 49

PrunaAI/cognitivecomputations-dolphin-2.9.2-qwen2-72b-GGUF-smashed

Updated Aug 2 • 516

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 6

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-QUANTO-int4bit-smashed

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-QUANTO-int2bit-smashed

Updated Aug 2 • 4

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-QUANTO-int8bit-smashed

Updated Aug 2 • 3

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-QUANTO-float8bit-smashed

Updated Aug 2 • 4

PrunaAI/NousResearch-Meta-Llama-3-8B-QUANTO-int2bit-smashed

Updated Aug 2 • 20

PrunaAI/NousResearch-Meta-Llama-3-8B-QUANTO-int4bit-smashed

Updated Aug 2 • 14

PrunaAI/NousResearch-Meta-Llama-3-8B-QUANTO-int8bit-smashed

Updated Aug 2 • 10

PrunaAI/NousResearch-Meta-Llama-3-8B-QUANTO-float8bit-smashed

Updated Aug 2 • 4

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-64k-QUANTO-int2bit-smashed

Updated Aug 2 • 3

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-64k-QUANTO-int4bit-smashed

Updated Aug 2 • 1

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-64k-QUANTO-float8bit-smashed

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-QUANTO-int2bit-smashed

Updated Aug 2 • 1

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-QUANTO-int4bit-smashed

Updated Aug 2 • 1

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-QUANTO-int8bit-smashed

Updated Aug 2 • 1

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-QUANTO-float8bit-smashed

Updated Aug 2 • 3

PrunaAI/AdaptLLM-medicine-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/AdaptLLM-medicine-chat-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/AdaptLLM-medicine-chat-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/AdaptLLM-medicine-chat-QUANTO-int4bit-smashed

Updated Aug 2 • 4

PrunaAI/AdaptLLM-medicine-chat-QUANTO-int2bit-smashed

Updated Aug 2 • 1

PrunaAI/AdaptLLM-medicine-chat-QUANTO-float8bit-smashed

Updated Aug 2 • 6

PrunaAI/AdaptLLM-medicine-chat-QUANTO-int8bit-smashed

PrunaAI/aisquared-dlite-v2-1_5b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/aisquared-dlite-v2-1_5b-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/aisquared-dlite-v2-1_5b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/aisquared-dlite-v2-1_5b-QUANTO-int2bit-smashed