Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/aisquared-dlite-v2-1_5b-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/aisquared-dlite-v2-1_5b-QUANTO-int4bit-smashed

Updated Aug 2 • 2

PrunaAI/aisquared-dlite-v2-1_5b-QUANTO-int8bit-smashed

Updated Aug 2 • 2

PrunaAI/aisquared-dlite-v2-1_5b-QUANTO-float8bit-smashed

Updated Aug 2 • 2

PrunaAI/lllyasviel-omost-llama-3-8b-4bits-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/lllyasviel-omost-llama-3-8b-4bits-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 40

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-QUANTO-int2bit-smashed

Updated Aug 2 • 14

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-QUANTO-int8bit-smashed

Updated Aug 2 • 1

PrunaAI/MaziyarPanahi-Calme-7B-Instruct-v0.1.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/Undi95-Meta-Llama-3-8B-hf-QUANTO-int2bit-smashed

PrunaAI/Undi95-Meta-Llama-3-8B-hf-QUANTO-int8bit-smashed

Updated Aug 2 • 1

PrunaAI/Undi95-Meta-Llama-3-8B-hf-QUANTO-int4bit-smashed

Updated Aug 2 • 5

PrunaAI/Undi95-Meta-Llama-3-8B-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 6

PrunaAI/Undi95-Meta-Llama-3-8B-hf-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-QUANTO-int4bit-smashed

Updated Aug 2 • 1

PrunaAI/Undi95-Meta-Llama-3-8B-hf-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 10

PrunaAI/Undi95-Meta-Llama-3-8B-hf-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-QUANTO-float8bit-smashed

Updated Aug 2 • 2

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 6

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-QUANTO-int2bit-smashed

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-QUANTO-int8bit-smashed

Updated Aug 2 • 3

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/Undi95-Meta-Llama-3-8B-hf-QUANTO-float8bit-smashed

Updated Aug 2 • 1

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/Undi95-Meta-Llama-3-8B-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.3-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 10