Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,829

Full-text search

Active filters: pruna-ai

PrunaAI/aari1995-germeo-7b-laser-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 12

PrunaAI/chujiezheng-Llama-3-Instruct-8B-SimPO-ExPO-GGUF-smashed

Updated Jul 16 • 39

PrunaAI/NexaAIDev-Octopus-v2-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/NexaAIDev-Octopus-v2-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 15

PrunaAI/NexaAIDev-Octopus-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/NexaAIDev-Octopus-v2-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/NexaAIDev-Octopus-v2-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/NexaAIDev-Octopus-v2-QUANTO-int2bit-smashed

Updated Jul 19 • 10

PrunaAI/NexaAIDev-Octopus-v2-QUANTO-int4bit-smashed

Updated Jul 19 • 10

PrunaAI/stockmark-stockmark-13b-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-QUANTO-int2bit-smashed

Updated Jul 19 • 10

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 10

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 15

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 15

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-HQQ-2bit-smashed

Text Generation • Updated Jul 16 • 15

PrunaAI/stockmark-stockmark-13b-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 17

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-AWQ-4bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/TheDrummer-Moistral-11B-v3-QUANTO-float8bit-smashed

Updated Jul 19 • 11

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-bnb-8bit-smashed

Text Generation • Updated Jul 16 • 13

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 16 • 16

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 17

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-HQQ-4bit-smashed

Text Generation • Updated Jul 16 • 14

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-bnb-8bit-smashed

Text Generation • Updated Jul 17 • 11

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-bnb-4bit-smashed

Text Generation • Updated Jul 17 • 11

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-1bit-smashed

Text Generation • Updated Jul 17 • 14

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-2bit-smashed

Text Generation • Updated Jul 17 • 13

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int2bit-smashed

Updated Jul 19 • 12

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-4bit-smashed

Text Generation • Updated Jul 17 • 15

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 17 • 14