Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/shenzhi-wang-Llama3-8B-Chinese-Chat-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 7

PrunaAI/NousResearch-Meta-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/meta-llama-Meta-Llama-3-8B-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/meta-llama-Meta-Llama-3-8B-Instruct-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 6

PrunaAI/NousResearch-Meta-Llama-3-8B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 9

PrunaAI/meta-llama-Meta-Llama-3-8B-Instruct-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/meta-llama-Meta-Llama-3-8B-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/aaditya-Llama3-OpenBioLLM-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 45

PrunaAI/google-gemma-2b-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/google-gemma-2b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/google-gemma-7b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/google-gemma-7b-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/google-gemma-7b-it-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/NousResearch-Meta-Llama-3-8B-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/google-gemma-7b-it-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/NousResearch-Meta-Llama-3-8B-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/google-gemma-2b-it-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/google-gemma-2b-it-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/google-codegemma-2b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/google-codegemma-2b-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/google-codegemma-7b-it-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/google-codegemma-7b-it-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/google-codegemma-7b-HQQ-2bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/google-codegemma-7b-HQQ-1bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/McGill-NLP-Llama-3-8B-Web-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Orenguteng-Llama-3-8B-Lexi-Uncensored-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/openlynn-Llama-3-Soliloquy-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 4

PrunaAI/UnicomLLM-Unichat-llama3-Chinese-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/beomi-Llama-3-Open-Ko-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 1

PrunaAI/meta-llama-Meta-Llama-3-8B-Instruct-HQQ-4bit-smashed

Text Generation • Updated Aug 2 • 12