Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,272

Full-text search

Active filters: 4-bit

PrunaAI/beomi-gemma-mling-7b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

tsunayoshi21/TinyLlamaBase-Alpaca-tunned-QA-pubmed-tunned

Updated 15 days ago • 6

PrunaAI/arise-sustech-llm4decompile-6.7b-uo-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/nicholasKluge-TeenyTinyLlama-160m-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/lightblue-suzume-llama-3-8B-multilingual-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/cognitivecomputations-Dolphin-2.9.1-Phi-3-Kensho-4.5B-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 8

PrunaAI/maywell-Mistral-ko-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/vilm-vinallama-7b-chat-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/cognitivecomputations-dolphin-2.2.1-mistral-7b-AWQ-4bit-smashed

Text Generation • Updated about 9 hours ago • 8

PrunaAI/allenai-tulu-2-7b-AWQ-4bit-smashed

Text Generation • Updated 3 days ago • 2

PrunaAI/beomi-Yi-Ko-6B-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 4

PrunaAI/sambanovasystems-SambaLingo-Arabic-Base-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/galatolo-cerbero-7b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/cognitivecomputations-dolphin-2.1-mistral-7b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 9

ngohuudang/deepseek-math-7b-rl-zaloai-vllm

Text Generation • Updated 15 days ago • 12

sudhanshu746/Deepseek-math-7B-mk-4bit

Text Generation • Updated 15 days ago • 1

tsunayoshi21/TinyLlamaBase-Alpaca-tunned-context-pubmed-tunned

Updated 15 days ago • 4

hitmanonholiday/llava-1.5-7b-4bit-finetuned3

Updated 15 days ago • 48

cgus/Replete-Coder-Qwen2-1.5b-exl2

Text Generation • Updated 15 days ago • 1

PrunaAI/nicholasKluge-TeenyTinyLlama-460m-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/HiTZ-latxa-7b-v1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/NurtureAI-Meta-Llama-3-8B-Instruct-64k-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 6

PrunaAI/beowolx-MistralHermes-CodePro-7B-v1-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/HPAI-BSC-Llama3-Aloe-8B-Alpha-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/PipableAI-pip-code-bandit-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/kaist-ai-janus-7b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/MediaTek-Research-Breeze-7B-Instruct-v1_0-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/capleaf-T-Llama-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/Rakuten-RakutenAI-7B-instruct-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1

PrunaAI/NousResearch-Nous-Hermes-Llama2-13b-AWQ-4bit-smashed

Text Generation • Updated 15 days ago • 1