Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,173

Full-text search

Active filters: 4-bit

PrunaAI/gradientai-Llama-3-8B-Instruct-262k-AWQ-4bit-smashed

Text Generation • Updated 29 days ago • 364 • 4

stylellm/ShuiHuZhuan-6b-AWQ

Text Generation • Updated 27 days ago • 35 • 1

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated about 1 month ago • 74.2k • 7

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 656 • 6

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • Updated 28 days ago • 6.1k • 10

MaziyarPanahi/Llama-3-8B-Instruct-v0.7-GGUF

Text Generation • Updated 14 days ago • 1.51k • 2

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated 25 days ago • 36.5k • 3

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated 7 days ago • 4.32k • 6

monsterapi/Mixtral-8x7B-v0.1_4bit_bnb

Text Generation • Updated 21 days ago • 120 • 1

monsterapi/Mixtral-8x7B-Instruct-v0.1_4bit_bnb

Text Generation • Updated 21 days ago • 52 • 1

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 18 days ago • 16.3k • 9

tctsung/TinyLlama-1.1B-chat-v1.0-awq

Text Generation • Updated 11 days ago • 22 • 1

starsy/Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation • Updated 14 days ago • 555 • 1

bluuwhale/NoromaidxOpenGPT4-2-4.0bpw-h6-exl2

Text Generation • Updated 14 days ago • 3 • 1

Zoyd/suzume-llama-3-8B-multilingual-4_0bpw-exl2

Text Generation • Updated 13 days ago • 24 • 1

cstr/llama3-8b-spaetzle-v20-int4-inc

Text Generation • Updated 12 days ago • 27 • 2

dwb2023/phi-3-vision-128k-instruct-quantized

Text Generation • Updated 9 days ago • 83 • 3

SorawitChok/SeaLLM-7B-v2.5-AWQ

Text Generation • Updated 7 days ago • 54 • 1

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated 7 days ago • 49 • 1

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated 7 days ago • 4.01k • 2

MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1-GGUF

Text Generation • Updated 7 days ago • 2.45k • 1

Zoyd/CohereForAI_aya-23-35B-4_0bpw_exl2

Text Generation • Updated 7 days ago • 2 • 1

AAProject/deepseek-math-7b-rl-8bits-Q

Text Generation • Updated 6 days ago • 133 • 1

AAProject/CodeLlama-7b-Instruct-hf-8bits-Q

Text Generation • Updated 6 days ago • 33 • 1

AAProject/Llama-2-7b-chat-hf-4bits-Q

Text Generation • Updated 6 days ago • 23 • 1

AAProject/Llama-2-7b-chat-hf-4bits-bnb

Text Generation • Updated 6 days ago • 27 • 1

anwesh/llama-3-8b-Instruct-bnb-4bit-yahma-alpaca-cleaned-4bit

Text Generation • Updated 6 days ago • 54 • 1

rhysjones/Phi-3-mini-mango-1-GGUF

Text Generation • Updated 4 days ago • 3.44k • 1

Klevin/DECYPHERS-2b-v2

Text Generation • Updated 4 days ago • 66 • 1

alijawad07/aya-23-8B-AWQ-GEMM

Text Generation • Updated 3 days ago • 28 • 1