Qwen/Qwen2.5-1.5B-Instruct-AWQ
Text Generation
•
Updated
•
3.17k
•
4
AWQ quants
AWQ quants of various leading models for benchmarks and testing
-
-
Qwen/Qwen2.5-3B-Instruct-AWQ
Text Generation • Updated • 15.1k • 8 -
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation • Updated • 29.3k • 18 -
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation • Updated • 19.7k • 15 -
Qwen/Qwen2-VL-2B-Instruct-AWQ
Image-Text-to-Text • Updated • 4.61k • 20 -
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text • Updated • 73.7k • 47 -
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ
Text Generation • Updated • 20.7k • 7 -
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation • Updated • 319k • 62 -
TheBloke/Mixtral_11Bx2_MoE_19B-AWQ
Text Generation • Updated • 13 • 5 -
TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ
Text Generation • Updated • 277 • 6 -
internlm/internlm2_5-7b-chat-4bit
Text Generation • Updated • 152 • 5 -
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation • Updated • 1.04k • 6 -
casperhansen/deepseek-r1-distill-qwen-7b-awq
Updated • 6.63k • 4 -
casperhansen/deepseek-r1-distill-llama-8b-awq
Updated • 3.93k • 1 -
casperhansen/deepseek-r1-distill-qwen-14b-awq
Updated • 9.16k • 11