Qwen1.5 GGUF - a lmstudio-ai Collection

lmstudio-ai 's Collections

MetaAI's CodeLlama - Coding Assistant LLM

Vision Models (GGUF)

Qwen1.5 GGUF

updated Feb 5

GGUF quants for the new Qwen1.5 model (https://qwenlm.github.io/blog/qwen1.5/)

Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • Updated Apr 9 • 23.9k • 19

Note With 0.5B parameters, this model runs extremely fast 🏎️💨
Qwen/Qwen1.5-1.8B-Chat-GGUF

Text Generation • Updated Apr 9 • 17.9k • 14

Note A good choice for machines with modest resources
Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • Updated Apr 9 • 7.84k • 8

Note A good choice for machines with modest resources
Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 9 • 29.7k • 59

Note Same as the version featured on LM Studio's home page
Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • Updated Apr 9 • 5.14k • 59

Note 72B variant. Suitable for machines with ample resources