Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2.5-0.5B-Instruct-GGUF
like
45
Follow
Qwen
35.8k
Text Generation
GGUF
English
chat
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
Qwen2.5-0.5B-Instruct-GGUF
Ctrl+K
Ctrl+K
2 contributors
History:
6 commits
feihu.hf
merge main
9217f5d
9 months ago
.gitattributes
1.56 kB
upload weights
9 months ago
LICENSE
11.3 kB
update README & LICENSE
9 months ago
README.md
4.86 kB
Update README.md
9 months ago
qwen2.5-0.5b-instruct-fp16.gguf
1.27 GB
xet
upload fp16 weights
9 months ago
qwen2.5-0.5b-instruct-q2_k.gguf
415 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q3_k_m.gguf
432 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q4_0.gguf
429 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q4_k_m.gguf
491 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q5_0.gguf
490 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q5_k_m.gguf
522 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q6_k.gguf
650 MB
xet
upload weights
9 months ago
qwen2.5-0.5b-instruct-q8_0.gguf
676 MB
xet
upload weights
9 months ago