Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-0.5B-Instruct-GGUF
like
62
Follow
Qwen
14.4k
Text Generation
GGUF
English
instruct
chat
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Deploy
Use this model
refs/pr/1
Qwen2-0.5B-Instruct-GGUF
6 contributors
History:
9 commits
algorithm
-cml / --chatml has been discontinued in llama.cpp
ec01b1f
verified
8 months ago
.gitattributes
Safe
1.56 kB
Initial commit
8 months ago
LICENSE
Safe
11.3 kB
Create LICENSE
8 months ago
README.md
2.65 kB
-cml / --chatml has been discontinued in llama.cpp
8 months ago
qwen2-0_5b-instruct-fp16.gguf
Safe
1.27 GB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q4_0.gguf
Safe
429 MB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q4_k_m.gguf
Safe
491 MB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q5_0.gguf
Safe
490 MB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q5_k_m.gguf
Safe
522 MB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q6_k.gguf
Safe
650 MB
LFS
Initial commit
8 months ago
qwen2-0_5b-instruct-q8_0.gguf
Safe
676 MB
LFS
Initial commit
8 months ago
