Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MCZK
/
Qwen2-0.5B-Instruct-GGUF
like
0
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Qwen2-0.5B-Instruct-GGUF
1 contributor
History:
18 commits
MCZK
Upload Qwen2-0.5B-Instruct.f16.gguf with huggingface_hub
d599d0a
verified
6 months ago
.gitattributes
Safe
2.44 kB
Upload Qwen2-0.5B-Instruct.f16.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q3_K_M.iMatrix.gguf
Safe
355 MB
LFS
Upload Qwen2-0.5B-Instruct.Q3_K_M.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q4_K_M.iMatrix.gguf
Safe
398 MB
LFS
Upload Qwen2-0.5B-Instruct.Q4_K_M.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q4_K_S.iMatrix.gguf
Safe
385 MB
LFS
Upload Qwen2-0.5B-Instruct.Q4_K_S.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q5_K_M.iMatrix.gguf
Safe
420 MB
LFS
Upload Qwen2-0.5B-Instruct.Q5_K_M.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q5_K_S.iMatrix.gguf
Safe
413 MB
LFS
Upload Qwen2-0.5B-Instruct.Q5_K_S.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q6_K.iMatrix.gguf
Safe
506 MB
LFS
Upload Qwen2-0.5B-Instruct.Q6_K.iMatrix.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.Q8_0.gguf
Safe
531 MB
LFS
Upload Qwen2-0.5B-Instruct.Q8_0.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.f16.gguf
Safe
994 MB
LFS
Upload Qwen2-0.5B-Instruct.f16.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.iQ3_M.gguf
Safe
343 MB
LFS
Upload Qwen2-0.5B-Instruct.iQ3_M.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.iQ3_S.gguf
Safe
339 MB
LFS
Upload Qwen2-0.5B-Instruct.iQ3_S.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.iQ3_XS.gguf
Safe
339 MB
LFS
Upload Qwen2-0.5B-Instruct.iQ3_XS.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.iQ3_XXS.gguf
Safe
334 MB
LFS
Upload Qwen2-0.5B-Instruct.iQ3_XXS.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.iQ4_XS.gguf
Safe
349 MB
LFS
Upload Qwen2-0.5B-Instruct.iQ4_XS.gguf with huggingface_hub
6 months ago
Qwen2-0.5B-Instruct.imatrix
Safe
989 kB
Upload Qwen2-0.5B-Instruct.imatrix with huggingface_hub
6 months ago
README.md
Safe
435 Bytes
Create README.md
6 months ago