legraphista/Qwen2-0.5B-Instruct-IMat-GGUF at 138ea8eb654a8c62d961e87bf339a107c38c533c

Qwen2-0.5B-Instruct-IMat-GGUF

1 contributor

History: 23 commits

legraphista's picture

Upload Qwen2-0.5B-Instruct.Q3_K_L.gguf with huggingface_hub

138ea8e verified 3 months ago

.gitattributes

2.25 kB

Upload Qwen2-0.5B-Instruct.Q3_K_L.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.BF16.gguf

994 MB
LFS

Upload Qwen2-0.5B-Instruct.BF16.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.FP16.gguf

994 MB
LFS

Upload Qwen2-0.5B-Instruct.FP16.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q2_K.gguf

339 MB
LFS

Upload Qwen2-0.5B-Instruct.Q2_K.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q3_K.gguf

355 MB
LFS

Upload Qwen2-0.5B-Instruct.Q3_K.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q3_K_L.gguf

369 MB
LFS

Upload Qwen2-0.5B-Instruct.Q3_K_L.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q4_K.gguf

398 MB
LFS

Upload Qwen2-0.5B-Instruct.Q4_K.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q4_K_S.gguf

385 MB
LFS

Upload Qwen2-0.5B-Instruct.Q4_K_S.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q5_K.gguf

420 MB
LFS

Upload Qwen2-0.5B-Instruct.Q5_K.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q5_K_S.gguf

413 MB
LFS

Upload Qwen2-0.5B-Instruct.Q5_K_S.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q6_K.gguf

506 MB
LFS

Upload Qwen2-0.5B-Instruct.Q6_K.gguf with huggingface_hub 3 months ago
Qwen2-0.5B-Instruct.Q8_0.gguf

531 MB
LFS

Upload Qwen2-0.5B-Instruct.Q8_0.gguf with huggingface_hub 3 months ago
README.md

8.02 kB

Upload README.md with huggingface_hub 3 months ago
imatrix.dat

989 kB

Upload imatrix.dat with huggingface_hub 3 months ago
imatrix.dataset

280 kB

Upload imatrix.dataset with huggingface_hub 3 months ago
imatrix.log

10.1 kB

Upload imatrix.log with huggingface_hub 3 months ago