neopolita
/

qwen2-0.5b-gguf

Inference Endpoints

Model card Files Files and versions Community

qwen2-0.5b-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload qwen2-0.5b_q8_0.gguf with huggingface_hub

ad4e914 verified 7 months ago

.gitattributes

1.92 kB

Upload qwen2-0.5b_q8_0.gguf with huggingface_hub 7 months ago
README.md

1.39 kB

Upload README.md with huggingface_hub 7 months ago
ggml-model-f16.gguf

994 MB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q2_k.gguf

339 MB
LFS

Upload qwen2-0.5b_q2_k.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q3_k_m.gguf

355 MB
LFS

Upload qwen2-0.5b_q3_k_m.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q4_k_m.gguf

398 MB
LFS

Upload qwen2-0.5b_q4_k_m.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q5_k_m.gguf

420 MB
LFS

Upload qwen2-0.5b_q5_k_m.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q6_k.gguf

506 MB
LFS

Upload qwen2-0.5b_q6_k.gguf with huggingface_hub 7 months ago
qwen2-0.5b_q8_0.gguf

531 MB
LFS

Upload qwen2-0.5b_q8_0.gguf with huggingface_hub 7 months ago