neopolita
/

qwen2-1.5b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

qwen2-1.5b-instruct-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload qwen2-1.5b-instruct_q8_0.gguf with huggingface_hub

3579c4d verified 6 months ago

.gitattributes

1.98 kB

Upload qwen2-1.5b-instruct_q8_0.gguf with huggingface_hub 6 months ago
README.md

1.42 kB

Upload README.md with huggingface_hub 6 months ago
ggml-model-f16.gguf

3.09 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q2_k.gguf

676 MB
LFS

Upload qwen2-1.5b-instruct_q2_k.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q3_k_m.gguf

824 MB
LFS

Upload qwen2-1.5b-instruct_q3_k_m.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q4_k_m.gguf

986 MB
LFS

Upload qwen2-1.5b-instruct_q4_k_m.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q5_k_m.gguf

1.13 GB
LFS

Upload qwen2-1.5b-instruct_q5_k_m.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q6_k.gguf

1.27 GB
LFS

Upload qwen2-1.5b-instruct_q6_k.gguf with huggingface_hub 6 months ago
qwen2-1.5b-instruct_q8_0.gguf

1.65 GB
LFS

Upload qwen2-1.5b-instruct_q8_0.gguf with huggingface_hub 6 months ago