neopolita
/

yi-1.5-9b-chat-gguf

Inference Endpoints

Model card Files Files and versions Community

yi-1.5-9b-chat-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload yi-1.5-9b-chat_q8_0.gguf with huggingface_hub

85db6e4 verified 7 months ago

.gitattributes

1.95 kB

Upload yi-1.5-9b-chat_q8_0.gguf with huggingface_hub 7 months ago
README.md

1.4 kB

Upload README.md with huggingface_hub 7 months ago
ggml-model-f16.gguf

17.7 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q2_k.gguf

3.35 GB
LFS

Upload yi-1.5-9b-chat_q2_k.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q3_k_m.gguf

4.32 GB
LFS

Upload yi-1.5-9b-chat_q3_k_m.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q4_k_m.gguf

5.33 GB
LFS

Upload yi-1.5-9b-chat_q4_k_m.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q5_k_m.gguf

6.26 GB
LFS

Upload yi-1.5-9b-chat_q5_k_m.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q6_k.gguf

7.25 GB
LFS

Upload yi-1.5-9b-chat_q6_k.gguf with huggingface_hub 7 months ago
yi-1.5-9b-chat_q8_0.gguf

9.38 GB
LFS

Upload yi-1.5-9b-chat_q8_0.gguf with huggingface_hub 7 months ago