Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Yi-1.5-9B-Chat-GGUF
like
5
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
conversational
arxiv:2403.04652
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
290ba67
Yi-1.5-9B-Chat-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
84d791dbd0ccf96729f6e855f92a71fdac87d6734c1a2ccf50e3bff5787efae9
290ba67
verified
6 months ago
.gitattributes
1.96 kB
84d791dbd0ccf96729f6e855f92a71fdac87d6734c1a2ccf50e3bff5787efae9
6 months ago
Yi-1.5-9B-Chat.Q2_K.gguf
3.35 GB
LFS
d6e53580be73e90d10d44dab369dad7c5b9c8ff348f5d14336a9501945cb9d1e
6 months ago
Yi-1.5-9B-Chat.Q3_K_L.gguf
4.69 GB
LFS
9f45a0598c0068640a5d3913a4963b0166a1e9f6038ca8212c2b2c3e06eb6e54
6 months ago
Yi-1.5-9B-Chat.Q3_K_M.gguf
4.32 GB
LFS
ffa651ba29fee1844dcc28b3e8c658c1584075e90177c16f67e4de31f87463ec
6 months ago
Yi-1.5-9B-Chat.Q3_K_S.gguf
3.9 GB
LFS
a34fd32e3a2fa08cbce4161e90b507b6221b25add6b218c6d04d3e1280e71a1f
6 months ago
Yi-1.5-9B-Chat.Q4_K_M.gguf
5.33 GB
LFS
98cfdb952d2495583439c8be8ad9ffc0e6c720ab6c382b45b037a7c832bd98f9
6 months ago
Yi-1.5-9B-Chat.Q4_K_S.gguf
5.07 GB
LFS
1e7391d52af55a182335d750f9b85b1bc4b5318840d8fb91ecafa6cdc91c0669
6 months ago
Yi-1.5-9B-Chat.Q5_K_M.gguf
6.26 GB
LFS
84d791dbd0ccf96729f6e855f92a71fdac87d6734c1a2ccf50e3bff5787efae9
6 months ago
