Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Ayla-Light-12B-Stock-GGUF
like
0
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
4c17391
Ayla-Light-12B-Stock-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
4996bc256d128cd9c0f9342b7f327bda5e312f9576313a82c5a250a4514d9fa6
4c17391
verified
7 days ago
.gitattributes
1.86 kB
4996bc256d128cd9c0f9342b7f327bda5e312f9576313a82c5a250a4514d9fa6
7 days ago
Ayla-Light-12B-Stock.Q5_K_M.gguf
8.73 GB
LFS
2751233b948baa0019b76164a9c05cde067b76ab29c629ff2da29ee5c33137cb
7 days ago
Ayla-Light-12B-Stock.Q5_K_S.gguf
8.52 GB
LFS
e4b14ee3e88a3d7d7a0fe5d27611c7e4c55dc4521a1c494acc032d136414379c
7 days ago
Ayla-Light-12B-Stock.Q6_K.gguf
10.1 GB
LFS
7abd41587f2f461d81e98979f2886e7229d85514072100a9b015713089ce491b
7 days ago
Ayla-Light-12B-Stock.Q8_0.gguf
13 GB
LFS
0f7a38c09513557cbb46761427394be94efe79a1020e83d6079a5c49d7a0c49b
7 days ago
Ayla-Light-12B-Stock.fp16.gguf
24.5 GB
LFS
4996bc256d128cd9c0f9342b7f327bda5e312f9576313a82c5a250a4514d9fa6
7 days ago
