Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
yi-super-9B-GGUF
like
4
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
dataset:teknium/OpenHermes-2.5
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
refs/pr/1
yi-super-9B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
e675118c6b23733b09975e41682247ad020aeff24115f3807e06266855a79a11
2e5afdb
verified
3 months ago
.gitattributes
2.17 kB
a3f60c9d41155facab182df62c105b02db1b4155d010d6b06cec8967418eeb7e
3 months ago
README.md
10.7 kB
e675118c6b23733b09975e41682247ad020aeff24115f3807e06266855a79a11
3 months ago
yi-super-9B.IQ4_XS.gguf
4.83 GB
LFS
48e04a57db1e8ece76e5587062c7ecc68835e71ee5798bd297fcdf9a1babeeaf
3 months ago
yi-super-9B.Q2_K.gguf
3.35 GB
LFS
5071e2dd35dd92d3d214b234d62070580137374e07d3a55f1021f94d78546855
3 months ago
yi-super-9B.Q3_K_L.gguf
4.69 GB
LFS
337ba3fa66a7223b2aa6d1a40f937cf522c2af760679657e3873e47a0e6c7649
3 months ago
yi-super-9B.Q3_K_M.gguf
4.32 GB
LFS
87fd5e3f1d787a00586414e77ae99df90ceb06d5a12e834d735ff8022e51c574
3 months ago
yi-super-9B.Q3_K_S.gguf
3.9 GB
LFS
b01dbd37e69b7ffa026e6d7fbf71014a0fd7208cbc1b1fc40b3e57f24a9ae704
3 months ago
yi-super-9B.Q4_K_M.gguf
5.33 GB
LFS
3eccafc77493cb4af36babad5b02546e0b99d594c00178c4c8e5c63e27446eec
3 months ago
yi-super-9B.Q4_K_S.gguf
5.07 GB
LFS
2b042fbaa61be047de4a8362805ac3c4a076741894b222da0eba8d57e0c5cd79
3 months ago
yi-super-9B.Q5_K_M.gguf
6.26 GB
LFS
164ba3032287a4b291e24bce68999f2a261b6ac8f492107978667e7d9d24645b
3 months ago
yi-super-9B.Q5_K_S.gguf
6.11 GB
LFS
e1911520a529e4d7405a68a96dbfdd920c334ddb46ca82e0b3d018b77a9520c8
3 months ago
yi-super-9B.Q6_K.gguf
7.25 GB
LFS
22fab1053e90cd113d23a7d8db831c8eae3b2b2b81e8a2659d3b0e40d4dedb94
3 months ago
yi-super-9B.Q8_0.gguf
9.38 GB
LFS
a3f60c9d41155facab182df62c105b02db1b4155d010d6b06cec8967418eeb7e
3 months ago
