Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-cmdmayc-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
mergekit-ties-cmdmayc-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
39076f0f7791518b2b7bf51cbadbf401bdbe202ec38decf470cdd93eca1c7e7c
1d5bed4
verified
about 1 month ago
.gitattributes
2.21 kB
b1891667f6d8f8d483786b9a22a92a3057bb04a538055a3b732c48186ae30fac
about 1 month ago
README.md
3.36 kB
39076f0f7791518b2b7bf51cbadbf401bdbe202ec38decf470cdd93eca1c7e7c
about 1 month ago
mergekit-ties-cmdmayc.Q2_K.gguf
2.72 GB
LFS
721b04fa799d16f172a82413320b9b31e738501df0ddb897fb57c5edf2bb7fd3
about 1 month ago
mergekit-ties-cmdmayc.Q3_K_L.gguf
3.82 GB
LFS
f3435f286adee40d22ae166f1ee508753bf28d0aa63714017edc0828d665c7a3
about 1 month ago
mergekit-ties-cmdmayc.Q3_K_M.gguf
3.52 GB
LFS
e7fd06ccec8e11c3d6bd92258edf08b8135dda585cefa80e1df1771c92c46b09
about 1 month ago
mergekit-ties-cmdmayc.Q3_K_S.gguf
3.16 GB
LFS
f51bef0e749143f9e5e62ed9443cb22daef9f1f73d8c7f03d40a020033b80ccf
about 1 month ago
mergekit-ties-cmdmayc.Q4_K_M.gguf
4.37 GB
LFS
9f985cf8ce9b1b06c8de9f03350bd3c4ba82c7acc0035124ad93f6cb28106613
about 1 month ago
mergekit-ties-cmdmayc.Q4_K_S.gguf
4.14 GB
LFS
91b81738c4234abfcaacfa0b9e317e6b4c2d2c752944bc93bdb6825fa419c923
about 1 month ago
mergekit-ties-cmdmayc.Q5_K_M.gguf
5.13 GB
LFS
c615e3a744b3e56f69907b5568905e5c697423b5f340c54f0a35c57856fb1436
about 1 month ago
mergekit-ties-cmdmayc.Q5_K_S.gguf
5 GB
LFS
31fbb4803111c2fa880d7d7ffe62396b943f0968698e795e7f7b9a7b82111893
about 1 month ago
mergekit-ties-cmdmayc.Q6_K.gguf
5.94 GB
LFS
58b5dce821eae191ed3a8f48a9d3ee5773669a22ed503a7ba8d158da16c8e4cc
about 1 month ago
mergekit-ties-cmdmayc.Q8_0.gguf
7.7 GB
LFS
b1891667f6d8f8d483786b9a22a92a3057bb04a538055a3b732c48186ae30fac
about 1 month ago