Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-aspkrwz-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
3b3cc64
mergekit-ties-aspkrwz-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
a090fa6711c967a32074f85810c37432b11d07928cc4da21bdce2e0ae4008a5b
3b3cc64
verified
about 1 month ago
.gitattributes
2.21 kB
a090fa6711c967a32074f85810c37432b11d07928cc4da21bdce2e0ae4008a5b
about 1 month ago
mergekit-ties-aspkrwz.Q2_K.gguf
2.53 GB
LFS
342180bb62b56775f11142e3a61453a6ebcd3f2171258448ee2efb24b3fcd993
about 1 month ago
mergekit-ties-aspkrwz.Q3_K_L.gguf
3.6 GB
LFS
04f785b18cd172d98cd0132b4f2761bb3bb90e427b638517b7d7ecd35eabdbc8
about 1 month ago
mergekit-ties-aspkrwz.Q3_K_M.gguf
3.3 GB
LFS
8f769fb25c36a0531a1a7246b60c0e286b6d8eeac5aab7fb3c2761def9855235
about 1 month ago
mergekit-ties-aspkrwz.Q3_K_S.gguf
2.95 GB
LFS
2abb65f71c968fc3789e96dfd49a89b18f98f81c00176536d737d70935220a27
about 1 month ago
mergekit-ties-aspkrwz.Q4_K_M.gguf
4.08 GB
LFS
4e5dc75dacab00cd15d769be7522be594c67d55fc7c68db1819b2fca14c94750
about 1 month ago
mergekit-ties-aspkrwz.Q4_K_S.gguf
3.86 GB
LFS
c13b2c8b6f4a9cc6af46f58d1415ebf7a2bf0d962150526ff565a57a104055d2
about 1 month ago
mergekit-ties-aspkrwz.Q5_K_M.gguf
4.78 GB
LFS
2261789acab7e2105746204b39cfa9a7b42ca687100abf74ad48337a7cebdc0e
about 1 month ago
mergekit-ties-aspkrwz.Q5_K_S.gguf
4.65 GB
LFS
ff04910968a7cba935a4db52e9bc242a761f6c0c6f6f7697cc151687b98c0d2f
about 1 month ago
mergekit-ties-aspkrwz.Q6_K.gguf
5.53 GB
LFS
62809a5c6aadeba6d6082f98c62fd16ec6b1ae4154c49321acb560ffaabb94dd
about 1 month ago
mergekit-ties-aspkrwz.Q8_0.gguf
7.16 GB
LFS
a090fa6711c967a32074f85810c37432b11d07928cc4da21bdce2e0ae4008a5b
about 1 month ago
