Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MeliodasT3qm7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
566fefc
MeliodasT3qm7-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
0dbb09214f822867c7e7db845d8a12f1de38540b4e35b473cd6b7166c526e780
566fefc
verified
7 months ago
.gitattributes
1.97 kB
0dbb09214f822867c7e7db845d8a12f1de38540b4e35b473cd6b7166c526e780
7 months ago
MeliodasT3qm7-7B.IQ3_XS.gguf
3.02 GB
LFS
24d60c278e0948bdda88d72f0caed74e8f0c102de2d9151dd6fc4a6dd8f80113
7 months ago
MeliodasT3qm7-7B.IQ4_XS.gguf
3.94 GB
LFS
666e68ed1ab89de20f6279dfa35b2bca64d6793b2e8bdbc7e4fb4e1330c4a4a9
7 months ago
MeliodasT3qm7-7B.Q2_K.gguf
2.72 GB
LFS
c7d852fbe76622e99e6e0533170001516f0117a79e0efb6bef4d9e71be67e2bd
7 months ago
MeliodasT3qm7-7B.Q3_K_L.gguf
3.82 GB
LFS
21acc2cffa7aba42b116bb77d1ec263f32b928aba0906258a6259cbc9ab10a22
7 months ago
MeliodasT3qm7-7B.Q3_K_M.gguf
3.52 GB
LFS
27eb148354b110b3ede90c5d5b8ba0a7e6546bc0c085328ac1beb7214a7003c2
7 months ago
MeliodasT3qm7-7B.Q3_K_S.gguf
3.16 GB
LFS
73eb855450b519e4a09f51ec1c54a69202120c8e9c367ea17aef72dc414bb3a2
7 months ago
MeliodasT3qm7-7B.Q4_K_M.gguf
4.37 GB
LFS
0dbb09214f822867c7e7db845d8a12f1de38540b4e35b473cd6b7166c526e780
7 months ago
