Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment27pasticheT3q-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
0199cde
Experiment27pasticheT3q-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
f4e1839e75faa94a80edfbcc9598d6f9cbf42700dd652883f92cc58c1bb094ba
0199cde
verified
about 1 month ago
.gitattributes
2.34 kB
f4e1839e75faa94a80edfbcc9598d6f9cbf42700dd652883f92cc58c1bb094ba
about 1 month ago
Experiment27pasticheT3q-7B.Q2_K.gguf
2.72 GB
LFS
86e7720f6397e324382f16a90cc16ac6d84383c7f0b45f9440886d7062bbbaf8
about 1 month ago
Experiment27pasticheT3q-7B.Q3_K_L.gguf
3.82 GB
LFS
62a0b020c2f3d913e1aa43cd250576ede786cdea9ed4984082394f2b8d9007a8
about 1 month ago
Experiment27pasticheT3q-7B.Q3_K_M.gguf
3.52 GB
LFS
323995d4c8db8caed4d68d51875ef3eab224428d4c2f6729fce29c9c0cc43a5f
about 1 month ago
Experiment27pasticheT3q-7B.Q3_K_S.gguf
3.16 GB
LFS
1e36917913684744f937b9f2fc63fe0b55e6f01f0f2f52734b7f5ede62348b1b
about 1 month ago
Experiment27pasticheT3q-7B.Q4_K_M.gguf
4.37 GB
LFS
b36e0f855f3bada1f0c6ad287c48a5dc94a746336737fb17ac352cadb7742096
about 1 month ago
Experiment27pasticheT3q-7B.Q4_K_S.gguf
4.14 GB
LFS
2f97fe1048182d2ad0a6fd8a65d9f189b7ef68932d37b7374d361daffc2af7c4
about 1 month ago
Experiment27pasticheT3q-7B.Q5_K_M.gguf
5.13 GB
LFS
399fdccf1082c3fabb972626563c6e32564b525bacad7982dff67eacc47c8db7
about 1 month ago
Experiment27pasticheT3q-7B.Q5_K_S.gguf
5 GB
LFS
c549788b15bcd39a4de75e2a02838d514ee7de05e75c7a2921567386add1e9d5
about 1 month ago
Experiment27pasticheT3q-7B.Q6_K.gguf
5.94 GB
LFS
e518a90eea5c8c9293a25ee06bf855e56bb9a88810160b9c4d645aaa100c1532
about 1 month ago
Experiment27pasticheT3q-7B.Q8_0.gguf
7.7 GB
LFS
1a57866267d5b10353b2b39c7b19b5ad627a217251e43525134fb185ffba10ba
about 1 month ago
Experiment27pasticheT3q-7B.fp16.gguf
14.5 GB
LFS
f4e1839e75faa94a80edfbcc9598d6f9cbf42700dd652883f92cc58c1bb094ba
about 1 month ago
