Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment24Experiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment24Experiment26-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
0cc7f8cca8163c58b3a11c90b1f3fcd34754a9cc102f082d1391d761b4748719
5f20436
verified
7 months ago
.gitattributes
2.35 kB
8f868368ddb6c042cab44731f428e399ec01c62c996d2142d42cd3093696ebe4
7 months ago
Experiment24Experiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
c362c864bea62d5ac02bef7252a1a55d934e96c614bcea2f7c18fb29bd6b563e
7 months ago
Experiment24Experiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
e36b2ea84a8a11567e6f6cb5ed374fb72ea8c88a23f7a34b65c95e79a6e8a1e5
7 months ago
Experiment24Experiment26-7B.Q2_K.gguf
2.72 GB
LFS
621e361147437a73b42ec36d806941e5dbf0d93882f22f6c00915a898e769a19
7 months ago
Experiment24Experiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
ab955be0a9ed98246f631390aca8b4e7ab9cc147becd60612af3b7dadeb6e105
7 months ago
Experiment24Experiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
97fbead1240546085fd70fff222f5d72cc381f8fb6b2f74ed3a95c306bf7d55e
7 months ago
Experiment24Experiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
651326ea8f6991b6e9a505be16b5d2effa3f218f1582245833c72aa0d86f8dbd
7 months ago
Experiment24Experiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
428e0e45fb90f43929f3e03dbc3273e2c69a59caff7f78b138576be410d43f66
7 months ago
Experiment24Experiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
edb0219b7c603bb7639f51af38e641c361bff47bc71615829d5c3bb1cba62a6f
7 months ago
Experiment24Experiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
ffa6c83c9a66537055f17d08399e737f07364c580eb7cbce543fbfd1f95d4e1d
7 months ago
Experiment24Experiment26-7B.Q5_K_S.gguf
5 GB
LFS
b2946650a16c808b2780b1dcc684a68e4ac13a02bed7dcee4fc2c0e45b3774a9
7 months ago
Experiment24Experiment26-7B.Q6_K.gguf
5.94 GB
LFS
8f868368ddb6c042cab44731f428e399ec01c62c996d2142d42cd3093696ebe4
7 months ago
README.md
11.2 kB
0cc7f8cca8163c58b3a11c90b1f3fcd34754a9cc102f082d1391d761b4748719
7 months ago
