Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment24Experiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
30f65ae
Experiment24Experiment26-7B-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
edb0219b7c603bb7639f51af38e641c361bff47bc71615829d5c3bb1cba62a6f
30f65ae
verified
7 months ago
.gitattributes
2.13 kB
edb0219b7c603bb7639f51af38e641c361bff47bc71615829d5c3bb1cba62a6f
7 months ago
Experiment24Experiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
c362c864bea62d5ac02bef7252a1a55d934e96c614bcea2f7c18fb29bd6b563e
7 months ago
Experiment24Experiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
e36b2ea84a8a11567e6f6cb5ed374fb72ea8c88a23f7a34b65c95e79a6e8a1e5
7 months ago
Experiment24Experiment26-7B.Q2_K.gguf
2.72 GB
LFS
621e361147437a73b42ec36d806941e5dbf0d93882f22f6c00915a898e769a19
7 months ago
Experiment24Experiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
ab955be0a9ed98246f631390aca8b4e7ab9cc147becd60612af3b7dadeb6e105
7 months ago
Experiment24Experiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
97fbead1240546085fd70fff222f5d72cc381f8fb6b2f74ed3a95c306bf7d55e
7 months ago
Experiment24Experiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
651326ea8f6991b6e9a505be16b5d2effa3f218f1582245833c72aa0d86f8dbd
7 months ago
Experiment24Experiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
428e0e45fb90f43929f3e03dbc3273e2c69a59caff7f78b138576be410d43f66
7 months ago
Experiment24Experiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
edb0219b7c603bb7639f51af38e641c361bff47bc71615829d5c3bb1cba62a6f
7 months ago