Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2480ea9
Experiment26Experiment28-7B-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
29988ea84dbc0e7d4d790e8f16abeeed0335ef12c3bf16befe1aacc21081508f
2480ea9
verified
7 months ago
.gitattributes
2.2 kB
29988ea84dbc0e7d4d790e8f16abeeed0335ef12c3bf16befe1aacc21081508f
7 months ago
Experiment26Experiment28-7B.IQ3_XS.gguf
3.02 GB
LFS
43db0b360b6a0b7e39b483389722599430c767938f44b06f8a734ae4cf7d0674
7 months ago
Experiment26Experiment28-7B.IQ4_XS.gguf
3.94 GB
LFS
fbfe3b8591acb57538009c92c9bc6341650d2f8865b7331c32d2ddd9c2ebc7a9
7 months ago
Experiment26Experiment28-7B.Q2_K.gguf
2.72 GB
LFS
cdcdb5dc68b9980bfdb36e4f94f55cd22bf7b60f065fdd9ac591326a582e70a3
7 months ago
Experiment26Experiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
b2bb3905159f150ce2a9ec534b417b78ff6471ad1f6fd82e38ffd3f5ff4f4c6a
7 months ago
Experiment26Experiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
558eb690a6c0dfc3e5d847b52387775e0d8e9dc6d747d0129de0b0725fbd5d67
7 months ago
Experiment26Experiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
b7584f9aab7c0892fa4b8b4affd93f04b993079bdf12f04893f3d3c098d6ddde
7 months ago
Experiment26Experiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
942bb226195e156d501dae642cd3701a7c6075a674e4f67812bd01ef49fb9a32
7 months ago
Experiment26Experiment28-7B.Q4_K_S.gguf
4.14 GB
LFS
8dd99583dc8241fae1d7f2a701c54d37cd6387779e74067b4780fb0e9702b791
7 months ago
Experiment26Experiment28-7B.Q5_K_M.gguf
5.13 GB
LFS
29988ea84dbc0e7d4d790e8f16abeeed0335ef12c3bf16befe1aacc21081508f
7 months ago
