Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment26Experiment28-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
c909b7230c57c86b40f14ff7bf6c0eaf5118dadee46e6b3d0809668227374525
09cef3a
verified
3 months ago
.gitattributes
2.35 kB
6bc9e8120bc464a9f179b935efde0eb2a7a8c785249d17510a5c8b6a9ab5972f
3 months ago
Experiment26Experiment28-7B.IQ3_XS.gguf
3.02 GB
LFS
43db0b360b6a0b7e39b483389722599430c767938f44b06f8a734ae4cf7d0674
3 months ago
Experiment26Experiment28-7B.IQ4_XS.gguf
3.94 GB
LFS
fbfe3b8591acb57538009c92c9bc6341650d2f8865b7331c32d2ddd9c2ebc7a9
3 months ago
Experiment26Experiment28-7B.Q2_K.gguf
2.72 GB
LFS
cdcdb5dc68b9980bfdb36e4f94f55cd22bf7b60f065fdd9ac591326a582e70a3
3 months ago
Experiment26Experiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
b2bb3905159f150ce2a9ec534b417b78ff6471ad1f6fd82e38ffd3f5ff4f4c6a
3 months ago
Experiment26Experiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
558eb690a6c0dfc3e5d847b52387775e0d8e9dc6d747d0129de0b0725fbd5d67
3 months ago
Experiment26Experiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
b7584f9aab7c0892fa4b8b4affd93f04b993079bdf12f04893f3d3c098d6ddde
3 months ago
Experiment26Experiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
942bb226195e156d501dae642cd3701a7c6075a674e4f67812bd01ef49fb9a32
3 months ago
Experiment26Experiment28-7B.Q4_K_S.gguf
4.14 GB
LFS
8dd99583dc8241fae1d7f2a701c54d37cd6387779e74067b4780fb0e9702b791
3 months ago
Experiment26Experiment28-7B.Q5_K_M.gguf
5.13 GB
LFS
29988ea84dbc0e7d4d790e8f16abeeed0335ef12c3bf16befe1aacc21081508f
3 months ago
Experiment26Experiment28-7B.Q5_K_S.gguf
5 GB
LFS
29a0177fa3d7a470498ba52bed09e58d1ccd32a8155ef30911f4b1c39a10bc57
3 months ago
Experiment26Experiment28-7B.Q6_K.gguf
5.94 GB
LFS
6bc9e8120bc464a9f179b935efde0eb2a7a8c785249d17510a5c8b6a9ab5972f
3 months ago
README.md
11.2 kB
c909b7230c57c86b40f14ff7bf6c0eaf5118dadee46e6b3d0809668227374525
3 months ago
