Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment24-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2f018d3
Experiment26Experiment24-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
d3ae8e5bae088da5da9babc376c0424da19e570cff900d493227df8af5d09f97
2f018d3
verified
8 months ago
.gitattributes
Safe
2.35 kB
d3ae8e5bae088da5da9babc376c0424da19e570cff900d493227df8af5d09f97
8 months ago
Experiment26Experiment24-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
f9c8f062bc36a91cb73644216cde2a27f903c327129512355dff722b249b06b3
8 months ago
Experiment26Experiment24-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
bfff25c91ede5233f92c54bc82e5ab1f3163cb923e096e7ba62dbf286c3abb61
8 months ago
Experiment26Experiment24-7B.Q2_K.gguf
Safe
2.72 GB
LFS
2e44d1e4b4f4b2471b2ca45428efc1f1c8d1c53d1dcd809623bbcdbd12748c1b
8 months ago
Experiment26Experiment24-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
b0b5e8d571534e3acd6fa5243f5e96c02dcc2b4e9bc69b4c85af70e918ebe0c3
8 months ago
Experiment26Experiment24-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
036fd0aab0ece6772099714f0513577e4c3cf9a5a21ee2046b04991c80711cfb
8 months ago
Experiment26Experiment24-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
59a418352521fc9aab58ff89a91ca4c3cdac89a3eb321ef0fcbf89b350556afc
8 months ago
Experiment26Experiment24-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
670a03f54e2b9c86cb5f2be67688569ec5c65ad92bed1a3babaa905f3ed2ec07
8 months ago
Experiment26Experiment24-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
08cc3cd69b99252566874518503cb49cb1f31ed6897a4c4f675948e5eb058cb4
8 months ago
Experiment26Experiment24-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
4dfadd8aa40f935df0cbc1779f6430c444018e95657bd94ae865acdb4d21a4aa
8 months ago
Experiment26Experiment24-7B.Q5_K_S.gguf
Safe
5 GB
LFS
5bc64e27e40948fc36fb26a1c2bf3061464736f77e60fbcb7be6880430cddd0a
8 months ago
Experiment26Experiment24-7B.Q6_K.gguf
Safe
5.94 GB
LFS
d3ae8e5bae088da5da9babc376c0424da19e570cff900d493227df8af5d09f97
8 months ago
