Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26M7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
50ea970
Experiment26M7-7B-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
161166230eb097e5e402f1c5a6823b59ef0de346f001e61dd0c88ce152e29216
50ea970
verified
7 months ago
.gitattributes
2.11 kB
161166230eb097e5e402f1c5a6823b59ef0de346f001e61dd0c88ce152e29216
7 months ago
Experiment26M7-7B.IQ3_XS.gguf
3.02 GB
LFS
edc56181801e024564809ef54f4ad1308abd955bf8339510db5bd57fc4a7b926
7 months ago
Experiment26M7-7B.IQ4_XS.gguf
3.94 GB
LFS
d92a92ff377423aa2f45aac16e4bcece5a97294d3b23121b3c18362ae2fa9008
7 months ago
Experiment26M7-7B.Q2_K.gguf
2.72 GB
LFS
ce309ebcedef84bee4d0ea197cfb1239c615d9f148b1812c1162389132646d28
7 months ago
Experiment26M7-7B.Q3_K_L.gguf
3.82 GB
LFS
c00553560738517ccc48e3a387c3977b9460f38267b4b6902a18ddd13146c89e
7 months ago
Experiment26M7-7B.Q3_K_M.gguf
3.52 GB
LFS
687ec26b987b2f6c899537074556f1ffc8f2e6650d2c2a0314ac1165ec9f9040
7 months ago
Experiment26M7-7B.Q3_K_S.gguf
3.16 GB
LFS
715ce14f540e1d4dacf0cbdd65e5248278b853965373129fe603f93c4056e20c
7 months ago
Experiment26M7-7B.Q4_K_M.gguf
4.37 GB
LFS
93307dd489b555d3faff4ead9b6a69a8f347dbc5356980d08d738d356484fa1e
7 months ago
Experiment26M7-7B.Q4_K_S.gguf
4.14 GB
LFS
d460e00d7077956d861df8ae5f4b091b5f06321deb981158704c67c490fcd760
7 months ago
Experiment26M7-7B.Q5_K_M.gguf
5.13 GB
LFS
161166230eb097e5e402f1c5a6823b59ef0de346f001e61dd0c88ce152e29216
7 months ago
