Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment24Experiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
f8db804
Experiment24Experiment28-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
4f247137cab72c1f976576ff321d4e3c8cf8aab44e5f3977e75343a207d5e696
f8db804
verified
10 months ago
.gitattributes
2.05 kB
4f247137cab72c1f976576ff321d4e3c8cf8aab44e5f3977e75343a207d5e696
10 months ago
Experiment24Experiment28-7B.IQ3_XS.gguf
3.02 GB
LFS
d0dbccb818d4a221d8e52ec43674b065389dbb93d44ce68fa31a6c2e531e91bc
10 months ago
Experiment24Experiment28-7B.IQ4_XS.gguf
3.94 GB
LFS
41801f29a3f2a3bd02586a351cbf58a88eb672e1622fc215cc95773476a7efe3
10 months ago
Experiment24Experiment28-7B.Q2_K.gguf
2.72 GB
LFS
2c8534ef90602134ea4a682c09c0b8839720c03d33e38c7f446544ef1fa28b54
10 months ago
Experiment24Experiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
aee88f590811c31555b949156c5e00386ed7cb22c6ccca81ffed980e09a26073
10 months ago
Experiment24Experiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
03ea13833d82762b82318e71da2d28d2909377a15ed6bb2b4fece009390e00fe
10 months ago
Experiment24Experiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
3a52108011e7b01c5604497beee9988a17cc3d4f1a309e7d03b6a9dfd16cbc2e
10 months ago
Experiment24Experiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
4f247137cab72c1f976576ff321d4e3c8cf8aab44e5f3977e75343a207d5e696
10 months ago
