Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Inex12Experiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
a761303
Inex12Experiment28-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
8b0e7013364eb88dceafe32c9a34e03b495477455f09606f96d5ba44bfe30a08
a761303
verified
3 months ago
.gitattributes
2.22 kB
8b0e7013364eb88dceafe32c9a34e03b495477455f09606f96d5ba44bfe30a08
3 months ago
Inex12Experiment28-7B.IQ3_XS.gguf
3.02 GB
LFS
cefbe6b3a376853b246bc802048f0c8f8567420b1d67efaca3764497452a9ef1
3 months ago
Inex12Experiment28-7B.IQ4_XS.gguf
3.94 GB
LFS
3617b23e47230b79431b50bfc9fcbcf350a247d5dbc328c127ec163fc422cfd7
3 months ago
Inex12Experiment28-7B.Q2_K.gguf
2.72 GB
LFS
de8e94cc6f9e9b3b92948cf8f00dff749cfe843f9fed7c6db5297d68445ed5a3
3 months ago
Inex12Experiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
b994a64228c259274cad575187e99a9bf50ff0dc942ac39619edcba153e0c1ba
3 months ago
Inex12Experiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
31a946612ee8457b6180255eafd75617fac50e99f85e3fee94bb36c629464b79
3 months ago
Inex12Experiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
7db76caa68c3a1a8edcb5098ce9ca16450825d4d8d9d01b5584eb95193767c40
3 months ago
Inex12Experiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
35b083a4163aa06784ae9d154eba0e00367ba9145ccf7207c8241815937b0c01
3 months ago
Inex12Experiment28-7B.Q4_K_S.gguf
4.14 GB
LFS
77fcca370bedd59ac7912aa2a587395bae3cdf6b328b9672da0d7511846fc8ca
3 months ago
Inex12Experiment28-7B.Q5_K_M.gguf
5.13 GB
LFS
5d1f16989bdfa5ce92d30facec12ac6420ccd5c789543044694b872d4fc093f9
3 months ago
Inex12Experiment28-7B.Q5_K_S.gguf
5 GB
LFS
8b0e7013364eb88dceafe32c9a34e03b495477455f09606f96d5ba44bfe30a08
3 months ago
