Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment27pasticheYamshadowexperiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
3ab07a8
Experiment27pasticheYamshadowexperiment28-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
d8aa8a017e9bf53935760a7f3603065ba14ad02ee8ba42fd9c40a7f1f64c999f
3ab07a8
verified
4 months ago
.gitattributes
2.53 kB
d8aa8a017e9bf53935760a7f3603065ba14ad02ee8ba42fd9c40a7f1f64c999f
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q2_K.gguf
2.72 GB
LFS
304e4a4a4a323f350a6555d184da003d59829aa94a887bc023de41314b1cd998
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q3_K_L.gguf
3.82 GB
LFS
617095c485cde91b8916063383bc9ba9a2c884a6d251f4584ad841f353a0e152
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q3_K_M.gguf
3.52 GB
LFS
3353c09814ef35f4d62b634040e248987d5c10cdee51346e80f4848b35412e4e
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q3_K_S.gguf
3.16 GB
LFS
2b447b9d654dab0c4d1783e91c78dc219787c0e3057a46580b5fbfc4894dceba
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q4_K_M.gguf
4.37 GB
LFS
04ae252a87098c9ce2135a901c9d044681c057f43be3147a293fa5c1cbf4a1ab
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q4_K_S.gguf
4.14 GB
LFS
4218f440bf3f50ad327ec4a4a698ee404a83de78c0e319e2bc92aab5165bdd69
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q5_K_M.gguf
5.13 GB
LFS
b84d5df9cd444815b79d2a19768595586feb7e636aa9052a9441e193041a9e3c
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q5_K_S.gguf
5 GB
LFS
f41f4ea6f6f3c2df9260b193dcdda73f49d6b0519ba55a8b04cad924072124f5
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q6_K.gguf
5.94 GB
LFS
19ac090415555653e34a57eda4406b19b9244c68fe7bd4e23931d4db69d0cd8f
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.Q8_0.gguf
7.7 GB
LFS
9cd23f43bf6305a21342501b5a7e1be52ecbecac64f8fd0d94d305e0c85c9d00
4 months ago
Experiment27pasticheYamshadowexperiment28-7B.fp16.gguf
14.5 GB
LFS
d8aa8a017e9bf53935760a7f3603065ba14ad02ee8ba42fd9c40a7f1f64c999f
4 months ago