Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
YamT3qm7x-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
e5771d4
YamT3qm7x-7B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
0da9b1f6a6f713c3f2e656479ebd0f2bc1fa2f935811a8a476fbb9dda51134bc
e5771d4
verified
5 months ago
.gitattributes
1.88 kB
0da9b1f6a6f713c3f2e656479ebd0f2bc1fa2f935811a8a476fbb9dda51134bc
5 months ago
YamT3qm7x-7B.IQ3_XS.gguf
3.02 GB
LFS
b518f12afc85168fb9dc6ff0157fa628bbae95edac89c597cd6b5b844e6f6277
5 months ago
YamT3qm7x-7B.IQ4_XS.gguf
3.94 GB
LFS
64fc84d7c85ba3f4f607020ec282becec31b70c547fec469f765390dd3776295
5 months ago
YamT3qm7x-7B.Q2_K.gguf
2.72 GB
LFS
f369624d40028f49a033825d79d2235cadbf7265e863aad2c2aa354b8fd65dec
5 months ago
YamT3qm7x-7B.Q3_K_L.gguf
3.82 GB
LFS
d94fc30da707fc8e526937ba8644fb4e5b56b9c85484f1277f3701cd5b1fdb8e
5 months ago
YamT3qm7x-7B.Q3_K_M.gguf
3.52 GB
LFS
a9a8f899e92c6e16a90c74250afb02e3d801c078d23df9d48c97c19999199530
5 months ago
YamT3qm7x-7B.Q3_K_S.gguf
3.16 GB
LFS
0da9b1f6a6f713c3f2e656479ebd0f2bc1fa2f935811a8a476fbb9dda51134bc
5 months ago