Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Inex12T3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
b9e2cc9
Inex12T3qm7xp-7B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
1c37ae6ae96e00da04601682d98d49db92178a7d20a38cff97ab803a8694fc54
b9e2cc9
verified
6 months ago
.gitattributes
1.91 kB
1c37ae6ae96e00da04601682d98d49db92178a7d20a38cff97ab803a8694fc54
6 months ago
Inex12T3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
8fb2800f444df1bff4e5bb8e9134453ca4adbdfa27a997092c96964ee638df3d
6 months ago
Inex12T3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
a4fa50a29efd93b5eb56cbba3bf83b3ee492a608907bf2764dc81fae50aa098a
6 months ago
Inex12T3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
1267888221d6680b36276f4b0cb00d6677a9bc0c1cf674ec3bb53f09e1835c2d
6 months ago
Inex12T3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
5c54f32a03394d9fe8e329b7553e18d1e3942dbcb780164e788ce6f6cdc2895b
6 months ago
Inex12T3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
2e8a5830f5a578d67bdc96dbf03301a981884bd40d6d20c0530552c0b06d9149
6 months ago
Inex12T3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
1c37ae6ae96e00da04601682d98d49db92178a7d20a38cff97ab803a8694fc54
6 months ago
