Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Experiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
12eeb5d
Experiment26Experiment26-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
30f38e9a6eef70d820419cf3c26dd2b047c95ee5230f75296bcce34e7dc3a8e5
12eeb5d
verified
7 months ago
.gitattributes
2.05 kB
30f38e9a6eef70d820419cf3c26dd2b047c95ee5230f75296bcce34e7dc3a8e5
7 months ago
Experiment26Experiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
a195198308e1e1500e609d98ec70443ba2ab480fc9053e6bf04f782b97b1a627
7 months ago
Experiment26Experiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
255c1f8eb19a4e16b398a3863c832f5631178953e38c6e4a7179b8180f52d4c5
7 months ago
Experiment26Experiment26-7B.Q2_K.gguf
2.72 GB
LFS
d32c50b1b8ea77b8217023105a0f68244d86eb87bb0646b25aca33900ed16abd
7 months ago
Experiment26Experiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
8b1a471b6df7dc934f7fe98833dcac8089a77fff017cb6e34a780e52038a3ba4
7 months ago
Experiment26Experiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
e57fbe603c2b6cc9d79ae1fc13bb44c56f64c2833240af09a8bc834a84c93f64
7 months ago
Experiment26Experiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
d296f4e5e6f9b5718d100521ab65298767ba37e18c24ef598a33389bda04260c
7 months ago
Experiment26Experiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
30f38e9a6eef70d820419cf3c26dd2b047c95ee5230f75296bcce34e7dc3a8e5
7 months ago
