Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qm7xExperiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
0537ab2
T3qm7xExperiment26-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
70546f6bd1caf5cd9a328660a7580cb0a6be2deb1d5d7021a148b1fc1fb3736f
0537ab2
verified
4 months ago
.gitattributes
2.22 kB
70546f6bd1caf5cd9a328660a7580cb0a6be2deb1d5d7021a148b1fc1fb3736f
4 months ago
T3qm7xExperiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
2f9da3d7fc67ce898fb6801d9465c3c87f37ea2494148ba76e45ab5463e5af83
4 months ago
T3qm7xExperiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
a8887c781f340a76667512a370d8e24d2b0dd509501656e77c6dfcbec45c435a
4 months ago
T3qm7xExperiment26-7B.Q2_K.gguf
2.72 GB
LFS
15b28d96889c0c5eeeed2412914bd000fef1e863027c1e0f1905251f9cf10ddf
4 months ago
T3qm7xExperiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
574a86450efd6dfaac6081d362a974d67ef10c326c32c21267ea77644f15a281
4 months ago
T3qm7xExperiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
29de8d941cce3dadd24e434c689b15739134c27da2cd069aa7fcc8462757c9fa
4 months ago
T3qm7xExperiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
aabe260f8d896d32bc6ab5ef32be03cefb3d92fb6bbd343d747f7f1558c40375
4 months ago
T3qm7xExperiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
a7947e1d6467c0c19a3739141dda19bb5185fb9ae7dadf3585f9b082c0d1cf55
4 months ago
T3qm7xExperiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
6c5e0eb65ca3e8c0c8b967326471cd0cccdbe7fe9d97fa01df9503bae4b8cf83
4 months ago
T3qm7xExperiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
cefb50f58482941818dea1efcad1e0f2f773fe6cee3eaed727170256467624b9
4 months ago
T3qm7xExperiment26-7B.Q5_K_S.gguf
5 GB
LFS
70546f6bd1caf5cd9a328660a7580cb0a6be2deb1d5d7021a148b1fc1fb3736f
4 months ago