Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28T3q-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
8ff8e4f
Experiment28T3q-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
a8d9fd930cf0f713529d7a195ecb48f627c997938da788593cc2f79ff0a01962
8ff8e4f
verified
7 months ago
.gitattributes
1.99 kB
a8d9fd930cf0f713529d7a195ecb48f627c997938da788593cc2f79ff0a01962
7 months ago
Experiment28T3q-7B.IQ3_XS.gguf
3.02 GB
LFS
99d83e6e2c7156e5cc500270837c32d73c0f468b5e07e0f18af3387e063f2b7f
7 months ago
Experiment28T3q-7B.IQ4_XS.gguf
3.94 GB
LFS
9377c2c80ce15a7eb584f5dd1e4798e817aa260bf3e88a9a4f0a167780b1fa1e
7 months ago
Experiment28T3q-7B.Q2_K.gguf
2.72 GB
LFS
f8015d626e8e3f15c96672da37f7f1d0a830c451fd0b3f328846d24999987196
7 months ago
Experiment28T3q-7B.Q3_K_L.gguf
3.82 GB
LFS
13a394b81a4ea2a6109f2f40ebc2f52eda96b301a4e9ce5803e734fe22324516
7 months ago
Experiment28T3q-7B.Q3_K_M.gguf
3.52 GB
LFS
2604271e1b4bd33d08391707883b97f269c137ceabccb3e2c53cb0b001d586e6
7 months ago
Experiment28T3q-7B.Q3_K_S.gguf
3.16 GB
LFS
ced35284d03b68ba357a18323c7faeba98ca73c55e6119eccad23f46187cef54
7 months ago
Experiment28T3q-7B.Q4_K_M.gguf
4.37 GB
LFS
a8d9fd930cf0f713529d7a195ecb48f627c997938da788593cc2f79ff0a01962
7 months ago
