Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qT3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
4db3e50
T3qT3qm7xp-7B-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786
4db3e50
verified
7 months ago
.gitattributes
2.01 kB
9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786
7 months ago
T3qT3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
1b8060ff835d6a8049b357ac1d3a04a0bb59bd53b11d0c2e88dc3cb5e65bbfa6
7 months ago
T3qT3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
521affd489dfcb7620fd8fcde89314ee742dc50f86b8581557093b2b3952abeb
7 months ago
T3qT3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
8cb53a6699e427879fc44a8f8814ef076b8bea6f1cc7ec83784e9192f37c9549
7 months ago
T3qT3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
d02d2ecb4aa37a106c74b4e60e4147aedccfbaef205b9052016a921f36804e2e
7 months ago
T3qT3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
01d372174bbcd9178c6bd109aeb7af69d78b1c2e58d8a256fb76602946d62646
7 months ago
T3qT3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
e6281ea2e821b91c05db6e4ba228cf47c4f548ba4648fa4bf259dc229ecfa374
7 months ago
T3qT3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
aa89c4a9a9d665203a17c81453d7a6a0d74f70f79d0e855e379b913b842bb805
7 months ago
T3qT3qm7xp-7B.Q5_K_S.gguf
5 GB
LFS
9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786
7 months ago