Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qT3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
b757c08
T3qT3qm7xp-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
3a30b1cc1b16f12c50e4647454c1699bdc6a3c15262f50c94b1d4d2ce0ec3fea
b757c08
verified
6 months ago
.gitattributes
2.19 kB
3a30b1cc1b16f12c50e4647454c1699bdc6a3c15262f50c94b1d4d2ce0ec3fea
6 months ago
T3qT3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
1b8060ff835d6a8049b357ac1d3a04a0bb59bd53b11d0c2e88dc3cb5e65bbfa6
6 months ago
T3qT3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
521affd489dfcb7620fd8fcde89314ee742dc50f86b8581557093b2b3952abeb
6 months ago
T3qT3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
8cb53a6699e427879fc44a8f8814ef076b8bea6f1cc7ec83784e9192f37c9549
6 months ago
T3qT3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
d02d2ecb4aa37a106c74b4e60e4147aedccfbaef205b9052016a921f36804e2e
6 months ago
T3qT3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
01d372174bbcd9178c6bd109aeb7af69d78b1c2e58d8a256fb76602946d62646
6 months ago
T3qT3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
e6281ea2e821b91c05db6e4ba228cf47c4f548ba4648fa4bf259dc229ecfa374
6 months ago
T3qT3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
aa89c4a9a9d665203a17c81453d7a6a0d74f70f79d0e855e379b913b842bb805
6 months ago
T3qT3qm7xp-7B.Q5_K_S.gguf
5 GB
LFS
9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786
6 months ago
T3qT3qm7xp-7B.Q6_K.gguf
5.94 GB
LFS
b11ef303937a6256a83080201fa7e245fe732dfc3170c45a864622a8e243adb5
6 months ago
T3qT3qm7xp-7B.Q8_0.gguf
7.7 GB
LFS
2a3747910e815ef7ae733c21b228c9608026f212bf4c9b4dd1f2dd1196286758
6 months ago
T3qT3qm7xp-7B.fp16.gguf
14.5 GB
LFS
3a30b1cc1b16f12c50e4647454c1699bdc6a3c15262f50c94b1d4d2ce0ec3fea
6 months ago
