Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-passthrough-zpfenfn-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
af0f5fc
mergekit-passthrough-zpfenfn-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
c86e5afd23924b76f4e1adeb5d95d0d599829f2c50c9d3571492fbab01973595
af0f5fc
verified
8 months ago
.gitattributes
Safe
2.28 kB
c86e5afd23924b76f4e1adeb5d95d0d599829f2c50c9d3571492fbab01973595
8 months ago
mergekit-passthrough-zpfenfn.Q2_K.gguf
Safe
8.73 GB
LFS
a602eb48264f7b4341461dd86819a0643dce1bb78919b25dbb32d951ee711c89
8 months ago
mergekit-passthrough-zpfenfn.Q3_K_L.gguf
Safe
12.3 GB
LFS
0412d4185f614ccaf5bde9a824e2595b55b7fe627822b457a4121ed2fb51af3f
8 months ago
mergekit-passthrough-zpfenfn.Q3_K_M.gguf
Safe
11.3 GB
LFS
939097d0f92d4f5921a85a63a70e4a33ba0c52c0700484cc0539cc92a58afdce
8 months ago
mergekit-passthrough-zpfenfn.Q3_K_S.gguf
Safe
10.2 GB
LFS
bf7116217c02243a0337ee06239bb1fbe78102141a49387eac591b1a10b2e33c
8 months ago
mergekit-passthrough-zpfenfn.Q4_K_M.gguf
Safe
14 GB
LFS
c980670a89fac77f3cac606b97f323f45929f853a4cafe79d55c959baee116e7
8 months ago
mergekit-passthrough-zpfenfn.Q4_K_S.gguf
Safe
13.3 GB
LFS
7ee74dfbce69f87b4640feb67fb0d1ca34d1310900f4dffb6ddf0f0ef328c97f
8 months ago
mergekit-passthrough-zpfenfn.Q5_K_M.gguf
16.4 GB
LFS
99790d2ee6775916e081cc3f976cb7fb2a84209788d09499805677018e920eb4
8 months ago
mergekit-passthrough-zpfenfn.Q5_K_S.gguf
16 GB
LFS
24351101a4161c493d5db63a8628d38b73f2c497e99eb7d3c279119ff150d2d0
8 months ago
mergekit-passthrough-zpfenfn.Q6_K.gguf
19.1 GB
LFS
511c884de59cd4236a4a513d87ffe7bb4a4eb7bdd6a45efb2eec1f24bddc9871
8 months ago
mergekit-passthrough-zpfenfn.Q8_0.gguf
24.7 GB
LFS
c86e5afd23924b76f4e1adeb5d95d0d599829f2c50c9d3571492fbab01973595
8 months ago