Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-zwxzpdk-GGUF
like
1
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
16329ff
mergekit-ties-zwxzpdk-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
28cd59c61b5bbd1d90cc20730b9842043581fd012b1b41be56229bd5b9d63e33
16329ff
verified
5 months ago
.gitattributes
2.21 kB
b01874a96926ebd1b649bef859cb4aad225851e32f0309fd5e15feb1a4ebf625
5 months ago
README.md
3.35 kB
28cd59c61b5bbd1d90cc20730b9842043581fd012b1b41be56229bd5b9d63e33
5 months ago
mergekit-ties-zwxzpdk.Q2_K.gguf
2.53 GB
LFS
59b9fd4eb717cc5412f2d1ed90cab9ea7fded9ecc881d17f2d4e7ea894c81e5e
5 months ago
mergekit-ties-zwxzpdk.Q3_K_L.gguf
3.6 GB
LFS
8aaeac70647ea3daa0a99691f247d9472d959b0e4fe1839eb0bc52442eb77bc3
5 months ago
mergekit-ties-zwxzpdk.Q3_K_M.gguf
3.3 GB
LFS
d0c20d487141738f556f9194ca5977dd5eb61d5c0130d2e27af6f25b59fccefe
5 months ago
mergekit-ties-zwxzpdk.Q3_K_S.gguf
2.95 GB
LFS
dda826753a37b8eeb1718cb229a4350c74659158026095ec0f08e21ea9875a03
5 months ago
mergekit-ties-zwxzpdk.Q4_K_M.gguf
4.08 GB
LFS
9192be63a54fef82a70f2bb1cc61e164c1066dcdb0c76a6d5b7883a42f22882a
5 months ago
mergekit-ties-zwxzpdk.Q4_K_S.gguf
3.86 GB
LFS
2914be05a5a7aa7636345ebdb2ea4cdbccd44668bb0290630221739011146367
5 months ago
mergekit-ties-zwxzpdk.Q5_K_M.gguf
4.78 GB
LFS
bd2bc2dec984220315ce3d861b6a01c1b3e7615106c755d6ff975c2180cebb19
5 months ago
mergekit-ties-zwxzpdk.Q5_K_S.gguf
4.65 GB
LFS
a8cc83a0103982e5d1874ca4d5fcf93ca91978e18e54eafb8b5539d7abea8559
5 months ago
mergekit-ties-zwxzpdk.Q6_K.gguf
5.53 GB
LFS
056b1dcf20330e593f80d7819043200049fcc3b9e7cc225d439c37fdcbc34d60
5 months ago
mergekit-ties-zwxzpdk.Q8_0.gguf
7.16 GB
LFS
b01874a96926ebd1b649bef859cb4aad225851e32f0309fd5e15feb1a4ebf625
5 months ago
