Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-zwxzpdk-GGUF
like
1
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
1bb839d
mergekit-ties-zwxzpdk-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
bd2bc2dec984220315ce3d861b6a01c1b3e7615106c755d6ff975c2180cebb19
1bb839d
verified
5 months ago
.gitattributes
2.01 kB
bd2bc2dec984220315ce3d861b6a01c1b3e7615106c755d6ff975c2180cebb19
5 months ago
mergekit-ties-zwxzpdk.Q2_K.gguf
2.53 GB
LFS
59b9fd4eb717cc5412f2d1ed90cab9ea7fded9ecc881d17f2d4e7ea894c81e5e
5 months ago
mergekit-ties-zwxzpdk.Q3_K_L.gguf
3.6 GB
LFS
8aaeac70647ea3daa0a99691f247d9472d959b0e4fe1839eb0bc52442eb77bc3
5 months ago
mergekit-ties-zwxzpdk.Q3_K_M.gguf
3.3 GB
LFS
d0c20d487141738f556f9194ca5977dd5eb61d5c0130d2e27af6f25b59fccefe
5 months ago
mergekit-ties-zwxzpdk.Q3_K_S.gguf
2.95 GB
LFS
dda826753a37b8eeb1718cb229a4350c74659158026095ec0f08e21ea9875a03
5 months ago
mergekit-ties-zwxzpdk.Q4_K_M.gguf
4.08 GB
LFS
9192be63a54fef82a70f2bb1cc61e164c1066dcdb0c76a6d5b7883a42f22882a
5 months ago
mergekit-ties-zwxzpdk.Q4_K_S.gguf
3.86 GB
LFS
2914be05a5a7aa7636345ebdb2ea4cdbccd44668bb0290630221739011146367
5 months ago
mergekit-ties-zwxzpdk.Q5_K_M.gguf
4.78 GB
LFS
bd2bc2dec984220315ce3d861b6a01c1b3e7615106c755d6ff975c2180cebb19
5 months ago
