Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
JackRussell-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
JackRussell-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
490df5fa2b151ba885bdc63846caba3551c236a7c7bcbee69d90c4e3f0b6aa2d
fdc2bfa
verified
3 months ago
.gitattributes
2.11 kB
65dce4b2475a8b5a019d2593b0fdf3f7c6c0067e77c3b1f27fba581e0995f11d
3 months ago
JackRussell.Q2_K.gguf
3.36 GB
LFS
f9b9ef946d7f3572987233afd5cdfede24fac337acfe1de770cb7f644e422c80
3 months ago
JackRussell.Q3_K_L.gguf
4.74 GB
LFS
a01b94b3750c7dc2b6e9f3277dab40d0656d852e3f04458de6e9aef93ab3d299
3 months ago
JackRussell.Q3_K_M.gguf
4.35 GB
LFS
14ef08cb01204acc7c4a6211d520277708366ad8fde2b54920f51840cd00c733
3 months ago
JackRussell.Q3_K_S.gguf
3.91 GB
LFS
be34221fa001809a32a573628f3b11cc3ea36316143c9f082a4a97b51a917050
3 months ago
JackRussell.Q4_K_M.gguf
5.42 GB
LFS
6599e842406925762d6f49fbf42c2e3e60f11249d412cae67711f9feafa087b7
3 months ago
JackRussell.Q4_K_S.gguf
5.13 GB
LFS
65c5728db889ffb040c351637d105b1bac14ec99e1232e77f7328fcdad8747a3
3 months ago
JackRussell.Q5_K_M.gguf
6.36 GB
LFS
26f06bed08941cb5a48f5f582ded266499a87d5d46c73fb7115c4c18eaa472a9
3 months ago
JackRussell.Q5_K_S.gguf
6.2 GB
LFS
7a6534387bcb87d31256857a98611c7e1f7d32ef23c60778e5ea65fd3d869c5f
3 months ago
JackRussell.Q6_K.gguf
7.37 GB
LFS
384d270c6aa866f29abac49f7dcbb12f5173cfc4ab4dcfc69c8b7374ec641c9b
3 months ago
JackRussell.Q8_0.gguf
9.55 GB
LFS
65dce4b2475a8b5a019d2593b0fdf3f7c6c0067e77c3b1f27fba581e0995f11d
3 months ago
README.md
3.21 kB
490df5fa2b151ba885bdc63846caba3551c236a7c7bcbee69d90c4e3f0b6aa2d
3 months ago