Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Saul-Base-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
legal
conversational
en
arxiv:2403.03883
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Saul-Base-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
972f9a9f7bc289803bf50a51b61c08675f3825c12830a8eeb244886bb43611c3
735f672
verified
4 months ago
.gitattributes
2.15 kB
076640a51915df562a0ebfb7f7292fcb8da8410834f2d21f9fdd083353cca255
4 months ago
README.md
10.7 kB
972f9a9f7bc289803bf50a51b61c08675f3825c12830a8eeb244886bb43611c3
4 months ago
Saul-Base.IQ4_XS.gguf
3.94 GB
LFS
4dde9db9a598a645a8ae0a7fe2eae6093d4befa05a1807b8874c913a7e696005
4 months ago
Saul-Base.Q2_K.gguf
2.72 GB
LFS
6ff90aa1bc0e4f941838082c7e99e484c1dcc20febd9418e69b1ce29405ee50a
4 months ago
Saul-Base.Q3_K_L.gguf
3.82 GB
LFS
24cc79f23a6b3a05f32672a4fb2bc9112646f2f17a5dcbab0c6d42fad67738a9
4 months ago
Saul-Base.Q3_K_M.gguf
3.52 GB
LFS
6052342f90ac6578f3a2ca88f097154043bee084731ebabe1d9aae7bd7eaaa7e
4 months ago
Saul-Base.Q3_K_S.gguf
3.16 GB
LFS
2b4ce7bdd87c1b33c8a8cf63aab93bcd9393d83b4ef1580884f76db1277767c1
4 months ago
Saul-Base.Q4_K_M.gguf
4.37 GB
LFS
ff9a28bf663e320ff1d029de801a27d311939071a51aeaf193850a39c0539ee9
4 months ago
Saul-Base.Q4_K_S.gguf
4.14 GB
LFS
5f9f1772cfd319cedd7bcbfeb92a3eec3e0fb1342e29b5e469e48d4a94a807f7
4 months ago
Saul-Base.Q5_K_M.gguf
5.13 GB
LFS
b48d2fd2cf166a19d294c5a1e6e1fe00892c67886e6366b978356812163c557e
4 months ago
Saul-Base.Q5_K_S.gguf
5 GB
LFS
064bb85682d8488c1863846ad3e16b2a619993541ab86319f22d128d39d2eb05
4 months ago
Saul-Base.Q6_K.gguf
5.94 GB
LFS
746b5a713348cbaeac97fe26187b4a6835d93293900ad4605cefeb1a5145a4b5
4 months ago
Saul-Base.Q8_0.gguf
7.7 GB
LFS
076640a51915df562a0ebfb7f7292fcb8da8410834f2d21f9fdd083353cca255
4 months ago
