Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mozilla
/
rocket-3B-llamafile
like
7
Follow
mozilla
185
Transformers
llamafile
English
stablelm
arxiv:
2305.18290
arxiv:
2101.00027
arxiv:
2305.06161
License:
cc-by-sa-4.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
839652d
rocket-3B-llamafile
1 contributor
History:
71 commits
jartine
Quantize rocket-3B with llamafile-0.7.3 F16
839652d
verified
8 months ago
.gitattributes
Safe
3.01 kB
Quantize rocket-3B with llamafile-0.7.3 F16
8 months ago
README.md
Safe
22 kB
Update README.md
12 months ago
config.json
Safe
32 Bytes
Add config.json to repo
12 months ago
rocket-3b.F16.llamafile
Safe
5.62 GB
LFS
Quantize rocket-3B with llamafile-0.7.3 F16
8 months ago
rocket-3b.Q2_K.llamafile
Safe
1.23 GB
LFS
Wrap rocket-3b.Q2_K.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q3_K_L.llamafile
Safe
1.54 GB
LFS
Wrap rocket-3b.Q3_K_L.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q3_K_M.llamafile
Safe
1.43 GB
LFS
Wrap rocket-3b.Q3_K_M.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q3_K_S.llamafile
Safe
1.29 GB
LFS
Wrap rocket-3b.Q3_K_S.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q4_0.llamafile
Safe
1.63 GB
LFS
Quantize rocket-3B with llamafile-0.7.3 Q4_0
8 months ago
rocket-3b.Q4_K_M.llamafile
Safe
1.74 GB
LFS
Wrap rocket-3b.Q4_K_M.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q4_K_S.llamafile
Safe
1.65 GB
LFS
Wrap rocket-3b.Q4_K_S.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q5_0.llamafile
Safe
1.98 GB
LFS
Wrap rocket-3b.Q5_0.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q5_K_M.llamafile
Safe
2.02 GB
LFS
Quantize rocket-3B with llamafile-0.7.3 Q5_K_M
8 months ago
rocket-3b.Q5_K_S.llamafile
Safe
1.98 GB
LFS
Wrap rocket-3b.Q5_K_S.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q6_K.llamafile
Safe
2.33 GB
LFS
Wrap rocket-3b.Q6_K.gguf with llamafile v0.6.2
11 months ago
rocket-3b.Q8_0.llamafile
Safe
3 GB
LFS
Quantize rocket-3B with llamafile-0.7.3 Q8_0
8 months ago