Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mozilla
/
rocket-3B-llamafile
like
7
Follow
mozilla
185
Transformers
llamafile
English
stablelm
arxiv:
2305.18290
arxiv:
2101.00027
arxiv:
2305.06161
License:
cc-by-sa-4.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
3d31fb7
rocket-3B-llamafile
1 contributor
History:
162 commits
jartine
Quantize rocket-3B with llamafile-0.8.12 Q4_K_M
3d31fb7
verified
5 months ago
.gitattributes
Safe
3.19 kB
Quantize rocket-3B with llamafile-0.7.3 Q5_1
8 months ago
README.md
Safe
22 kB
Update README.md
12 months ago
config.json
Safe
32 Bytes
Add config.json to repo
12 months ago
rocket-3b.BF16.llamafile
Safe
5.62 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 BF16
5 months ago
rocket-3b.F16.llamafile
Safe
5.62 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 F16
5 months ago
rocket-3b.Q2_K.llamafile
Safe
1.11 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q2_K
5 months ago
rocket-3b.Q3_K_L.llamafile
Safe
1.54 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q3_K_L
5 months ago
rocket-3b.Q3_K_M.llamafile
Safe
1.42 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q3_K_M
5 months ago
rocket-3b.Q3_K_S.llamafile
Safe
1.28 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q3_K_S
5 months ago
rocket-3b.Q4_0.llamafile
Safe
1.64 GB
LFS
Quantize rocket-3B with llamafile-0.8.9 Q4_0
6 months ago
rocket-3b.Q4_1.llamafile
Safe
1.81 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q4_1
5 months ago
rocket-3b.Q4_K_M.llamafile
Safe
1.74 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q4_K_M
5 months ago
rocket-3b.Q4_K_S.llamafile
Safe
1.65 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q4_K_S
5 months ago
rocket-3b.Q5_0.llamafile
Safe
1.97 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q5_0
5 months ago
rocket-3b.Q5_1.llamafile
Safe
2.14 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q5_1
5 months ago
rocket-3b.Q5_K_M.llamafile
Safe
2.02 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q5_K_M
5 months ago
rocket-3b.Q5_K_S.llamafile
Safe
1.97 GB
LFS
Quantize rocket-3B with llamafile-0.8.9 Q5_K_S
6 months ago
rocket-3b.Q6_K.llamafile
Safe
2.33 GB
LFS
Quantize rocket-3B with llamafile-0.8.9 Q6_K
6 months ago
rocket-3b.Q8_0.llamafile
Safe
3 GB
LFS
Quantize rocket-3B with llamafile-0.8.12 Q8_0
5 months ago