1 contributor

History: 236 commits

jartine

Quantize with llamafile-0.8.7 Q6_K

cd93c2d verified about 1 month ago

.gitattributes
3.99 kB

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F32 3 months ago
README.md
3.76 kB

Update README.md 3 months ago
TinyLlama-1.1B-Chat-v1.0.BF16.llamafile
2.24 GB
LFS

Quantize with llamafile-0.8.6 BF16 2 months ago
TinyLlama-1.1B-Chat-v1.0.F16.llamafile
2.24 GB
LFS

Quantize with llamafile-0.8.6 F16 2 months ago
TinyLlama-1.1B-Chat-v1.0.F32.llamafile
4.44 GB
LFS

Quantize with llamafile-0.8.6 F32 2 months ago
TinyLlama-1.1B-Chat-v1.0.Q2_K.llamafile
458 MB
LFS

Quantize with llamafile-0.8.7 Q2_K about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q3_K_L.llamafile
617 MB
LFS

Quantize with llamafile-0.8.7 Q3_K_L about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q3_K_M.llamafile
574 MB
LFS

Quantize with llamafile-0.8.7 Q3_K_M about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q3_K_S.llamafile
525 MB
LFS

Quantize with llamafile-0.8.7 Q3_K_S about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q4_0.llamafile
662 MB
LFS

Quantize with llamafile-0.8.7 Q4_0 about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q4_1.llamafile
727 MB
LFS

Quantize with llamafile-0.8.7 Q4_1 about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q4_K_M.llamafile
694 MB
LFS

Quantize with llamafile-0.8.7 Q4_K_M about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q4_K_S.llamafile
666 MB
LFS

Quantize with llamafile-0.8.7 Q4_K_S about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q5_0.llamafile
792 MB
LFS

Quantize with llamafile-0.8.7 Q5_0 about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q5_1.llamafile
856 MB
LFS

Quantize with llamafile-0.8.7 Q5_1 about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q5_K_M.llamafile
808 MB
LFS

Quantize with llamafile-0.8.7 Q5_K_M about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q5_K_S.llamafile
792 MB
LFS

Quantize with llamafile-0.8.7 Q5_K_S about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q6_K.llamafile
929 MB
LFS

Quantize with llamafile-0.8.7 Q6_K about 1 month ago
TinyLlama-1.1B-Chat-v1.0.Q8_0.llamafile
1.21 GB
LFS

Quantize with llamafile-0.8.6 Q8_0 2 months ago