llamafile
English
GGUF

Commit History

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_S
7bde0df
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_M
f082437
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_S
8e0bb53
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_L
62ca068
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_M
92eb247
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_S
95df6e6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q2_K
48e036a
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_1
571741c
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_0
57f2c2f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_1
a828796
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_0
120d92d
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F32
afe0f30
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F16
9e68a73
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 BF16
7cc2632
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q8_0
6487307
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q6_K
bad577e
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_M
67ce9dd
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_S
e2f1aaa
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_M
ff3a419
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_S
a0949c7
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_L
690be13
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_M
5379f33
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_S
a1ff20e
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q2_K
952e76b
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_1
187a270
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_0
f1c934c
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_1
1052205
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_0
520fc7b
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F32
a26b598
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q5_K.llamafile
3dc5a8b
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q4_K.llamafile
c378db2
verified

jartine commited on

Delete TinyLlama-1.1B-Chat-v1.0.Q3_K.llamafile
5deafa7
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F16
08524de
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 BF16
8a7d4f5
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q8_0
6aee330
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q6_K
bab2baf
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_M
9115aff
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_S
2a816fc
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K
c931a5a
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_M
5da5761
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_S
dbafb0f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K
f07c622
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_L
7eb4de4
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_M
3f0260f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_S
a0485f9
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K
84b6af6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q2_K
ed8fdf9
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_1
b157c5f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_0
fabdf34
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_1
06bac9a
verified

jartine commited on