llamafile
English
GGUF

Commit History

Quantize with llamafile-0.8.6 Q2_K
14083b9
verified

jartine commited on

Quantize with llamafile-0.8.6 Q5_1
62a770b
verified

jartine commited on

Quantize with llamafile-0.8.6 Q5_0
f133d51
verified

jartine commited on

Quantize with llamafile-0.8.6 Q4_1
a1db126
verified

jartine commited on

Quantize with llamafile-0.8.6 Q4_0
922d78f
verified

jartine commited on

Quantize with llamafile-0.8.5 F32
23ff3ac
verified

jartine commited on

Quantize with llamafile-0.8.5 F16
7f39ddf
verified

jartine commited on

Quantize with llamafile-0.8.5 BF16
cf39988
verified

jartine commited on

Quantize with llamafile-0.8.5 Q8_0
e763e4a
verified

jartine commited on

Quantize with llamafile-0.8.5 Q6_K
91f746f
verified

jartine commited on

Quantize with llamafile-0.8.5 Q5_K_M
89f6aed
verified

jartine commited on

Quantize with llamafile-0.8.5 Q5_K_S
f4ef4e8
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_K_M
f52b558
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_K_S
108caf7
verified

jartine commited on

Quantize with llamafile-0.8.5 Q3_K_L
852af45
verified

jartine commited on

Quantize with llamafile-0.8.5 Q3_K_M
b9b5eba
verified

jartine commited on

Quantize with llamafile-0.8.5 Q3_K_S
2995cc2
verified

jartine commited on

Quantize with llamafile-0.8.5 Q2_K
c8106db
verified

jartine commited on

Quantize with llamafile-0.8.5 Q5_1
707b4ec
verified

jartine commited on

Quantize with llamafile-0.8.5 Q5_0
9a6ccfa
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_1
d066acf
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_0
50f8135
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_1
2d772f2
verified

jartine commited on

Quantize with llamafile-0.8.5 Q4_0
055bd30
verified

jartine commited on

Update README.md
538628b
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 F32
1752a47
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 F16
310bf7f
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 BF16
0f0a538
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q8_0
dec7afe
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q6_K
8b548c5
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_K_M
ec5c215
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_K_S
3451d03
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_K_M
9e580b7
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_K_S
14da8e5
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_L
ada5ba6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_M
053bded
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_S
e9ed5ff
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q2_K
889f2a2
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_1
452f0d0
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_0
57eefc6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_1
869812c
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_0
3dababc
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_M
0916fd3
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_S
7bde0df
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_M
f082437
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_S
8e0bb53
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_L
62ca068
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_M
92eb247
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_S
95df6e6
verified

jartine commited on

Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q2_K
48e036a
verified

jartine commited on