Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 F32 1752a47 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 F16 310bf7f verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 BF16 0f0a538 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q8_0 dec7afe verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q6_K 8b548c5 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_K_M ec5c215 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_K_S 3451d03 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_K_M 9e580b7 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_K_S 14da8e5 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_L ada5ba6 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_M 053bded verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q3_K_S e9ed5ff verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q2_K 889f2a2 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_1 452f0d0 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q5_0 57eefc6 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_1 869812c verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_0 3dababc verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_M 0916fd3 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_S 7bde0df verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_M f082437 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_S 8e0bb53 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_L 62ca068 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_M 92eb247 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_S 95df6e6 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q2_K 48e036a verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_1 571741c verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_0 57f2c2f verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_1 a828796 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_0 120d92d verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F32 afe0f30 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F16 9e68a73 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 BF16 7cc2632 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q8_0 6487307 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q6_K bad577e verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_M 67ce9dd verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_S e2f1aaa verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_M ff3a419 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_S a0949c7 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_L 690be13 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_M 5379f33 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_S a1ff20e verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q2_K 952e76b verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_1 187a270 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_0 f1c934c verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_1 1052205 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_0 520fc7b verified jartine commited on May 10
jartine
commited on
