Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.4 Q4_0 3dababc verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_M 0916fd3 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_K_S 7bde0df verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_M f082437 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_K_S 8e0bb53 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_L 62ca068 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_M 92eb247 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q3_K_S 95df6e6 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q2_K 48e036a verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_1 571741c verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q5_0 57f2c2f verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_1 a828796 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.3 Q4_0 120d92d verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F32 afe0f30 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 F16 9e68a73 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 BF16 7cc2632 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q8_0 6487307 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q6_K bad577e verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_M 67ce9dd verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_K_S e2f1aaa verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_M ff3a419 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_K_S a0949c7 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_L 690be13 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_M 5379f33 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q3_K_S a1ff20e verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q2_K 952e76b verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_1 187a270 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q5_0 f1c934c verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_1 1052205 verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.8.2 Q4_0 520fc7b verified jartine commited on May 10
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F32 a26b598 verified jartine commited on Apr 23
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F16 08524de verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 BF16 8a7d4f5 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q8_0 6aee330 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q6_K bab2baf verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_M 9115aff verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_S 2a816fc verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K c931a5a verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_M 5da5761 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_S dbafb0f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K f07c622 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_L 7eb4de4 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_M 3f0260f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_S a0485f9 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K 84b6af6 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q2_K ed8fdf9 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_1 b157c5f verified jartine commited on Apr 20
jartine
commited on
