Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 F16 08524de verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 BF16 8a7d4f5 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q8_0 6aee330 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q6_K bab2baf verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_M 9115aff verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K_S 2a816fc verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_K c931a5a verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_M 5da5761 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K_S dbafb0f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_K f07c622 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_L 7eb4de4 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_M 3f0260f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K_S a0485f9 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q3_K 84b6af6 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q2_K ed8fdf9 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_1 b157c5f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q5_0 fabdf34 verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_1 06bac9a verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7.3 Q4_0 2c6bc5f verified jartine commited on Apr 20
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q5_K_M 43ea77c verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q5_K_S f7d76c1 verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q4_K_M e7aba13 verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q4_K_S 83786a5 verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_L d99d7d9 verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_M cfb2c3d verified jartine commited on Apr 1
Quantize TinyLlama-1.1B-Chat-v1.0 with llamafile-0.7 Q3_K_S aa4bc7e verified jartine commited on Apr 1