Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q5_K_S 32f2cab verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q4_K_M 0fb483b verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q4_K_S 94010fc verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q3_K_L ec694c6 verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q3_K_M 646971a verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q3_K_S 2c90b6a verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q2_K 727e715 verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q5_1 e25efe7 verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q5_0 9740d6d verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q4_1 6c6ec59 verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q8_0 36cfc7c verified jartine commited on Apr 26
Quantize Phi-3-mini-4k-instruct with llamafile-0.8.1 Q4_0 a83519a verified jartine commited on Apr 26