Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 F16 0e96575 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 BF16 007a025 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q8_0 84f1f51 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q6_K d7e955a verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q5_K_M 86052a2 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q5_K_S 0f42df2 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q4_K_M d900bbf verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q4_K_S 73fc306 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q3_K_L 2a7f697 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q3_K_M 8e8865a verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q3_K_S 7045567 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q2_K 7ee9349 verified jartine commited on May 10
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.8.4 Q5_1 0bfb1b1 verified jartine commited on May 10