Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_K_S c9340a3 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_K ca6d8d1 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_K_M 735c307 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_K_S 25835ea verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_K d000242 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q3_K_L 367c0f8 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q3_K_M 085f85e verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q3_K_S 2cd5bdd verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q3_K 5afde77 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q2_K 911e1cc verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_1 80f87e3 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_0 a940757 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_1 c19746d verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q6_K 2979e80 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 BF16 1927c5c verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 F16 d18b812 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q8_0 48dfbf8 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_K_M 0479f7e verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_0 d656e11 verified jartine commited on Apr 19