Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q5_K_M ce8aecc verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q4_0 07e5a99 verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q4_0 68b97ac verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q3_K_M 12c540f verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q3_K_M a55b34a verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q2_K 429f575 verified jartine commited on Apr 25, 2024
Quantize Mixtral-8x22B-Instruct-v0.1 with llamafile-0.8 Q2_K baf67ba verified jartine commited on Apr 25, 2024