jartine's picture
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_K_M
6ea5cfd verified