jartine's picture
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 F16
297e980 verified