jartine's picture
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 BF16
fc963e3 verified