jartine's picture
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 F16
047b115 verified