jartine's picture
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_0
ca51107 verified