Quantize BF16 with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb 73e9a28 verified jartine commited on Oct 2
Quantize F16 with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb 9efd38f verified jartine commited on Oct 2
Quantize Q6_K with llamafile-7b395be84b6797117049d7473aa5a0d76a9892cb a3f59ae verified jartine commited on Oct 2