Usage on Ornith-1.5-35B-A3B
#7
by nonitis - opened
Can this template be used on the Ornith-1.5-35B-A3B finetune also?
Yes! I'm benchmarking it right now, will be uploading my own dynamic quant with my own imatrix and the sharp template, with benchmarks in the model card showing how it affects the model :),