About weighted/imatrix quants
I think you are right about that. maybe its problem on my output original model. The problem maybe’s I forgot calibration run on output the original.
I will planning generate a new one with weighted/imatrix quants support at my free time. once it’s done. I will post a thread at this discussion.
Sorry, I am missing context here - did we talk about this model before? According to the meta-data, I haven't tried making imatrix quants, and I can try making them if you are requesting it, even if you are making a new model.
Ah, the only reaosn speaking against imatrix quants is that my training data concentrates on english only, which I think would be a bad for for this model. But it could be done :)
sorry to make you confuse. I mean I am the author of the module. So I can provide the imatrix quants use my training data
Ahh, you do them yourself, that's great! :)