Could you add ARM quants for this model please?
#1
by
EloyOn
- opened
Phone user here xD
Will add! :D
Thank you!
"Q4_0_4_4", "Q4_0_4_8", "Q4_0_8_8"
Uploading! yay
I think ARM-Violet_Twilight-v0.2-Q4_0_4_8-imat is the most popular/balanced of the ARM quants (i8mm)
Lewdiculous
changed discussion status to
closed
"Q4_0_4_4", "Q4_0_4_8", "Q4_0_8_8"
Uploading! yay
I think ARM-Violet_Twilight-v0.2-Q4_0_4_8-imat is the most popular/balanced of the ARM quants (i8mm)
Yeah, 048 quants are what I use on my Snapdragon 8 gen 3.
That was fast, thank you!