What is smashed?
#1
by
supercharge19
- opened
What does it mean? Is it marketing term or new technique for quantization? Sorry, am busy so can't read paper right now, so if you could give TL;DR please?
smashed is basically used to designate that this is optimized by pruna. In the case for the current model it is raw GGUF as mentioned in the readme. For other models it could mean a combination of different optimizations methods. Hope this answers your question :)
johnrachwanpruna
changed discussion status to
closed
sharpenb
changed discussion status to
open
sharpenb
changed discussion status to
closed