What is smashed?

#1
by supercharge19 - opened

What does it mean? Is it marketing term or new technique for quantization? Sorry, am busy so can't read paper right now, so if you could give TL;DR please?

Pruna AI org

smashed is basically used to designate that this is optimized by pruna. In the case for the current model it is raw GGUF as mentioned in the readme. For other models it could mean a combination of different optimizations methods. Hope this answers your question :)

johnrachwanpruna changed discussion status to closed
sharpenb changed discussion status to open
Pruna AI org

You can find a more detailed explanation here.

sharpenb changed discussion status to closed

Sign up or log in to comment