open-sourced codes for the edited framework of smoothquant for whisper
#1
by KukiFan - opened
Hello mohitsha,
I am a student currently learning how to use SmoothQuant to quantize Whisper. I noticed that SmoothQuant cannot be directly applied to Whisper out of the box. Would it be possible for you to open-source your code for quantizing Whisper-tiny with SmoothQuant?
Your work appears to be the only successful implementation of this so far. I really admire your ingenuity and would greatly appreciate your help!
Thank you so much!