INT8 Weight Only Quantization
#10
by
deleted
- opened
Hey @Hank012 - do you have any further details on how you've quantised the model? E.g. library, hyper parameters, etc? A reproducible code snippet would be awesome here!
Hey @Hank012 - do you have any further details on how you've quantised the model? E.g. library, hyper parameters, etc? A reproducible code snippet would be awesome here!