8-bit Optimizers via Block-wise Quantization
Channel: Tim Dettmers
Date: 2021-10-07

This talk tells a little tale about 8-bit optimizers. 

Paper: https://arxiv.org/abs/2110.02861
Codebase: https://github.com/facebookresearch/bitsandbytes