GitHub repository: CryVeck/QuaRot
Primary language: Python
Description: Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.