GitHub repository: liangyuwang/zo2
Primary language: Python
Description: ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory