GitHub repository: zyushun/hessian-spectrum
Primary language: Jupyter Notebook
Created: 2024-02-26T06:10:37Z
Description: Code for the paper: Why Transformers Need Adam: A Hessian Perspective