GitHub repository: Guitaricet/relora
Primary language: Jupyter Notebook
Description: Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates