GitHub repository: ElleLeonne/Lightning-ReLoRA
Primary language: Python
Description: A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.