GitHub repository: viliamvolosv/Lightning-ReLoRA
Description: A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.