GitHub repository: AutumnAurelium/hackppo
Description: Experimental fork of torchtune designed around hackable PPO recipes