GitHub repository: Klomgor/OpenDiloco
Description: OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training