Patent ID: 11875256
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A system comprising:
a computer processing circuit; and
a computer-readable storage medium storing instructions, which, when executed by the computer processing circuit, are configured to cause the computer processing circuit to perform a method comprising:
performing decentralized distributed deep learning training on a batch of training data for a plurality of learners;
determining a training time wherein a learner, of the plurality of learners, performs the decentralized distributed deep learning training on the batch of training data;
generating, by the learner, a table comprising:
the training time; and
a plurality of other processing times wherein a corresponding plurality of other learners, of the plurality of learners, performs the decentralized distributed deep learning training on a corresponding plurality of other batches of other training data;
providing, by the learner, the table to a neighboring learner of the plurality of learners;

determining, by the learner, that the learner is a straggler by determining, using a table generated by a neighboring learner of the learner, that the training time is greater than each of the plurality of other processing times;
modifying a processing aspect of the learner to reduce a future training time of the learner for performing the decentralized distributed deep learning training on a new batch of training data in response to determining the learner is the straggler, wherein modifying the processing aspect comprises increasing a frequency rate of a computational circuit of the straggler; and
performing, by the learner, the decentralized distributed deep learning training on the new batch of training data in less time than the training time by using the modified processing aspect.