Patent ID: 11941528
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. The non-transitory computer readable medium of claim 7, further storing instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to:
assign each portion of the second weight gradients to each of a plurality of first exchange tasks;
store the plurality of first exchange tasks sequentially in a buffer;
receive an indication that a hardware interface is idle;
retrieve a first exchange task of the plurality of first exchange tasks from the buffer; and
execute the first exchange task based on:
causing the hardware interface to transmit the first portion of the second weight gradients assigned to the one of the plurality of first exchange tasks to the second computer system; and
receiving third weight gradients from the second computer system via the hardware interface.