Patent ID: 11971824
Assignee: AETHERAI IP HOLDING LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 24:
25. A computing platform comprising:
a central processing unit (CPU);
at least one computational device connected to and coordinated by the CPU; and
computer-readable medium storing instructions that, when executed by the CPU, cause the CPU and the at least one computational device to perform acts comprising:
(a) calculating a working set size of every operation in a computational graph;
(b) categorizing the operations of the computational graph into multiple groups with at least one operation contained in each group and a total of the working set sizes of the at least one operation in the group less than a memory threshold of the at least one computational device;
(c) prefetching data associated with one selected from multiple examples of a dataset for executing a prefetch number of the groups N ahead of all others in the multiple groups to a corresponding computational device, wherein N is an integer greater than zero;
(d) sequentially selecting one of the multiple groups as a current group;
(e) simultaneously executing the at least one operation in the current group in the corresponding computational device and prefetching data associated with the example for executing a next group not yet prefetched to the corresponding computational device until both group execution and data prefetch are completed for the current group; and
(f) iterating the foregoing step (d) until the multiple groups are executed.