Patent ID: 11868895
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. The computer-implemented method of claim 1, further comprising:
identifying a second tensor operation in the neural network model, the second tensor operation and the first tensor operation having no data dependency;
dividing the second tensor operation into a second set of sub-operations, wherein each sub-operation of the second set of sub-operations generates a portion of a final output of the second tensor operation;
generating instructions for performing, in parallel with performing the set of sub-operations of the first tensor operation, individual sub-operations of the second set of sub-operations on respective computing engines of a second plurality of computing engines; and
generating instructions for making an inference based on a result of the first tensor operation and a result of the second tensor operation.