Patent ID: 11875247
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. A method comprising:
performing a first direct memory access transfer to load a set of shared data from an external memory of an acceleration engine to a first buffer memory in a first accelerator of the acceleration engine;
performing a second direct memory access transfer to load the set of shared data that was stored in the external memory from the first buffer memory in the first accelerator to a second buffer memory in a second accelerator of the acceleration engine;
loading the set of shared data from the first buffer memory into a first compute engine of the first accelerator;
loading the set of shared data from the second buffer memory into a second compute engine of the second accelerator;
performing computations on a first batch of input data using the set of shared data in the first compute engine of the first accelerator; and
performing computations on a second batch of input data using the set of shared data in the second compute engine of the second accelerator,
wherein the set of shared data is retained in the first buffer memory until the set of shared data has been loaded into the first compute engine and loaded into the second buffer memory.