Patent ID: 11900921
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A system comprising:
a first device including at least one processor, and at least one memory including instructions that, when executed by the at least one processor, cause the first device to:
receive first input data corresponding to a first input;
process a first portion of the first input data using a second portion of a first machine learning (ML) model, wherein the second portion of the first ML model comprises a first node of the first ML model;
determine, based at least in part on processing the first portion of the first input data using the second portion of the first ML model, first embedding data representing a partial speech recognition output of the second portion of the first ML model;
determine, based at least in part on the first embedding data, a second device is to complete the processing of the first input data; and
in response to determining the second device is to complete the processing of the first input data, and prior to processing the first embedding data using a third portion of the first ML model, send the first embedding data to the second device to complete the processing of the first input data using a second ML model, wherein:
the third portion of the first ML model comprises a second node of the first ML model,
the first ML model and the second ML model are configured to perform a first type of processing, and
sending the first embedding data to the second device causes the second device to complete the first type of processing of the first input data using the second ML model to determine a response to the first input.