Patent ID: 11886542
Assignee: APPLE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. An electronic device, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving, at a first portion of a language model, an input;
obtaining, based on the input, a first output distribution from the first portion of the language model;
adjusting, using a first training model, the language model based on the first output distribution;
receiving, at a second portion of the language model, the first output distribution;
obtaining, based on the first output distribution, a first representation of the input from the second portion of the language model;
adjusting, using a second training model, the language model based on the first representation of the input; and

providing, using the adjusted language model, an output based on a received user input.