Patent ID: 11886542
Assignee: APPLE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A computer-implemented method, comprising:, at an electronic device with one or more processors and memory:
receiving, at a first portion of a language model, an input;
obtaining, based on the input, a first output distribution from the first portion of the language model;
adjusting, using a first training model, the language model based on the first output distribution;
receiving, at a second portion of the language model, the first output distribution;
obtaining, based on the first output distribution, a first representation of the input from the second portion of the language model;
adjusting, using a second training model, the language model based on the first representation of the input; and
providing, using the adjusted language model, an output based on a received user input.