Patent ID: 11915120
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A computing system, comprising:
at least one processor; and
at least one tangible, non-transitory computer-readable medium that stores instructions that, when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:
obtaining an input associated with a particular task; and
routing the input through a machine-learned model according to a respective routing matrix for a respective layer of the machine-learned model, the routing matrix activating one or more components of a plurality of components of the respective layer based on the particular task;
wherein the routing matrix was obtained by learning a connection probability matrix based on outputs from the plurality of components for the particular task;
wherein the routing matrix was obtained by, during training of the machine-learned model:
sampling binary values for a candidate routing matrix based on the connection probability matrix;
executing a forward pass using the candidate routing matrix; and
updating the connection probability matrix based on the forward pass.