Patent ID: 11922287
Assignee: BAIDU.COM TIMES TECHNOLOGY (BEIJING) CO., LTD.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 11:
12. A non-transitory computer-readable medium or media comprising one or more sequences of instructions which, when executed by at least one processor, causes steps for multi-objective ranking comprising:
converting features from one or more data sources into embeddings;
receiving, at a multi-gate mixture of experts (MMoE) layer comprising multiple experts and a gating network, the embeddings corresponding to one or more states and one or more actions, wherein each expert is a neural network;
generating, by each of multiple experts using soft actor critic (SAC), a prediction based on an input, each expert output related to one or more prediction parameters corresponding to one or more actions;
obtaining a weighted sum of the expert outputs by the multiple experts, in accordance with weights generated by the gating network for the experts, in which each expert has a corresponding weight obtained from the gating network; and
generating a prediction output based on the weighted sum,
wherein a training process comprises:
regarding each action as a task;
adding an entropy-regularized term to a policy function; and
learning policy parameters by minimizing a Kullback-Leibler divergence between the policy function and a quotient obtained by dividing an exponential of a soft-Q function and a partition function.