Patent ID: 11947908
Assignee: BAIDU USA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method for word embedding disentanglement comprising:
given an altered sequence comprising a plurality of context words related to at least one altered word, generating, using a prior neural network, a prior distribution for each context word;
generating, using an encoder, a word embedding for each context word conditioned on the prior distribution corresponding to the context word which was generated using the prior neural network, in which a distribution related to the word embedding is treated as a factorial member of an exponential family and information related to an exponential family prior is incorporated with the word embedding;
generating, using a decoder, a decoder output comprising one or more recovered words for the at least one altered word based on word embeddings of the plurality of context words; and
training at least one of the prior neural network, the encoder, and the decoder using an objective involving at least the decoder output and a ground-truth label comprising a text sequence and binary masks, wherein the altered sequence is constructed from the text sequence with a binary mask or masks on one or more words in the text sequence.