Patent ID: 11907637
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. The method of claim 6, wherein the reflective decoding subnetwork further comprises a visual attention module, the visual attention module comprises a first long short-term memory (LSTM) network, a second LSTM network, and an attention mechanism network, and determining the word vector corresponding to the target region feature in the first image feature using the (M+1)th reflective decoding subnetwork comprises:
multiplying a word vector outputted by the (M+1)th reflective decoding subnetwork at a previous moment by a first weight matrix, to obtain a target word vector;
performing feature extraction on the second image feature and the target word vector using the first LSTM network, to determine a first hidden state of the first LSTM network;
inputting the first hidden state and the first image feature into the attention mechanism network for visual matching, to obtain the target region feature;
performing feature extraction on the first hidden state and the target region feature using the second LSTM network, to determine a second hidden state of the second LSTM network; and
determining the word vector corresponding to the target region feature according to the first hidden state and the second hidden state.