Patent ID: 11875220
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. An apparatus for generating network representation for a neural network, the apparatus comprising:
a memory storing instructions; and
a processor in communication with the memory, wherein, when the processor executes the instructions, the processor is configured to cause the apparatus to:
obtain a source-side vector sequence corresponding to an input sequence,
perform linear transformation on the source-side vector sequence, to obtain a request vector sequence, a key vector sequence, and a value vector sequence corresponding to the source-side vector sequence,
calculate a logical similarity between the request vector sequence and the key vector sequence,
construct a local strength matrix according to the request vector sequence, perform nonlinear transformation based on the logical similarity and the local strength matrix, to obtain a local strength attention weight distribution corresponding to elements in the input sequence, and
fuse value vectors in the value vector sequence according to the local strength attention weight distribution, to obtain a network representation sequence corresponding to the input sequence.