Patent ID: 11881038
Assignee: KIA CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. The system of claim 15, wherein:
in the local attention module MEALocal,
both adjacency matrices A1 and B1 of the MEALocal are identity matrices, and
in the neighboring attention module MEANeighbor,
adjacency matrices A2 and B2 of the MEANeighbor have the save form as a circulant matrix which is subjected to a convolution operation for the feature map F by using a convolution kernel with the size of k×k and all 1s as the element values, and wherein, a value of k is smaller than the width and the height of the feature map F, and
in the global attention module MEAGlobal,
values of adjacency matrices A3 and B3 of the MEAGlobal are randomly initialized, and trained with the entire network, in respect to calculation of AXWQ and WTKXTBT=(BXWK), two fully connected layers are respectively used on the feature vector dimension and the channel dimension,
the adjacency matrices A comprises the A1, the A2, and the A3,
the adjacency matrices B comprises the B1, the B2, and the B3, and
the adjacency matrices A1, A2, A3, B1, B2, and B3 are implemented by using a 1-dimensional convolution operation in which the size of the convolution kernel is 1×1, and the number of channels is N, and parameter matrices WQ and WK are implemented by using a 1-dimensional convolution operation in which the size of the convolution kernel is 1×1, and the number of channels is D.