Patent Document ID: 9953437
Application ID: 15786680
Patent Status: 1

Claim One:
1. A method for constructing a table including information on a pooling type based on ranges of scale of at least one object in at least one image for constructing table, comprising steps of: (a) a table-constructing device acquiring or supporting another device to acquire the image for constructing table including the object as an input for a CNN with adjusted parameters, wherein the adjusted parameters have been acquired by a learning device performing processes of (i) dividing an area in one or more feature maps for training corresponding to a region of interest (ROI) for training into multiple sub-regions if the one or more feature maps for training are generated as a result of applying convolution operations to the training image, and if the region of interest (ROI) for training is acquired from a Region Proposal Network (RPN); (ii)(ii-1) generating a first pooled feature map for training by applying one or more max pooling operations to one or more areas, corresponding to the ROI for training, in the one or more feature maps, wherein each of the max pooling operations selects a pixel with the maximum pixel value among all pixels in each of the multiple sub-regions and (ii-2) generating a second pooled feature map for training by applying one or more avg pooling operations to one or more areas, corresponding to the ROI for training, in the one or more feature maps, wherein each of the avg pooling operations averages all the pixel values included in each of the multiple sub-regions; and (iii)(iii-1) allowing a first FC layer to acquire information on pixel data of a first candidate bounding box for training by applying regression operations to the first pooled feature map for training, and allowing a first loss layer to acquire first comparative data by comparing between information on the pixel data of the first candidate bounding box for training and that of a bounding box of a first GT image, thereby using the first comparative data to adjust at least one of parameters of the CNN during a backpropagation process, and (iii-2) allowing a second FC layer to acquire information on pixel data of a second candidate bounding box for training by applying regression operations to the second pooled feature map for training, and allowing a second loss layer to acquire second comparative data by comparing between information on the pixel data of the second candidate bounding box for training and that of the bounding box of the first GT image, thereby using the second comparative data to adjust at least one of parameters of the CNN during a backpropagation process; (b) the table-constructing device allowing the plurality of convolutional layers to apply the convolution operations to the image for constructing table to thereby acquire one or more feature maps for constructing table, and allowing the RPN to perform certain operations on the at least one of feature maps for constructing table to thereby acquire an ROI for constructing table; (c) the table-constructing device (c-1) generating a first pooled feature map for constructing table by applying one or more max pooling operations to one or more areas, corresponding to the ROI for constructing table, in the one or more feature maps and (c-2) generating a second pooled feature map for constructing table by applying one or more avg pooling operations to one or more areas, corresponding to the ROI for constructing table, in the one or more feature maps; and (c-3) allowing the first FC layer to acquire information on pixel data of a first candidate bounding box for constructing table by applying regression operations to the first pooled feature map for constructing table, and (c-4) allowing the second FC layer to acquire information on pixel data of a second candidate bounding box for constructing table by applying regression operations to the second pooled feature map for constructing table; and (d) the table-constructing device comparing a first degree of similarity between the first candidate bounding box for constructing table and a bounding box in a second GT image with a second degree of similarity between the second candidate bounding box for constructing table and the bounding box in the second GT image to thereby construct the table so as to include information on respective optimal pooling types by respective ranges of the scale of the object in the second GT image or the object in the image for constructing table.