Patent ID: 11954898
Assignee: SUPERB AI CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A testing method for detecting at least part of first object classes and second object classes by using an object detector that has been trained by transfer learning, comprising steps of:
(a) after a learning device has performed processes of: (I) on condition that (i) first training images including one or more first objects for training corresponding to the first object classes for training have been acquired from a first training data set, (ii) first feature maps for training have been outputted by applying at least one convolution operation to each of the first training images through at least one convolutional layer, (iii) first ROI proposals for training have been outputted, wherein the first ROI proposals for training have been acquired by predicting object regions for training in each of the first feature maps for training corresponding to each of the first training images through a first ROI (region of interest) proposal network, (iv) first pooled feature maps for training have been outputted, wherein the first pooled feature maps for training have been acquired by pooling each of regions for training corresponding to the first ROI proposals for training in each of the first feature maps for training through a pooling layer, (v) first FC outputs for training have been generated by applying first FC operation to the first pooled feature maps for training through a first FC (fully-connected) layer, (vi) pieces of first class prediction information for training and pieces of first regression prediction information for training corresponding to objects for training of the first training images have been outputted by applying second FC operation to the first FC outputs for training through a second FC layer, (vii) first class losses and first regression losses have been acquired by referring to pieces of first class GT (ground truth) information and pieces of first regression GT information corresponding to their corresponding pieces of the first class prediction information for training and pieces of the first regression prediction information for training, (viii) the first class losses and the first regression losses have been backpropagated and thus first parameters of the convolutional layer, second parameters of the first ROI proposal network, third parameters of the first FC layer and fourth parameters of the second FC layer have been trained, in response to acquiring second training images including at least one of second objects for training corresponding to the second object classes for training from a second training data set, instructing the convolutional layer having the first parameters trained in advance to output second feature maps for training by applying the convolution operation to each of the second training images; (II) (i) instructing each of the first ROI proposal network having the second parameters trained in advance and a second ROI proposal network having fifth parameters that have not been trained to perform a process of predicting object regions for training in each of the second training images by referring to each of the second feature maps for training, thereby outputting each of (2_1)-st ROI proposals for training and (2_2)-nd ROI proposals for training, and (ii) instructing the pooling layer to pool regions for training corresponding to each of the (2_1)-st ROI proposals for training and the (2_2)-nd proposals for training in each of the second feature maps for training, thereby outputting second pooled feature maps for training; (III) (i) instructing the first FC layer having the third parameters trained in advance to generate second FC outputs by applying the first FC operation to the second pooled feature maps for training, and (ii) instructing the second FC layer having the fourth parameters that have not been trained to apply the second FC operation on the second FC outputs for training, thereby outputting pieces of second class prediction information for training and pieces of second regression prediction information for training corresponding to objects for training on the second training images; and (IV) (i) acquiring second class losses and second regression losses by referring to pieces of the second class prediction information for training, pieces of the second regression prediction information for training and pieces of second class GT information and pieces of second regression GT information, respectively corresponding to pieces of the second class prediction information for training and pieces of the second regression prediction information for training, and (ii) backpropagating the second class losses and the second regression losses, thereby further training the fifth parameters of the second ROI proposal network that have not been trained, the third parameters of the first FC layer that have been trained in advance and the fourth parameters of the second FC layer that have not been trained, in response to acquiring a test image containing at least part of first objects for testing and second objects for testing corresponding to first object classes for testing and second object classes for testing, a testing device instructing the convolutional layer to apply the convolution operation to the test image, thereby outputting a feature map for testing;
(b) the testing device (i) instructing each of the first ROI proposal network and the second ROI proposal network to perform a process of predicting at least one of object regions for testing in the test image by referring to the feature map for testing, thereby outputting each of (2_1)-st ROI proposals for testing and (2_2)-nd ROI proposals for testing and (ii) instructing the pooling layer to pool regions for testing corresponding to each of the (2_1)-st ROI proposals for testing and the (2_2)-nd proposals for testing in each of the feature map for testing, thereby outputting a second pooled feature map for testing;
(c) the testing device (i) instructing the first FC layer to generate a second FC output for testing by applying the first FC operation on the second pooled feature map for testing, and (ii) instructing the second FC layer to output second class prediction information for testing and second regression prediction information for testing corresponding to objects for testing on the test image by applying the second FC operation to the second FC output for testing.