Patent Document ID: 10089743
Application ID: 15725374
Patent Status: 1

Claim One:
1. A segmentation device for segmenting an image by using a CNN, comprising: a communication part for acquiring or supporting another device to acquire an image of a frame from an inputted video; and a processor for performing or supporting another device to perform (i) a process of acquiring a first segmented image for a t-th frame by allowing a CNN_PREVIOUS to segment the image of the t-th frame, wherein the CNN_PREVIOUS is a CNN having at least one first weight learned at a t−(i+1)-th frame, (ii) a process of acquiring at least some optical flow images, selected among each of optical flow images which corresponds to each of a (t−1)-th frame to a (t−i)-th frame, wherein each of the optical flow images corresponding to each of the (t−1)-th frame to the (t−i)-th frame includes information on optical flows originating with individual pixels of the first segmented image and ending with their corresponding pixels of each of segmented images of the (t−1)-th frame to the (t−i)-th frame, where the segmented images of the (t−1)-th to the (t−i)-th frame are acquired using a CNN_PREVIOUS, (iii) a process of acquiring one or more warped images for the t-th frame by replacing first pixels with second pixels by referring to the optical flow images, wherein the first pixels include at least some pixels of the first segmented image for the t-th frame, and the second pixels include at least some pixels in at least some of the segmented images of the (t−1)-th frame to the (t−i)-th frame, (iv) a process of acquiring loss values by respective comparisons between the first segmented image and the warped images, (v) a process of acquiring a CNN_CURRENT, which is a CNN with at least one second weight having been obtained by adjusting the first weight of the CNN_PREVIOUS, by using at least one of the loss values, and (vi) a process of segmenting at least one image of at least one of (vi-1) the t-th frame and (vi-2) frames after the t-th frame by using the CNN_CURRENT; where “i” is a predetermined integer corresponding to a cardinal number of image frames placed between a frame at which CNN_PREVIOUS is acquired and a frame at which CNN_CURRENT is acquired.