Patent ID: 11880979
Assignee: SAMSUNG ELECTRONICS CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. An apparatus with video segmentation, comprising:
a communication interface configured to acquire, over time, a video sequence comprising a plurality of image frames, the plurality of image frames including a second image frame corresponding to a time t of the video sequence and a first image frame corresponding to a time t−1 before the time t;
an encoder configured to extract a second feature vector from the second image frame;
a memory configured to store information related to the second image frame;
a recurrent neural network (RNN) configured to generate second hidden state information corresponding to the second image frame, based on first hidden state information corresponding to the first image frame and second fusion information in which the second feature vector is fused with the stored information related to the second image frame; and
a decoder configured to generate a second segmentation mask corresponding to the second image frame, based on an output vector corresponding to the second hidden state information, and output the second segmentation mask,
wherein the memory is configured to store a first feature vector corresponding to at least one object included in the second image frame, wherein the processor is further configured to:
generate second hidden state information corresponding to the second image frame, by using information related to the second image frame based on a relation between the first feature vector and the second feature vector, and
wherein the information related to the second image frame is determined to have a predetermined relation with the second image frame from among hidden state information of a plurality of the image frames corresponding to a time before the time t,, wherein the processor is further configured to:
determine a dissimilarity based on an entropy-based correlation between hidden state information stored in the memory and the second feature vector; and
store the second hidden state information in the memory, based on a result of comparing the dissimilarity to a preset reference value.