Patent ID: 11928753
Assignee: INTEL CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system for providing segmentation in video comprising:
a memory to store a current video frame; and
one or more processors coupled to the memory, the one or more processors to:
generate a feature volume corresponding to the current video frame, the feature volume comprising the current video frame and at least one of a temporally previous video frame, a temporally previous segmentation frame, or an object of interest indicator frame comprising one or more indicators of an object of interest in the current video frame;
combine the feature volume with a plurality of feature frames each comprising features compressed from feature layers of a convolutional neural network as applied to the current video frame to generate a segmentation network input volume;
apply a first convolutional layer of a plurality of convolutional layers of a segmentation network to the segmentation network input volume;
combine the feature volume with a convolutional layer output volume from the first convolutional layer or a second convolutional layer of the convolutional layers to generate a convolutional layer input volume;
apply a third convolutional layer of the convolutional layers to the convolutional layer input volume to generate a second convolutional layer output volume; and
generate a current segmentation frame from the segmentation network based on the second convolutional layer output volume.