Patent Document ID: 9354711
Application ID: 14553752
Patent Status: 1

Claim One:
1. A method for localizing a region of interest in an ego-centric video using a dynamic hand gesture, comprising: capturing, by a processor, the ego-centric video containing the dynamic hand gesture; compensating, by the processor, for a drift of a head-mounted video device during the capturing of the ego-centric video; analyzing, by the processor, a frame of the ego-centric video to detect pixels that correspond to a fingertip using a hand segmentation algorithm; analyzing, by the processor, temporally one or more frames of the ego-centric video to compute a path of the fingertip in the dynamic hand gesture, wherein the analyzing temporally the one or more frames of the ego-centric video to compute the path of the fingertip comprises performing a localization on a frame-by-frame basis; localizing, by the processor, the region of interest based on the path of the fingertip in the dynamic hand gesture, wherein the region of interest is larger than the frame and the path is traced using a combination of the dynamic hand gesture and a movement of the head-mounted video device, wherein an object in the region of interest is stitched together to fit in the region of interest in one frame; and performing, by the processor, an action based on the object in the region of interest.