Patent ID: 9317112
Filing Date: 2016-04-19
CPC Classification: G06F,G06K,H04N

Claim Text:
1. On a computing device, a computer-implemented method for controlling a virtual environment, comprising: visually presenting, via a display, a representation of the virtual environment; receiving, from a depth camera, depth video imaging a human subject; recognizing a virtual skeleton that models the human subject with a plurality of virtual joints characterized by three-dimensional positions, the virtual skeleton derived from the depth video; using the virtual skeleton to identify a gesture performed by the human subject; recognizing an optical flow of the depth video, the optical flow derived from a plurality of cells mapped to the depth video, each cell having a motion value indicating a magnitude of motion in that cell recognized between consecutive image frames of the depth video; using the optical flow to assign a magnitude to the gesture performed by the human subject; and visually presenting, via the display, an updated representation of the virtual environment, the updated representation being modified based on the gesture, and the updated representation being modified in proportion to the magnitude.