Patent ID: 9261966
Filing Date: 2016-02-16
CPC Classification: G06F,H04M

Claim Text:
1. A method of operation of a natural user interface system comprising: providing a display device having a display screen, a display device camera, a display device gyroscope, and a display device compass; providing a mobile device having a mobile device camera, a mobile device gyroscope, and a mobile device compass, an optical axis of the mobile device camera positioned at an angle to an optical axis of the display device camera; pairing the mobile device with the display device; determining an orientation of the display device with the display device gyroscope and the display device compass; determining an orientation of the mobile device with the mobile device gyroscope and the mobile device compass; synchronizing a viewing angle of the mobile device camera with the display device based on the orientation of the mobile device relative to the orientation of the display device; detecting a user's hand; determining posture and movement of the user's hand including: translating the posture and movement of the user's hand into a gesture for controlling an element of a user interface on the display screen.