Patent ID: 9727790
Date: 2017-08-08
CPC Classifications: G02B,G06F,G06K,H04N,H04R,H04W

Claim:
1. An apparatus of a wearable computer with natural user interface comprising: a first portable unit including: an eyeglass frame to be worn by a user; at least one scene camera disposed on the eyeglass frame, having a configurable field of view, for capturing at least one scene image corresponding to a field of view of the user; at least one first eye tracking camera disposed on the eyeglass frame, having a configurable field of view, directed towards one eye of the user, for capturing at least a plurality of eye images corresponding to at least a portion of one eye of the user; at least one accelerometer disposed on the eyeglass frame for tracking at least a head movement of the user and generating at least one signal corresponding to at least a duration of the head movement of the user; at least one microphone disposed on the eyeglass frame for capturing at least a duration of the voice of the user; at least one light emitter disposed on the eyeglass frame, for providing at least a light feedback to the user via light; at least one bone conduction speaker disposed on the eyeglass frame for providing at least a voice feedback to the user via voice; and at least one processor disposed on the eyeglass frame: communicating with the at least one scene camera, the at least one first eye tracking camera, the at least one accelerometer, the at least one microphone, the at least one light emitter and the at least one conduction bone speaker, receiving at least one signal from the at least one accelerometer, maintaining at least one history of the user's head movement based on at least a portion of the received signal from the at least one accelerometer, receiving at least a plurality of eye images from the at least one first eye tracking camera, locating the pupil of the one eye of the user in the at least a plurality of the eye images received from the at least one first eye tracking camera and maintaining at least one history of the pupil location, utilizing the at least one maintained history of the pupil location and the at least one maintained history of the head movement of the user to determine an area within a field of view of the user, wherein the size of the field of view of the determined area within a field of view of the user is between the size of the foveal view and the size of the peripheral view, configuring the at least one scene camera to capture at least one scene image of the determined area within a field of view of the user, receiving the at least one scene image corresponding to the determined area within a field of view of the user from the at least one scene camera, and transmitting the at least one scene image; and a second portable unit including: a smartphone, wherein the smartphone communicating at least with the at least one processor disposed in the first portable unit and the smartphone being carried by the user, at least one user interface of a digital personal assistance app, wherein the app running on the smartphone and configured for communicating with the user at least via voice via the at least one microphone and the at least one conduction bone speaker, wherein the app further configured for: receiving the at least one scene image from the at least one processor disposed in the first portable unit, utilizing image processing to recognize as least one object in the at least one received scene image, and taking at least one action based on the at least one recognized object in the at least one received scene image.