Patent ID: 12013985

Abstract:
Example systems, devices, media, and methods are described for controlling the presentation of a series of virtual or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined hand gesture. Each predefined hand gesture is associated with an action; for example, a leafing gesture is associated with a scrolling action. The system controls the display of a series of virtual elements, in accordance with the associated action. In an example series of hand shapes that includes flexing and extending the fingers of a single hand severally and continually in a leafing motion, the matching predefined leafing gesture is associated with a scrolling action, which displays the series of items in a display order, sequentially and in accordance with the detected speed of the moving fingers.