Patent ID: 11865444
Assignee: SNAP INC.
Field: nan (nan)
Classification: CPC nan | IPC A  G

Claim 16:
17. A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:
capturing frames of video data with a camera, wherein each frame of video data comprises depth information for a plurality of pixels, and wherein said camera is coupled to an eyewear device comprising a processor, a memory, a hand tracking utility, and a display;
presenting a game clock on said display at a location establishing a field of play, wherein said field of play is persistently viewable as an overlay relative to a physical environment, independent of movement of said eyewear device, and wherein said game clock is configured to increment from a start time to a final time;
detecting in said frames of video data, with said hand tracking utility, a final hand shape associated with said final time;
identifying a set of hand landmarks associated with said detected final hand shape, based on said depth information;
selecting a candidate hand gesture from a library of hand gestures based on said identified set of hand landmarks;
selecting a final virtual game piece from a set of virtual game pieces based on said selected candidate hand gesture;
presenting on said display said final virtual game piece as an overlay relative to said final hand shape;
broadcasting wirelessly said final virtual game piece;
detecting an opposing final virtual game piece; and
presenting on said display a game score based on said final virtual game piece versus said opposing final virtual game piece.