Patent ID: 11875604
Assignee: META PLATFORMS TECHNOLOGIES, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method comprising, by a computing system:
receiving an image of a real-world environment, the image including at least a portion of a hand of a user of an artificial reality device, the hand comprising a palm and a plurality of fingers;
determining, using the image, a hand pose of the hand while the hand is interacting with a virtual object displayed by the artificial reality device;
determining a grab state indicating whether the hand of the user is grabbing the virtual object, wherein the grab state is determined by:
defining, based on the hand pose, a three-dimensional surface positioned in the palm of the hand, wherein the three-dimensional surface is (a) different than the virtual object the user is interacting with, (b) invisible to the user, and (c) is configured for determining the grab state of the hand;
determining distances between predetermined portions of the plurality of fingers and the three-dimensional surface; and
assigning, based on the distances, a pose value for each of the plurality of fingers of the hand, wherein the grab state is determined based on the pose value;

accessing, based on the virtual object and the grab state, one or more display poses representing an appearance of the hand interacting with the virtual object; and
displaying the one or more display poses to the user of the artificial reality device.