Patent ID: 11914836
Assignee: META PLATFORMS TECHNOLOGIES, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A system comprising: one or more processors; and a memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
access an image of a physical environment of a user, the image being associated with a perspective of the user and depicting a physical input device and a physical hand of the user;
determine that a contrast between the physical input device and the physical hand depicted in the image is lower than a predetermined threshold;
modify the image to increase the contrast between the physical input device and the physical hand depicted in the image, thereby improving a visual distinction between a first set of pixels associated with the physical hand and a second set of pixels associated with the physical input device in the image;
determine a pose of the physical input device;
generate a three-dimensional model representing the physical hand of the user;
generate an image mask by projecting the three-dimensional model onto an image plane associated with the perspective of the user;
generate, by applying the image mask to the modified image, a cropped image depicting at least the physical hand of the user in the image;
render, based on the perspective of the user and the pose of the physical input device, a virtual input device to represent the physical input device; and
display the cropped image depicting at least the physical hand of the user over the rendered virtual input device.