Patent ID: 11868521
Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A device for determining a gaze position of a user that is applied to a terminal with a display screen, the device including a processor and a storage device for storing computer executable instructions that, when executed by the processor, cause the processor to perform operations comprising:
obtaining a target distance from the display screen to a target user;
obtaining a user image of the target user, the user image including a global image, a head image, and an eye image, and the global image being an image of a target space in front of the display screen;
determining a first space where eyes of the target user are located from a plurality of preset subspaces within the target space based on the target distance and the global image; and
determining a gaze position of the target user on the display screen corresponding to the first space and the user image of the target user, based on a preset correspondence among the subspaces, user images, and screen coordinates on the display screen,
wherein the processor performs operations further comprising obtaining a prediction result by:
determining a pre-trained hierarchical coordinate prediction model for the first space, where each of the subspaces have a pre-trained hierarchical coordinate prediction model which has been trained based on user images, screen coordinates of the gaze position of the user on the display screen, and a plurality of preset hierarchies; and
inputting the user image of the target user into the hierarchical coordinate prediction model for several times based on the number of hierarchies corresponding to the hierarchical coordinate prediction model to obtain the gaze position of the target user on the display screen under the corresponding hierarchy for each time,
wherein, the larger the number of the hierarchy, the more sub-areas into which the display screen is divided,
wherein the processor performs operations further comprising obtaining a prediction result by:
determining a pre-trained hierarchical coordinate prediction model for the first space, where each of the subspaces have a pre-trained hierarchical coordinate prediction model which has been trained based on user images, screen coordinates of the gaze position of the user on the display screen, and a plurality of preset hierarchies; and
inputting the user image of the target user into the hierarchical coordinate prediction model for several times based on the number of hierarchies corresponding to the hierarchical coordinate prediction model to obtain the gaze position of the target user on the display screen under the corresponding hierarchy for each time,
wherein, the larger the number of the hierarchy, the more sub-areas into which the display screen is divided.