Patent ID: 11887330
Assignee: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method of assisting object registration in a smart home system comprising a plurality of home devices, performed by a computing device, the method comprising:
controlling, by the computing device, a user terminal to display a first screen that requests a user to select one home device from the plurality of home devices;
receiving, by the computing device, from the user terminal, a selection of the home device;
controlling, by the computing device, the user terminal to display a second screen that requests the user to perform a plurality of pointing gestures toward the selected home device;
capturing, by a camera, in response to performing the plurality of pointing gestures by the user within a field of view (FOV) of the camera, the plurality of pointing gestures;
configuring a pointing ray using each of the plurality of captured pointing gestures;
estimating a position of a nearest point extending from the plurality of pointing rays; and
registering the estimated position of the nearest point as a position of the selected home device,
wherein the configuring of the pointing ray using each of the plurality of captured pointing gestures comprises:
identifying a head position of the user from a corresponding captured gesture;
identifying a hand position of the user from a corresponding captured gesture;
defining a gesture-direction vector using the identified head position of the user and the identified hand position of the user; and
configuring the pointing ray using the head position of the user and the gesture-direction vector, and
wherein the configuring of the pointing ray using the head position of the user and the gesture-direction vector comprises configuring the pointing ray using the following equation:

rn=Pn+an·un 

where n denotes an index indicating a pointing ray number, rn denotes an n-th pointing ray, Pn denotes a head position of the user used to configure the n-th pointing ray, an denotes a scalar parameter used to configure the n-th pointing ray, and un denotes a gesture-direction vector used to configure the n-th pointing ray.