Patent ID: 11868582
Assignee: LG ELECTRONICS INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A method, comprising:
obtaining a real image, by a camera, of a device to be controlled, wherein the real image is to be used to configure an augmented reality (AR)-based remote controller;
performing a recognition of the device from the real image, for detecting device information of the device, wherein the device information is used to detect a remote control (RC) protocol of the device;
detecting the remote control (RC) protocol of the device based on the recognition of the device, wherein the detecting of the RC protocol includes verifying whether the device is controllable through a candidate RC protocol by controlling the device in accordance with the real image;
augmenting the real image with a first user interface (UI) of the AR-based remote controller which controls the device based on the RC protocol; and
based on a determination that the device is out of a field of view of the camera and a determination that another application not related to the device to be controlled is being executed, displaying a reduced second user interface (UI) of the AR-based remote controller along with a screen of the another application being executed, wherein the reduced second UI of the AR-based remote controller is reduced in size compared to the first UI,
wherein performing the recognition of the device further includes:
receiving a type information of the device in accordance with a user input when the type of the device and a model name of the device are not recognized based on the real image;
displaying the first UI with the real image; and
adding the real image and the type information to a database.