Patent ID: 11961292
Assignee: ABB S.P.A.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. A method for assisting a user in interacting with an electronic relay for electric power distribution grids, said electronic relay having a user-interface panel including one or more user-interface components configured to allow the user to interact with said electronic relay, wherein said method comprises:
activating a camera of a mobile computerized device;
showing images of said user-interface panel on a display of said mobile computerized device, said images being captured by said camera while the user frames said user-interface panel using said mobile computerized device;
processing said images to identify said user-interface components and physical features of said user-interface panel, the identification of said user-interface components and the physical features including a comparison of said images with predefined models of user-interface panels;
based on the identification of said user-interface components and the physical features, showing first augmented reality features on said display, said first augmented reality features being configured to assist the user in framing said user-interface panel using said mobile computerized device, said first augmented reality features being shown superimposed to said images on said display;
based on the identification of the user-interface components and the physical features of the user-interface panel, sampling one or more image portions of said user-interface panel captured during an observation time interval, in which the user frames said user-interface panel using said mobile computerized device;
processing the sampled image portions of said user-interface panel to identify one or more light signals emitted by one or more of said user-interface components of said user-interface panel, the identification of said light signals including a detection of sequences of light pulses emitted by said user-interface components and a comparison of the detected sequences of light pulses with predefined sequences of light pulses that can be emitted by said user-interface components; and
based on the identification of said light signals, showing on said display, first information describing the identified light signals emitted by said user-interface components.