Patent ID: 11861898
Assignee: KONINKLIJKE PHILIPS N.V.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. An augmented reality (AR) based servicing guidance device comprising:
a mobile device including a display, a processor, and a camera; and
a computer programmed to perform computer vision (CV) processing to generate AR content by operations including aligning at least a portion of the AR content with at least one location of interest (LOI) identified in a recorded video of the service call by a user input, wherein the CV processing comprises a Simultaneous Location and Mapping (SLAM) algorithm;
a server computer programmed to perform CV processing to align AR content with a live video feed captured by the camera of the mobile device, wherein the CV processing comprises a SLAM algorithm and wherein the aligned AR content includes a part number annotation, a computer aided design (CAD) drawing or CAD drawing portion, or a CAD animation aligned with a LOI identified in the live video feed by the CV processing; and
the processor of the mobile device is programmed to transmit the live video feed produced by the camera of the mobile device to the server computer and to receive the AR Content aligned with the live video feed from the sever computer and to display on the display of the mobile device the AR content aligned with the live video feed; and
the server computer is programmed to perform a servicing preview by performing the CV processing to align the AR content with preview video of how a step of the maintenance task is performed substituted for the live video feed produced by the camera of the mobile device and simultaneously displaying on the display of the mobile device both the AR content aligned with the preview video and the preview video displayed as an underlay of the AR content, the preview video displayed as an underlay of the AR content being a video to show how the maintenance steps are performed edited with the part number annotation, the CAD drawing or CAD drawing portion, or the CAD animation aligned with a LOI identified in the live video feed by the CV processing.