Patent Publication Number: US-2023156161-A1

Title: Failure identification and handling method, and system

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
     This is a continuation of International Application No. PCT/JP2021/027277 filed on Jul. 21, 2021, which claims priority to Chinese Patent Application No. 202010709092.6, filed on Jul. 22, 2020. The entire disclosures of these applications are incorporated by reference herein. 
    
    
     BACKGROUND 
     Technical Field 
     The present invention relates to the field of machine maintenance, and more specifically to a failure identification and handling method and system. 
     Background Art 
     With the development of science and technology and the improvement of living standards, various electronic devices or electric devices have been widely applied in various fields. When a failure occurs in a device, a user or an after-sales service person usually views a failure code displayed on a panel of the device at a site, and then retrieves failure-related information corresponding to the failure code from a maintenance manual to confirm or eliminate the failure. However, such a method is time-consuming and if the failure is rather complicated, the user cannot confirm or eliminate the failure by himself or herself, and needs to contact an after-sales service person to request a visiting service, thereby taking longer time and affecting the normal use of the device. In addition, the failure-related information and the elimination method described in the maintenance manual are not intuitive, which affects the accuracy of failure confirmation and the efficiency of failure elimination. 
     In recent years, a method of confirming a failure by identifying information has been proposed. 
     For example, a camera collection module captures an LED lamp group image by a camera and transmits the LED lamp group image to a failure position identification, the failure collection and the failure identification module, so that the failure position identification, the failure collection and the failure identification module performs image identification and analysis on the LED lamp group image to obtain the specific state information of the hardware circuit, analyzes a failure on the basis of a lamp group encoding information base, obtains an analysis result of the hardware circuit, and then performs feedback. 
     In addition, for example, a digital camera is used to capture an image such as a system error code displayed on a display unit of a user computer, and the image is transmitted to a failure recovery process server by a mobile phone. The server detects the system error code on the basis of the image, obtains failure content information associated with the error code from a database, and transmits the failure content information to the mobile phone. 
     Further, for example, if a two dimensional code is displayed on the panel of the device together with the failure code, the user can quickly access the homepage containing the maintenance information after scanning the two dimensional code, and thus obtain the failure and maintenance information. 
     It should be noted that the above-described introduction to the technical background is merely intended to facilitate a clearer and complete description of the technical solutions of the present disclosure, and to facilitate understanding of those skilled in the art. Only with the description of these technical solutions in Background Art of the present disclosure, the above-described technical solutions are not considered to be known to those skilled in the art. 
     SUMMARY 
     A first aspect of the embodiment of the present disclosure provides a failure identification and handling method including capturing video including a failure code, identifying the failure code in the video and obtaining an identified failure code, determining failure related information corresponding to the failure code based on the identified failure code and generating display data based on the failure related information, and displaying the failure related information based on the display data. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG.  1    is a schematic diagram of a failure identification and handling method according to a first embodiment of the present disclosure. 
         FIG.  2    is a schematic diagram of a display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  3    is a schematic diagram of the display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  4    is a schematic diagram of another display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  5    is a schematic diagram of the other display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  6    is a schematic diagram of still another display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  7    is a schematic diagram of the still other display type for a failure code according to the first embodiment of the present disclosure. 
         FIG.  8    is a schematic diagram of an implementation method of Step  102  according to the first embodiment of the present disclosure. 
         FIG.  9    is a schematic diagram of another implementation method of Step  102  according to the first embodiment of the present disclosure. 
         FIG.  10    is a schematic diagram of still another implementation method of Step  102  according to the first embodiment of the present disclosure. 
         FIG.  11    is a schematic diagram of superimposed adjacent frames of the video according to the first embodiment of the present disclosure. 
         FIG.  12    is a schematic diagram of a failure identification and handling system according to a second embodiment of the present disclosure. 
         FIG.  13    is a schematic diagram of the failure identification and handling system according to the second embodiment of the present disclosure performing a corresponding method. 
         FIG.  14    is a schematic view of an embodiment of an identification unit according to the second embodiment of the present disclosure. 
         FIG.  15    is a schematic view of another embodiment of the identification unit according to the second embodiment of the present disclosure. 
         FIG.  16    is a schematic diagram of a second identification module according to the second embodiment of the present disclosure. 
         FIG.  17    is a schematic view of another embodiment of the identification unit according to the second embodiment of the present disclosure. 
         FIG.  18    is a schematic diagram of a fourth identification module according to the second embodiment of the present disclosure. 
         FIG.  19    is a schematic diagram of a terminal device according to a third embodiment of the present disclosure. 
     
    
    
     DETAILED DESCRIPTION OF EMBODIMENT(S) 
     Hereinafter, preferred embodiments of the present disclosure will be described with reference to the drawings. 
     First Embodiment 
     A first embodiment of the present disclosure provides a failure identification and handling method.  FIG.  1    is a schematic diagram of a failure identification and handling method according to the first embodiment of the present disclosure. As illustrated in  FIG.  1   , the method includes 
     Step  101 : capturing video including a failure code, 
     Step  102 : identifying the failure code in the video and obtaining an identified failure code, 
     Step  103 : determining the failure-related information corresponding to the failure code on the basis of the identified failure code, and generating display data on the basis of the failure-related information, and 
     Step  104 : displaying the failure-related information on the basis of the display data. 
     In this manner, video including a failure code is captured and the failure code is identified on the basis of the video, whereby a complete failure code can be accurately identified without being limited by the failure code display type or the image acquisition parameters. Thus, it is possible to obtain failure-related information quickly and accurately on the basis of the identified complete and accurate failure code. 
     In the first embodiment of the present disclosure, the device using this method may be various devices capable of displaying a failure code, such as various industrial devices or various household devices, for example. Examples thereof include devices such as an air conditioner, a washing machine, a refrigerator, and a water heater. When a failure occurs in the device, a failure code is displayed on a display panel of the device. 
     In the first embodiment of the present disclosure, the manufacturer of the device may indicate a failure code in various ways. For example, the failure code may be composed of at least one of numbers, alphabets, and symbols, and the number of digits thereof may be one or more. The manufacturer of the device may set the specific display format and number of digits of the failure code in accordance with actual needs. 
     At Step  101 , video including a failure code is captured. In the first embodiment of the present disclosure, Step  101  may be performed by a terminal device. That is, the video may be captured by a terminal device. For example, the terminal device may be a smartphone, an intelligent tablet, or intelligent glasses. The intelligent tablet may be a tablet terminal (tablet-type information communication terminal). The intelligent glasses may be smart glasses (glasses-type information communication terminal). 
     In the first embodiment of the present disclosure, for example, the captured video is generated by capturing a display panel area of the device, and a failure code may be displayed on the display panel. For example, the display panel may be a control panel or another display panel of the device. 
     For example, the failure code is displayed in a failure display area of the display panel. 
     In the first embodiment of the present disclosure, the display panel on which a failure code is displayed may be various kinds of display screens. For example, it may be a liquid crystal display screen or a digital tube display screen. 
     In the first embodiment of the present disclosure, the method may be applied to various failure code display types. 
     In addition, the time length of the captured video may be determined in accordance with actual needs. For example, it may be determined by a failure code display type. 
     Hereinafter, failure code display types will be exemplarily described, but the first embodiment of the present disclosure is not limited by these display types. 
     For example, a failure code may be displayed in a certain period of time and not displayed in a certain period of time in a continuous cycle. In that case, the captured video may include a period of time in which a failure code is displayed. 
       FIG.  2    and  FIG.  3    are schematic diagrams of a display type for a failure code according to the first embodiment of the present disclosure. As illustrated in  FIG.  2   , the failure code is displayed as “A9-01” in a certain period of time. As illustrated in  FIG.  3   , the failure code is not displayed in a certain period of time. 
     Further, for example, a part of a failure code may be displayed in a certain period of time, and the remaining part thereof may be displayed in another period of time in a continuous cycle. In that case, the captured video may include a period of time in which a part of the failure code is displayed and another period of time in which the remaining part of the failure code is displayed. 
       FIG.  4    and  FIG.  5    are schematic diagrams of another display type for a failure code according to the first embodiment of the present disclosure. As illustrated in  FIG.  4   , a part of the failure code is displayed as “J5” in a certain period of time. As illustrated in  FIG.  5   , the remaining part of the failure code is displayed as “-01” in another period of time. 
     In the first embodiment of the present application, the part of the failure code may be referred to as an error code and indicate a failed member, while the remaining part thereof may be referred to as a detailed code and indicate detailed contents of the failure. The error code and the detailed code are combined into one complete failure code. For example, “J5” in  FIG.  4    indicates an error code, and “-01” in  FIG.  5    indicates a detailed code. The combination of both indicates a complete error code “J5-01”. 
     Further, for example, the failure code may be displayed by a digital tube, and may be displayed with blinking at a predetermined frequency on the basis of the display principle of the digital tube. In that case, the time length of the captured video may be any suitable time length, and may be, for example, several seconds for collecting a plurality of frames to identify a failure code. 
       FIG.  6    and  FIG.  7    are schematic diagrams of another display type for a failure code according to the first embodiment of the present disclosure. Since the digital tube displays a failure code with blinking at a predetermined frequency, the failure code “J5” is displayed at the time as illustrated in  FIG.  6   , and the failure code “J5” is incompletely displayed at the time as illustrated in  FIG.  7   . 
     At Step  102 , the failure code in the video is identified to obtain the identified failure code. In the first embodiment of the present disclosure, a local terminal device may perform Step  102 , or a terminal device may transmit the video data to a remote server, such as a cloud server, for example, so that the server performs Step  102 . 
     The following will specifically and exemplarily describe Step  102  with respect to each of the different display types for a failure code. 
     For example, in the display system in which a failure code is displayed in a certain period of time and not displayed in a certain period of time in a continuous cycle, that is, in the example illustrated in  FIGS.  2  and  3   , each frame of the video can be sequentially identified at Step  102 . 
       FIG.  8    is a schematic diagram of an implementation method of Step  102  according to the first embodiment of the present disclosure. As illustrated in  FIG.  8   , the step of identifying one frame of the video includes 
     Step  801 : calculating an average value of pixel values of all pixel points in a failure code display area of the frame, 
     Step  802 : determining, when the average value satisfies a predetermined condition, that the failure code display area includes a failure code, and 
     Step  803 : identifying the failure code display area including the failure code by using a preliminarily trained first identification model so as to obtain the identified failure code. 
     At Step  802 , the predetermined condition may be determined by a difference in display between the failure code and the background of the display area. For example, when the background of the display area is dark and the displayed failure code is bright, the predetermined condition is that the average value of pixel values is larger than a predefined threshold. Further, for example, when the background of the display area is bright and the displayed failure code is dark, the predetermined condition is that the average value of pixel values is smaller than a predefined threshold. Here, the predefined threshold may be determined by a pixel value of the background of the display area. 
     The first identification model used at Step  803  is a model obtained by training using training data. For example, the first identification model is obtained by training a neural network by using training data. The neural network may have a structure of a neural network in the related art. 
     In the first embodiment of the present disclosure, when the average value does not satisfy a predetermined condition, it is determined that the failure code display area does not include a failure code, and no processing is performed on the image of the one frame. 
     In the first embodiment of the present disclosure, if each frame is identified and then the failure codes obtained by identifying the frames match, the failure code is considered to be an identification result, while if the failure codes obtained by identifying the frames do not match, a failure code identified from more frames may be considered to be an identification result. 
     Further, for example, in the display type in which a part of a failure code is displayed in a certain period of time and the remaining part of the failure code is displayed in another period of time in a continuous cycle, that is, in the example of  FIGS.  4  and  5   ,  FIG.  9    is a schematic diagram of another implementation method of Step  102  according to the first embodiment of the present disclosure. As illustrated in  FIG.  9   , the method includes 
     Step  901 : sequentially identifying each frame of the video so as to obtain a first partial failure code and a second partial failure code that are identified, and 
     Step  902 : combining the first partial failure code and the second partial failure code into a complete failure code as an identified failure code. 
     In this manner, it is possible to identify the display of a complete failure code including different parts at different times, and thus obtain accurate failure-related information. 
     For example, each frame of the video is sequentially identified, whereby the first partial failure code “J5” in  FIG.  4    and the second partial failure code “-01” in  FIG.  5    are obtained, and the first partial failure code “J5” and the second partial failure code “-01” are combined into a complete failure code “J5-01”. 
     Here, the step of identifying a frame of the video is similar to Steps  801  to  803 , that is, the step includes
     calculating an average value of pixel values of all pixel points in a failure code display area of the frame,   determining, when the average value satisfies a predetermined condition, that the failure code display area includes a failure code, and   identifying the failure code display area including the failure code by using a preliminarily trained first identification model so as to obtain the identified first partial failure code or the identified second partial failure code.   

     In the first embodiment of the present disclosure, which part of the failure code is placed in the front end as the first partial failure code may be determined in accordance with actual needs. For example, a partial failure code including an identified alphabet may be placed in the front end as the first partial failure code. Further, for example, a partial failure code not including an identified symbol may be placed in the front end as a first partial failure code, while a partial failure code including an identified symbol, such as a partial code including the symbol “-”, for example, may be placed in the rear end as a second partial failure code. 
     Further, for example, in the display type in which a failure code is displayed with blinking at a certain frequency by the digital tube, that is, in the example of  FIGS.  6  and  7   ,  FIG.  10    is a schematic diagram of still another implementation method of Step  102  according to the first embodiment of the present disclosure. As illustrated in  FIG.  10   , the method includes 
     Step  1001 : superimposing adjacent frames or interval frames of the video on the basis of a predetermined weight value so as to obtain a plurality of superimposed frames, and 
     Step  1002 : identifying a failure code on the basis of the plurality of superimposed frames. 
     In this manner, it is possible to solve the defect that a failure code cannot be accurately displayed in a single image, accurately confirm a failure code, and obtain accurate failure-related information. 
     At Step  1001 , adjacent frames or interval frames of the video may be superimposed two by two on the basis of a weight value, the interval frames being two interval frames separated by a predetermined number of frames. 
     In the first embodiment of the present disclosure, a weight value for superposition may be set in accordance with actual needs. For example, when the average of weight values is 0.5, the pixel values of the corresponding pixel points in two adjacent frames or two separated frames are thus averaged. Further, for example, when the average of the weight values is 1, the pixel values of the corresponding pixel points in two adjacent frames or two separated frames are thus added. 
     In the first embodiment of the present disclosure, in the display type in which a part of a failure code is displayed in a certain period of time and the remaining part of the failure code is displayed in another period of time in a continuous cycle, Step  1002  includes sequentially identifying each of the superimposed frames so as to obtain a first partial failure code and a second partial failure code that are identified, and combining the first partial failure code and the second partial failure code into a complete failure code as an identified failure code. 
       FIG.  11    is a schematic diagram of superimposed adjacent frames of the video according to the first embodiment of the present disclosure. As illustrated in  FIG.  11   , among the six frame images included in the video, the images in the second frame, the third frame, and the fifth frame have a captured failure code that is incomplete due to the blinking of the digital tube. Superimposition related to addition of pixel values is performed on two adjacent frames. With the first frame and the second frame superimposed, the first partial failure code “LC” is identified. With the third frame and the fourth frame superimposed, no normal failure code is identified, and thus it is discarded. With the fifth frame and the sixth frame superimposed, the second partial failure code “-14” is identified. By combining the first partial failure code “LC” and the second partial failure code “-14”, a complete failure code “LC-14” is obtained. 
     In the first embodiment of the present disclosure, Step  102  may further include, prior to the identification, a step of dividing the video so as to obtain each frame of the video and determining a failure code display area for each frame of the video. 
     In this manner, it is possible to determine a failure code display area for each frame, and thus facilitate identification of a failure code in the failure code display area. 
     In the first embodiment of the present disclosure, for example, it is possible to determine the position of the failure code display area on the basis of the predetermined positional relation between the failure code display area and the display panel displaying the failure code, or determine the position of the failure code display area by using a preliminarily trained second identification model. 
     For example, an area captured by video is substantially the area of the display panel, and the position of the failure code display area is determined on the basis of the predetermined positional relation of the failure code display area on the display panel. 
     For example, the second identification model may be a neural network, and the neural network may have a structure of a neural network in the related art. 
     In the first embodiment of the present disclosure, the failure code is identified at Step  102 , and then failure-related information corresponding to the failure code is determined at Step  103  on the basis of the identified failure code, and display data is generated on the basis of the failure-related information. In the first embodiment of the present disclosure, a local terminal device may perform Step  103 , or a server may perform Step  103 . 
     In the first embodiment of the present disclosure, a failure information database may be preliminarily established. The failure information database stores information related to failures of various devices, and the failure-related information corresponds to the kind, a model number, and a failure code of the device. 
     In the first embodiment of the present disclosure, the failure-related information corresponding to a failure code may include a failure content corresponding to the failure code and/or a first model of a device in which a failure occurs. The first model is a two dimensional model or a three dimensional model capable of representing each member of the device. 
     In the first embodiment of the present disclosure, the failure content may include information of a failed position or member and/or the corresponding after-service maintenance information. For example, the after-service maintenance information may include a maintenance method and steps, and may further include, for example, information such as costs associated with replacement of members. 
     At Step  103 , a search is conducted on the failure information database so as to determine failure-related information corresponding to the failure code on the basis of the identified failure code, and display data is generated on the basis of the failure-related information, the display data being display data capable of displaying the failure-related information. 
     At Step  104 , the failure-related information is displayed on the basis of the display data. In the first embodiment of the present disclosure, when a local terminal device performs Step  104 , and a server performs Step  103 , the server may transmit the generated display data to the terminal device. 
     In the first embodiment of the present disclosure, the failure-related information may be displayed in various systems. For example, the failure content represented by characters may be displayed on a screen, or the failure content represented by the combination of characters and graphics may be displayed on a screen, or a model of the device capable of representing the failure content by a system of combining truth/falsehood may be displayed. In the first embodiment of the present disclosure, the method of displaying the failure-related information is not limited. 
     For example, at Step  104 , a second model of the device capable of representing a failure content may be displayed on the basis of the display data, the second model being formed on the basis of the first model of the device. In this manner, it is possible to intuitively indicate the structure of the device and the position of a failure, thereby improving the efficiency of failure determination and failure elimination. 
     For example, the second model is a two dimensional model or a three dimensional model capable of representing each member of the device and representing a failed position or member in an emphasized manner. 
     For example, the second model is displayed by a system of augmented reality, an image, or a moving image. In this manner, it is possible to grasp the failure-related information more intuitively, thereby further improving the efficiency of failure determination and failure elimination. 
     For example, the second model displays a failed position or member in a different color. In this manner, it is possible to grasp the failure-related information more intuitively, thereby further improving the efficiency of failure determination and failure elimination. 
     In the first embodiment of the present disclosure, after-service maintenance information among the failure-related information may be displayed. For example, the maintenance method or steps may be displayed by a system of a moving image, or video. Display of after-service maintenance information further improves the efficiency of failure elimination. 
     As is understood from the above-described first embodiment, video including a failure code is captured and the failure code is identified on the basis of the video, whereby the complete failure code can be accurately identified without being limited by the failure code display type or the image acquisition parameters. Thus, it is possible to obtain failure-related information quickly and accurately on the basis of the identified complete and accurate failure code. 
     Second Embodiment 
     A second embodiment of the present disclosure provides a failure identification and handling system corresponding to the failure identification and handling method described in the first embodiment. For the concrete implementation thereof, the implementation of the method described in the first embodiment may be referred to, and the same or related contents will not be described herein any further. 
       FIG.  12    is a schematic diagram of a failure identification and handling system according to the second embodiment of the present disclosure. As illustrated in  FIG.  12   , a failure identification and handling system  1200  includes 
     an imaging unit  1201  that captures video including a failure code, 
     an identification unit  1202  that identifies a failure code in the video and obtains an identified failure code, 
     a determination unit  1203  that determines failure-related information corresponding to the failure code on the basis of the identified failure code, and generates display data on the basis of the failure-related information, and 
     a display unit  1204  that displays the failure-related information on the basis of the display data. 
     In the second embodiment of the present disclosure, as illustrated in  FIG.  12   , the failure identification and handling system  1200  may include a terminal device  1210  and a server  1220 , and the terminal device  1210  may include the imaging unit  1201  and the display unit  1204 , while the server  1220  may include the identification unit  1202  and the determination unit  1203 . 
     Moreover, as illustrated in  FIG.  12   , the terminal device  1210  further includes 
     a first transmission unit  1205  that transmits the video to the server  1220 , and 
     a first reception unit  1206  that receives display data from the server  1220 , and 
     the server  1220  further includes
         a second reception unit  1207  that receives video including a failure code captured by the terminal device  1210  from the terminal device, and   a second transmission unit  1208  that transmits the display data to the terminal device  1210 .       

     In the second embodiment of the present disclosure, the terminal device  1210  may be various kinds of terminal devices. For example, the terminal device may be a smartphone, an intelligent tablet, or intelligent glasses. 
     The server  1220  may be various kinds of servers, and may be, for example, a cloud server. 
       FIG.  13    is a schematic diagram of the failure identification and handling system according to the second embodiment of the present disclosure performing a corresponding method. As illustrated in  FIG.  13   , the method includes 
     Step  1301 : capturing, by the terminal device  1210 , video including a failure code, 
     Step  1302 : transmitting, by the terminal device  1210 , the video to the server  1220 , 
     Step  1303 : identifying, by the server  1220 , the failure code in the video and obtaining an identified failure code, 
     Step  1304 : determining, by the server  1220 , failure-related information corresponding to the failure code on the basis of the identified failure code, and generating, by the server  1220 , display data on the basis of the failure-related information, 
     Step  1305 : transmitting, by the server  1220 , the display data to the terminal device  1210 , and 
     Step  1306 : displaying, by the terminal device  1210 , the failure-related information on the basis of the display data. 
       FIG.  14    is a schematic view of an embodiment of the identification unit according to the second embodiment of the present disclosure. As illustrated in  FIG.  14   , the identification unit  1202  includes 
     a first calculation module  1401  that calculates an average value of pixel values of all pixel points in a failure code display area of the frame, 
     a first determination module  1402  that determines, when the average value satisfies a predetermined condition, that the failure code display area includes a failure code, and 
     a first identification module  1403  that identifies the failure code display area including the failure code by using a preliminarily trained first identification model so as to obtain the identified failure code. 
       FIG.  15    is a schematic view of another embodiment of the identification unit according to the second embodiment of the present disclosure. As illustrated in  FIG.  15   , the identification unit  1202  includes 
     a second identification module  1501  that sequentially identifies each frame of the video so as to obtain a first partial failure code and a second partial failure code that are identified, and 
     a first combining module  1502  that combines the first partial failure code and the second partial failure code into a complete failure code as an identified failure code. 
       FIG.  16    is a schematic diagram of the second identification module according to the second embodiment of the present disclosure. As illustrated in  FIG.  16   , the second identification module  1501  includes 
     a second calculation module  1601  that calculates an average value of pixel values of all pixel points in a failure code display area of the frame, 
     a second determination module  1602  that determines, when the average value satisfies a predetermined condition, that the failure code display area includes a failure code, and 
     a third identification module  1603  that identifies the failure code display area including the failure code by using a preliminarily trained first identification model so as to obtain the identified first partial failure code or the identified second partial failure code. 
       FIG.  17    is a schematic view of another embodiment of the identification unit according to the second embodiment of the present disclosure. As illustrated in  FIG.  17   , the identification unit  1202  includes 
     a superimposition module  1701  that superimposes adjacent frames or interval frames of the video on the basis of a predetermined weight value so as to obtain a plurality of superimposed frames, and 
     a fourth identification module  1702  that identifies a failure code on the basis of the plurality of superimposed frames. 
       FIG.  18    is a schematic diagram of the fourth identification module according to the second embodiment of the present disclosure. As illustrated in  FIG.  18   , the fourth identification module  1702  includes 
     a fifth identification module  1801  that sequentially identifies each superimposed frame so as to obtain a first partial failure code and a second partial failure code that are identified, and 
     a second combining module  1802  that combines the first partial failure code and the second partial failure code into a complete failure code as an identified failure code. 
     In the second embodiment of the present disclosure, the identification unit  1202  may further include 
     a dividing module that divides the video so as to obtain each frame of the video, and 
     a second determination module that determines a failure code display area for each frame of the video. 
     In the second embodiment of the present disclosure, the second determination module is able to determine the position of the failure code display area on the basis of the predetermined positional relation between the failure code display area and the display panel displaying the failure code, or determine the position of the failure code display area by using the preliminarily trained second identification model. 
     In the second embodiment of the present disclosure, the failure-related information corresponding to a failure code may include a failure content corresponding to the failure code and/or the first model of a device in which a failure occurs. 
     In the second embodiment of the present disclosure, the display unit  1204  may display, on the basis of the display data, the second model of the device capable of representing a failure content, the second model being formed on the basis of the first model of the device. 
     For example, the first model of the device is a two dimensional model or a three dimensional model capable of representing each member of the device, and the second model of the device is a two dimensional model or a three dimensional model capable of representing each member of the device and representing a failed position or member in an emphasized manner. 
     In addition, the display unit  1204  may display the second model by a system of augmented reality, an image, or a moving image. In the second embodiment of the present disclosure, the failure content may include information of a failed position or member and/or the corresponding after-service maintenance information. 
     In the second embodiment of the present disclosure, for the implementation of the functions of the above-described units and modules, the contents of the related steps in the first embodiment may be referred to. The description thereof is omitted here. 
     As is understood from the above-described embodiments, video including a failure code is captured and the failure code is identified on the basis of the video, whereby the complete failure code can be accurately identified without being limited by the failure code display type or the image acquisition parameters. Thus, it is possible to obtain failure-related information quickly and accurately on the basis of the identified complete and accurate failure code. 
     Third Embodiment 
     A third embodiment of the present disclosure provides a terminal device corresponding to the failure identification and handling method described in the first embodiment. For the concrete implementation thereof, the implementation of the method described in the first embodiment may be referred to, and the same or related contents will not be described herein any further. 
       FIG.  19    is a schematic diagram of the terminal device according to the third embodiment of the present disclosure. As illustrated in  FIG.  19   , a terminal device  1900  includes 
     an imaging unit  1901  that captures video including a failure code, 
     an identification unit  1902  that identifies a failure code in the video and obtains an identified failure code, 
     a determination unit  1903  that determine failure-related information corresponding to the failure code on the basis of the identified failure code, and generates display data on the basis of the failure-related information, and 
     a display unit  1904  that displays the failure-related information on the basis of the display data. 
     That is, a terminal device may perform all steps in the first embodiment, and for the implementation of the functions of the units of the terminal device, the contents of the related steps in the first embodiment may be referred to. The description thereof is omitted here. 
     As is understood from the above-described embodiments, video including a failure code is captured and the failure code is identified on the basis of the video, whereby the complete failure code can be accurately identified without being limited by the failure code display type or the image acquisition parameters. Thus, it is possible to obtain failure-related information quickly and accurately on the basis of the identified complete and accurate failure code. 
     The above-described device and method of the present disclosure may be achieved by hardware, or may be achieved by the combination of hardware and software. The present disclosure relates to a computer-readable program as follows. When the program is executed by a logic unit, the logic unit is able to achieve the above-described device or components, or the logic unit is able to achieve the above-described various methods or steps. 
     The present disclosure relates to a storage medium for storing the above-described program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, and the like. 
     The present disclosure has been described above in conjunction with the specific embodiments. However, it should be understood by those skilled in the art that these descriptions are only exemplary and do not limit the protection scope of the present disclosure. Those skilled in the art may make variations and modifications with respect to the present disclosure on the basis of the spirit and principle of the present disclosure, and these variations and modifications also fall within the scope of the present disclosure.