Patent Publication Number: US-2022230484-A1

Title: Method, Fault Management Apparatus, Computer Program, and Computer Program Product For Fault Management For a Vehicle

Description:
The present application is the U.S. national phase of PCT Application PCT/EP2020/065031 filed on May 29, 2020, which claims priority of German patent application No. 102019117943.2 filed on Jul. 3, 2019, which is incorporated herein by reference in its entirety. 
    
    
     TECHNICAL FIELD 
     The disclosure relates to a method for fault management for a vehicle, a fault management apparatus for a vehicle, and a computer program and computer program product for fault management for a vehicle. 
     BACKGROUND 
     Faults can occur in vehicles. If a fault is detected, it can be processed by a fault management apparatus. 
     One underlying object of the disclosed embodiments is to make a contribution to a precise fault management for a vehicle. 
     SUMMARY 
     The object is achieved by the features of the independent patent claims. Advantageous designs are set out in the subclaims. 
     A first aspect is a method for fault management for a vehicle. 
     The vehicle has at least one camera unit which is designed to provide image data. 
     According to the first aspect, if a respective fault condition is detected in relation to the vehicle, a respective fault entry is created depending on the respective detected fault condition. The respective fault entry is representative of information relating to the respective detected fault condition. Respective image data of the at least one camera unit are requested depending on the respective detected fault condition. The image data of the at least one camera unit are requested in such a way that the respective image data have a temporal reference to the respective detected fault condition. The respective requested image data are assigned to the respective fault entry. 
     As a result, it is possible to use the respective requested image data as additional information for the respective fault entry by means of existing infrastructure of the vehicle. This is advantageous, for example, for an assessment of a fault cause of the respective detected fault condition. An unequivocal assessment, for example, of the fault cause of the respective fault condition can thereby be enabled. This simplifies, for example, an analysis of a problem and/or can result in a cost reduction. 
     Problem elimination and/or system optimization, for example, can thus be simplified for the vehicle. Vehicle safety, for example, can furthermore be increased as a result if the fault cause can be unequivocally assigned to the respective detected fault condition by means of the additional information in the form of the respective requested image data. An unequivocal misuse by a user and/or of a driver of the vehicle, for example, can thus be established, such as, for example, an impairment of a field of view of a camera unit of the vehicle through the use of a cell phone. The respective requested image data assigned to the respective fault entry can, for example, be read together with the respective fault entry in the event of a service and/or an inspection in a workshop or the like in order, for example, to simplify the problem elimination and/or assessment of the fault cause of the respective detected fault condition and/or a resolution of the fault cause and/or a clarification of the repair costs. The respective requested image data assigned to the respective fault entry can, for example, also be advantageously used even during the development of the vehicle. 
     The at least one camera unit is, for example, a camera and/or an infrared camera or the like. The at least one camera unit is arranged, for example, in an internal area and/or external area of the vehicle. The at least one camera unit is designed, for example, for facial recognition of the driver of the vehicle. The at least one camera unit is designed, for example, to provide the image data via a bus system or a network connection of the vehicle. The bus system is, for example, a controller area network, CAN, bus system. In particular, the network connection is designed, for example, as a wireless or an optical network connection. 
     The respective fault condition is, for example, a fault condition of any vehicle function of the vehicle. The respective fault condition is, for example, a defect of an electronic window regulator of the vehicle and/or a fault in the facial recognition of the driver of the vehicle and/or a defect of a trailer hitch of the vehicle and/or a defect in an area around the vehicle or the like. 
     The respective fault condition is detected, for example, for a respective occurrence of the defect of the electronic window regulator of the vehicle. 
     The respective fault entry comprises, for example, information in text form, such as a time indication and/or a vehicle condition and/or further information. The information in text form comprises, in particular, letters and/or numbers and/or any characters or the like. In particular, the respective fault entry is, for example, a fault memory entry of the vehicle. If necessary, the respective fault entry is free from respective image data. 
     The temporal reference of the respective image data to the respective detected fault condition comprises, for example, a predefined time range around a time of the detection of the respective fault condition. The temporal reference also comprises, for example, the time of detection of the respective fault condition. 
     The respective image data of the at least one camera unit are requested, for example, for the predefined time range and/or a predefined time. The predefined time range and/or the predefined time is/are dependent, for example, on a type of the respective fault condition. In particular, the predefined time range and/or the predefined time is/are predefined, for example, by a user input. The requested image data provide, for example, findings relating to the assessment of the fault cause of the respective detected fault condition. 
     The respective image data are requested for the predefined time, for example, in such a way that the predefined time occurs, in particular, before the time of detection of the respective fault condition. The respective image data are requested for the predefined time, for example, in such a way that the predefined time occurs, in particular, after the time of detection of the respective fault condition. The respective image data are requested for the predefined time, for example, in such a way that the predefined time corresponds, in particular, to the time of detection of the respective fault condition. 
     The assignment of the respective requested image data to the respective fault entry is performed, for example, on the basis of a name and/or component information and/or a code or the like. The assignment can be performed, for example, chronologically or time-independently. 
     According to one optional design, the respective image data of the at least one camera unit are requested from an image data buffer memory depending on the respective detected fault condition. The image data buffer memory has pre-stored image data of the at least one camera unit. 
     As a result, it is possible to use pre-stored image data of the existing infrastructure of the vehicle for the assignment. 
     The image data of the at least one camera unit are temporarily stored, for example, in the image data buffer memory for different time ranges. This can be the case if the latter are already used by vehicle functions of the vehicle. The different times have, for example, the predefined time range and/or the predefined time and can therefore be used for the assignment. 
     The image data buffer memory is, for example, a central data memory of the vehicle. The image data buffer memory is, for example, a local data memory which is arranged, for example, in a structural unit with the at least one camera unit. 
     According to a further optional design, the respective image data of the at least one camera unit are requested from the at least one camera unit depending on the respective detected fault condition. 
     As a result, it is possible to request the respective image data directly from the at least one camera unit. 
     The image data are requested from the at least one camera unit, for example, by requesting image data for the predefined time range and/or the predefined time. The at least one camera unit is activated, if necessary, for example, to generate the requested image data. 
     According to one further optional design, the respective fault entry is stored in a fault entry memory. 
     As a result, it is possible to use the existing infrastructure of the vehicle to store the respective fault entry. Furthermore, the respective fault entry can thus be stored independently from the requested image data. 
     In particular, the fault entry memory is, for example, a fault memory of the vehicle which is designed to store a fault memory entry. 
     However, the fault entry memory can also be arranged, for example, outside the vehicle. 
     According to one further optional design, the respective requested image data of the at least one camera unit are stored in an image data memory. 
     As a result, it is possible to use the existing infrastructure of the vehicle to store the respective requested image data. Furthermore, the respective requested image data can thus be stored independently from the respective fault entry. 
     The image data memory is, for example, the central data memory of the vehicle. The image data memory corresponds, for example, to the fault entry memory. 
     However, the image data memory can also be arranged, for example, outside the vehicle. 
     According to one further optional design, the vehicle comprises a plurality of camera units. A subset of the plurality of camera units is selected depending on the respective detected fault condition. Respective image data of the subset of the plurality of camera units are requested depending on the respective detected fault condition. The respective image data of the subset of the plurality of camera units are requested in such a way that the respective image data have a temporal reference to the respective detected fault condition. 
     As a result, it is possible to request the image data depending on the respective detected fault condition. Furthermore, it is thus possible to request the image data depending on a type and/or a location of the respective detected fault condition. 
     The subset is predefined, for example, by a user input. The subset is, for example, determined automatically. The subset is, for example, dependent on the respective detected fault condition. 
     The plurality of camera units are installed, for example, in different areas of the vehicle. The image data of the subset of the plurality of camera units have, for example, a correlation to the respective detected fault condition. 
     A second aspect is a fault management apparatus for a vehicle which has at least one camera unit which is designed to provide image data. The fault management apparatus has a fault entry memory which is designed to store a respective fault entry. The fault management apparatus further has an image data memory which is designed to store respective requested image data. The fault management apparatus is designed to carry out the method for fault management for a vehicle. 
     The fault management apparatus is arranged, for example, in a structural unit in the vehicle. 
     The fault management apparatus is arranged, for example, in different structural units. The fault management apparatus comprises, for example, a first partial fault management apparatus and a second partial fault management apparatus. The first partial fault management apparatus comprises, for example, a first communication interface. The second partial fault management apparatus comprises, for example, a second communication interface. The first communication interface is designed, for example, to receive data from the second communication interface. The second communication interface is designed, for example, to receive data from the first communication interface. The first partial fault management apparatus is arranged, for example, in the vehicle, and the second partial fault management apparatus is arranged outside the vehicle. In particular, the second partial fault management apparatus is arranged, for example, in a backend or cloud or the like outside the vehicle. The data comprise, for example, the respective fault entry and/or the respective requested image data. 
     The first communication interface and the second communication interface are interconnected, for example, via a network connection. 
     The first partial fault management apparatus comprises, for example, the fault entry memory, and the second partial fault management apparatus comprises the image data memory, or vice versa. The second partial fault management apparatus comprises, for example, the fault entry memory and the image memory. 
     A further aspect is a computer program, wherein the computer program comprises instructions which, when the computer program is executed by a computer, cause the computer to carry out the method for fault management for a vehicle during its execution on a data processing apparatus. 
     Yet a further aspect is a computer program product comprising an executable program code, wherein the program code, when it is executed by a data processing apparatus, carries out the method for fault management for a vehicle. 
     The computer program product comprises, in particular, a medium readable by the data processing apparatus on which the program code is stored. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       Exemplary embodiments are explained in detail below with reference to the schematic drawings, in which: 
         FIG. 1  shows a schematic drawing of a vehicle, 
         FIG. 2  shows a schematic drawing of a first distributed system, 
         FIG. 3  shows a schematic drawing of a second distributed system, 
         FIG. 4  shows a schematic drawing of a third distributed system, and 
         FIG. 5  shows a flow diagram of a program for fault management for a vehicle. 
     
    
    
     DETAILED DESCRIPTION 
       FIG. 1  shows a schematic drawing of a vehicle  10 . The vehicle  10  has a plurality of camera units  21 ,  23 ,  25  which are designed to provide image data. The vehicle  10  further has a fault management apparatus  30  which is designed to request image data from the plurality of camera units  21 ,  23 ,  25 . The fault management apparatus  30  has a fault entry memory  40  which is designed to store a respective fault entry FE. The fault management apparatus  30  further has an image data memory  50  which is designed to store the respective requested image data ABD. 
     The plurality of camera units  21 ,  23 ,  25  and the fault management apparatus  30  are interconnected, for example, via a bus system or network connection of the vehicle. The bus system is, for example, a controller area network, CAN, bus system. The network connection is, in particular, for example, a wireless or an optical network connection. 
     The plurality of camera units  21 ,  23 ,  25  can also comprise, for example, more than three camera units. 
       FIG. 2  shows a schematic drawing of a first distributed system. The first distributed system has the vehicle  10 . The vehicle  10  has the plurality of camera units  21 ,  23 ,  25 . The vehicle  10  further has a first partial fault management apparatus  30   a.  The first partial fault management apparatus  30   a  has a first communication interface  33   a.  The distributed system further has a second partial fault management apparatus  30   b  which is arranged outside the vehicle  10 . In particular, the second partial fault management apparatus  30   b  is arranged, for example, in a backend or cloud or the like outside the vehicle. The second partial fault management apparatus  30   b  has a second communication interface  33   b  . The second partial fault management apparatus  30   b  comprises the fault management memory  40 . The second partial fault management apparatus  30   b  further comprises the image data memory  50 . 
     The second communication interface  33   b  is designed, for example, to receive the respective fault entry FE and/or the respective requested image data ABD from the first communication interface  33   a.    
     The first communication interface  33   a  and the second communication interface  33   b  are interconnected, for example, via a network connection. 
       FIG. 3  shows a schematic drawing of a second distributed system. The second distributed system has the same features as the first distributed system, wherein the first partial fault management apparatus  30   a  comprises the fault entry memory  40 , and the second partial fault management apparatus  30   b  comprises the image data memory  50 . 
       FIG. 4  shows a schematic drawing of a third distributed system. The third distributed system has the same features as the first distributed system, wherein the first partial fault apparatus  30   a  comprises the image data memory  50 , and the second partial fault management apparatus  30   b  comprises the fault entry memory  40 . 
       FIG. 5  shows a flow diagram of a program for fault management for the vehicle  10 , wherein the program is stored in a program memory and/or data memory and can be executed by a computing unit. The fault management apparatus  30  for the vehicle  10  comprises, for example, the program memory and/or data memory and the computing unit which executes the program for processing measurement datasets. 
     The program is started in a step S 101  in which, if necessary, variables are initialized. 
     The program is continued in a step S 103 . In step S 103 , it is determined whether a respective fault condition FZ is detected in relation to the vehicle  10 . If a respective fault condition FZ is detected in relation to the vehicle  10 , the processing is continued in a step S 105 . Otherwise, the processing is continued once more in step S 103 , if necessary following a predefined waiting time period. 
     The respective fault condition is, for example, a fault in a facial recognition of a driver of the vehicle. 
     In step S 105 , a respective fault entry FE is created depending on the respective detected fault condition DFZ. The respective fault entry FE is representative of information relating to the respective detected fault condition DFZ. 
     In particular, the respective fault entry is, for example, a fault memory entry of the vehicle which is representative of the fault in the facial recognition. 
     Following step S 105 , the program is continued in a step S 107 . In step S 107 , a subset TM of the plurality of camera units  21 ,  23 ,  25  is selected depending on the respective detected fault condition DFZ. 
     The camera unit  21  is, for example, an internal area camera which is installed on a rearview mirror of the vehicle, wherein its field of view comprises a driver&#39;s seat of the vehicle. The camera unit  23  is, for example, a further internal area camera whose field of view comprises the driver&#39;s seat of the vehicle. The camera unit  21  is, for example, an internal area camera whose field of view does not comprise the driver&#39;s seat of the vehicle. 
     The subset TM is predefined, for example, by a user input for faults in the facial recognition in such a way that the subset TM comprises the camera units  21 ,  23 . 
     Following step S 107 , the program is continued in a step S 109 . In step S 109 , respective image data BD of the subset TM of the plurality of camera units  21 ,  23 ,  25  are requested depending on the respective detected fault condition DFZ. The image data BD of the subset TM of the plurality of camera units  21 ,  23 ,  25  are requested in such a way that the respective image data BD have a temporal reference to the respective detected fault condition DFZ. 
     Optionally, in step S 109 , the respective image data BD of the subset TM of the plurality of camera units  21 ,  23 ,  25  are requested from an image data buffer memory depending on the respective detected fault condition DFZ. The image data buffer memory has pre-stored image data of the subset TM of the plurality of camera units  21 ,  23 ,  25 . 
     Optionally, in step S 109 , the respective image data BD of the subset TM of the plurality of camera units  21 ,  23 ,  25  are requested from the subset TM of the plurality of camera units  21 ,  23 ,  25  depending on the respective detected fault condition DFZ. 
     The respective image data BD of the subset TM which comprises the camera units  21 ,  23  are requested, for example, for the fault in the facial recognition and are provided via a bus system of the vehicle. The image data BD of the camera unit  21  are pre-stored, for example, in the image data buffer memory and are requested from the image data buffer memory. The camera unit  23  is activated, for example, to generate the respective image data BD, and the respective image data BD are requested directly from the camera unit  23 . 
     The respective image data BD of the subset TM are requested, for example, for the time of detection of the fault in the facial recognition. 
     Following step S 109 , the processing is continued in a step S 111 . In step S 111 , the respective requested image data ABD are assigned to the respective fault entry FE. 
     Following step S 111 , the program is continued in a step S 113 . In step S 113 , the respective fault entry FE is stored in the fault entry memory  40 . 
     The fault entry memory is, for example, a fault memory of the vehicle which is designed to store the fault memory entry. 
     Following step S 113 , the program is continued in a step S 115 . In step S 115 , the respective requested image data ABD of the subset TM of the plurality of camera units  21 ,  23 ,  25  are stored in the image data memory  50 . 
     The image data memory is, for example, the fault memory. The respective requested image data ABD of the subset TM which comprises the camera units  21 ,  23  are stored, for example, together with the fault memory entry in the fault memory. 
     The program is then ended in a step S 117  and can be restarted, if necessary, in step S 101 .