Patent ID: 12260589

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

FIG.1shows a schematic view of an indirect view system1which can perform the method according to the invention. The view system1comprises an image capture unit10, such as a camera, with an image sensor20, an image processing unit30, such as an ECU, and a reproduction unit40, such as a monitor. The view system1shown inFIG.1is shown in an ideal vehicle environment in which a vehicle60(see rectangular which is shown with a two dots dashed line) and a target field of view71associated with the vehicle60(see hatched rectangular) is to be seen. An ideal vehicle environment presently means that the target field of view71is shown to a driver (not shown) of the vehicle60as required on the reproduction unit40. The forward driving direction of the vehicle60shown inFIG.1runs inFIG.1to the right, the rearward driving direction runs inFIG.1to the left. The capture unit10has a recording portion11which, starting at the camera10, flares and expands, respectively, to the rear side of the vehicle60.

Further, the view system1comprises a reference transducer50. The reference transducer50is attached inFIG.1to a left outer side of a schematically shown vehicle60.

The target field of view71is arranged obliquely behind the vehicle of a left side of the vehicle60and may be a legally required field of view, such as a field of view of group II or IV, as required in the UN/ECE R46. The target field of view71as shown inFIG.1has a fixed geometric reference73to the reference transducer50. That is, the arrangement of the target field of view71with reference to the reference transducer50is known and is also always unaltered in the ideal vehicle environment.

FIG.2shows a plan view of a vehicle60, presently a truck. The vehicle60has a driver's cabin61and a vehicle built-up62(e.g. a tipper, a cooler, a box body, a car transporter etc.). The forward driving direction of the truck60runs inFIG.2to the left, whereas the rearward driving direction of the truck60runs inFIG.2to the right. The following description of the vehicle environment on the left side of the truck60also holds for the right side of the truck60, even if not shown.

The truck has at the left side of the traction machine, in particular the driver's cabin, an image capture unit10. The image capture unit10captures the vehicle environment left alongside and behind the truck60and has a recording portion11which expands in a horizontal plane which is parallel to the road surface from the image capture unit10to the rear of the truck60. The recording portion11of the image capture unit10, thus, is named recording cone11.

Left alongside/next to the truck60, the target field of view71schematically shown inFIG.1is arranged. The target field of view71extends in a predetermined distance behind the ocular point of the driver (not shown) to the rear of the truck60and expands in a particular angle to the rear. Presently, the target field of view71corresponds to the field of view II of UN/ECE R46, i.e., a main mirror field of view. However, the target field of view may also correspond to any other field of view, either a legally required field of view or a wished field of view, i.e., a field of view predetermined by the manufacturer or user.

At a rear edge of the driver's cabin61of the truck60, the reference transducer50shown inFIG.1is arranged. As shown inFIG.2, the reference transducer50is located in the recording cone11of the image capture unit60. The reference transducer50may also be attached to the vehicle built-up62, provided that the built-up is a rigid built-up.

FIG.3shows the vehicle environment ofFIG.2in a side view. As shown inFIG.3, the recording portion11of the image capture unit10does not only expand in a horizontal plane which is parallel to the road surface from the image capture unit10to the rear of the truck60, but also expands to the rear in a plane which is orthogonal to the road surface and parallel to the left truck vehicle outer wall. The target field of view71is shown inFIG.3as big black line in the plane of the road surface. As further shown inFIG.3, the reference transducer is arranged in an upper rear left corner of the traction machine of the truck60and is captured by the recording cone11of the image capture unit10.

FIG.4shows the reproduction unit40shown inFIG.1. InFIG.4, the reproduction unit40shows the ideal vehicle environment shown inFIGS.2and3. The person schematically depicted inFIG.4is not shown inFIGS.2and3. InFIG.4, for sake of clearness, only the traction machine ofFIGS.2and3is depicted. As it can be taken fromFIG.4, the reference transducer50is arranged at the traction machine of the truck60via a reference transducer supporting element53. Specifically, the reference transducer50is attached to an end of the reference transducer supporting element53protruding from the traction machine of the truck60which end is distal from the vehicle. The reference transducer50may be a light reflecting element or a lamp which emits light to the front of the truck60.

FIG.5shows an image sensor20as it is present in the image capture unit10shown inFIG.1and schematically shows a verification process which is performed by the image processing unit30and wherein a verification of the recording portion11of the image capture unit10or a read-out portion22of the image sensor occurs by comparing a reference transducer current position52and a reference transducer target position51on the image sensor20.

The image sensor20has a rectangular shape with a longer extension in the up-and-down-extension than in the left-and-right-extension inFIG.5. On the image sensor20, the entire vehicle environment located in the recording cone11is depicted. A part of the image data shown on the image sensor20is read out as an image read-out portion22(see rectangular with fine dashed line) and is transmitted to the reproduction unit40for displaying. It is also possible to transmit the image data of the entire image sensor20to the reproduction unit40for displaying.

In a left upper corner of the image read-out portion22, an image analysis portion21is arranged (see rectangular with roughly dashed line). In the image analysis portion21, a reference transducer target position51is indicated. The reference transducer target position51on the image sensor20corresponds to the position on the image sensor20at which the reference transducer50should be depicted, if the recording portion11of the image capture unit10is located in the required and wished adjustment, respectively. In the required and wished adjustment of the recording portion11of the image capture unit10, respectively, the driver sees the required and wished vehicle environment, respectively, on the reproduction unit40, such as, for example, the required and wished target field of view71, respectively.

In the image analysis portion21, further, a reference transducer current position52is depicted. The reference transducer current position52on the image sensor20corresponds to the position on the image sensor20where the reference transducer50is actually depicted, if the image capture unit10captures the vehicle environment. As shown inFIG.5, the reference transducer current position52does not lie in the same position as the reference transducer target position51. As the reference transducer target position51has a fixed geometric relation73to the target field of view71, a current field of view72is also shown in a displaced manner in view of the target field of view71on the image sensor20of the image capture unit10, and, in this case, the driver can only partly see/view into the required and wished vehicle environment, respectively (see overlapping portion of the target field of view71and the current field of view72inFIG.5), on the reproduction unit40.

The deviation of the reference transducer current position52and the reference transducer target position51on the image sensor20is detected in the embodiment shown inFIG.5by a suitable computer program stored in the image processing unit30, such as, e.g. by image recognition, and is shown to the driver by an audio warning or a corresponding display on the reproduction unit40or the dashboard. Then, for example, the driver may correct the deviation of the reference transducer current position52to the reference transducer target position51manually by adjusting the image capture unit10such that the reference transducer current position52is equal to the reference transducer target position51. In a further or an alternative step to the output of a signal, however, the image processing unit30may also correct the error in the depiction on the image sensor, i.e., that the reference transducer current position52is unequal to the reference transducer target position51, on its own and, thus, may calibrate the indirect view system. A calibration of the recording portion11of the image capture unit10may occur automatically by the image processing unit30. In general, the determination whether the reference transducer current position52is equal to the reference transducer target position51is started either upon a signal, such as a corresponding command of the driver, upon a vehicle event or by a corresponding calibration program. A vehicle event may be the starting of the vehicle, the switching on of the ignition, the coupling of a trailer, etc. A calibration program performs a determination of the reference transducer current position52by means of a corresponding software in a clocked manner, compares the reference transducer current position52with the reference transducer target position51and corrects the reference transducer current position52autonomously such that it coincides with the reference transducer target position51.

As it is further shown inFIG.5, a reference transducer target portion23is defined around the reference transducer target position51. The reference transducer target portion23defines an area on the image sensor11in which the reference transducer50has to be located at least, in order to be able to capture the required and wished fields of view, respectively, with the image capture unit10, to depict them on the image sensor11and to show them on the reproduction unit40. The reference transducer target portion23is defined in advance by the vehicle manufacturer or the view system manufacturer and usually comprises a portion which is symmetrical around the reference transducer target position51. A non-symmetric extension of the reference transducer target portion23around the reference transducer target position51is also conceivable. Therefore, it may also be sufficient that the reference transducer current position52is displaced into the reference transducer target portion23, in order to calibrate the view system1, but does not have to exactly lie on the reference transducer target position51.

InFIG.6, the reproduction unit40is shown whose display corresponds substantially to the display of the reproduction unit ofFIG.4. However, inFIG.6, a reference transducer50is shown which is attached to a lower rear right corner of the driver's cabin61of the truck60. The reference transducer50inFIG.4is a kind of crossline which is attached to the driver's cabin outer wall. For example, the reference transducer50may be a permanent adhesive label/sticker or may be attached during vanishing the truck60at the driver's cabin outer wall. The reference transducer, thus, is permanently attached to the driver's cabin outer wall. Alternatively, however, the reference transducer50may also be a (releasable) adhesive label/sticker, may be attachable via a magnetic base to the driver's cabin/truck outer wall or may be configured otherwise releasably from the driver's cabin/truck outer wall such that it is fixed only on demand, i.e. for a planned verification and, if so, calibration of the indirect view system1, to the body of the truck. Furthermore, the reference transducer may be attached to all imaginable and suitable locations at the body of the truck60, however, may also be attached to a fixedly defined part of a vehicle built-up, such as, for example, a box body. Alternatively, special shapes of the vehicle body of the truck (e.g., the wheel, the rear edge of the driver's cabin61or the built-up62) may form the reference transducer50itself.

FIG.7shows again the reproduction unit40ofFIG.6and a verification process which is performed by the image processing unit30and wherein a verification of the recording portion11of the image capture unit10occurs by comparison of a reference transducer current position52and a reference transducer target position51on the reproduction unit40, e.g. either digitally by an overlay or manually by applying a foil on each of which the reference transducer target position is defined. The overlay and the foil, respectively, correspond presently to the verification unit.

While inFIG.6only the target situation is shown on the reproduction unit40, inFIG.7, the target situation and the current situation are shown on the reproduction unit40. Specifically, it is shown inFIG.6that the reference transducer50is located in the target situation at the reference transducer target position51and in the current situation at the reference transducer current position52. With a reference transducer current position52which is displaced in view of the reference transducer target position51, also the current field of view72is displaced in view of the target field of view71.

The deviation of the reference transducer current position52and the reference transducer target position51on the image sensor20is detected in the embodiment shown inFIG.6by a suitable computer program which is stored in the image processing unit30, such as, for example, by image recognition, and is shown to the driver on the reproduction unit40by laying the target situation over the current situation. If so, the display of the current situation deviating from the target situation can be shown to the driver on the reproduction40also by an additional signal, such as by an audio warning or a corresponding display on the reproduction unit40or the dashboard. Then, for example, the driver may correct the deviation of the reference transducer current position52to the reference transducer target position51manually by adjusting the image capture unit10, such that the reference transducer current position52is equal to the reference transducer target position51. In a further or alternative step to the signal output, however, the image processing unit30may also correct the error in the depiction on the image sensor, i.e. that the reference transducer current position52is unequal to the reference transducer target position51, on its own by means of a suitable calibration program and, thus, may calibrate the indirect view system. A calibration of the recording portion11of the image capture unit10by the image processing unit30may occur automatically. In general, the determination whether the reference transducer current position52is equal to the reference transducer target position51is either started upon a signal, such as a corresponding command of the driver, upon a vehicle event or upon a corresponding calibration program. A vehicle event may be the starting of the vehicle, the switching on of the ignition, the coupling of a trailer, etc. A calibration program performs a determination of the reference transducer current position52by means of a corresponding software in a clocked manner, compares the reference transducer current position52with the reference transducer target position51and corrects the reference transducer current position52on its own such that it coincides with the reference transducer target position51.

While it is shown inFIG.6that the reference transducer50is arranged at the rear portion of the driver's cabin61,FIG.7shows that the reference transducer50is arranged at a rear portion of a built-up62of the truck60.

InFIG.8, a flow diagram is shown which describes the verification process and calibration process, respectively. In step S10, an image capture unit10which has at least one image sensor20and is configured for capturing image data of at least one recording portion11around the truck, an ECU as image processing unit30which is configured for processing the image data captured by the image capture unit10, and a monitor as reproduction unit40which is configured for reproducing the image data processed by the image processing unit30, are provided. Further, in step S10, a reference transducer is provided which is arranged at a defined position at the truck60such that the reference transducer50lies in a recording portion of the image capture unit10during operation of the view system1and is depicted on the image sensor20.

In step S20, a reference transducer target position51is correspondingly defined/determined on the image sensor20where the reference transducer50is depicted in an ideal vehicle environment.

In step S30, the image capture unit captures image data of the recording portion11around the vehicle60on the image sensor20which comprise the reference transducer50.

In step S40, the image read-out portion22read out from the image data of the image sensor20is shown on the reproduction unit40.

In step S50, a reference transducer current position52of the reference transducer50is determined on the image sensor20and, in step S60, the reference transducer current position52and the reference transducer target position51are compared with each other to that effect whether the reference transducer current position52is equal to the reference transducer target position51or not (S70).

If the reference transducer current position52is equal to the reference transducer target position51(YES in S70), the verification process returns to step S50and determines the reference transducer current position52. The re-determination of the reference transducer current position52may either occur upon a signal, such as, for example, a manual signal by the driver or an automatically generated signal, such as upon elapse of a certain time span, or may occur directly after determination that the reference transducer current position52is equal to the reference transducer target position51, without time delay, i.e., in an inquiry program loop.

If the reference transducer current position52is not equal to the reference transducer target position51(NO in S70), the process either proceeds to step S71and outputs a signal to the driver which shows the driver the deviation of the reference transducer current position52relative to the reference transducer target position51, or proceeds to step72in which the recording portion11of the camera10is calibrated, i.e. corrected such that the reference transducer current position52is equal to the reference transducer target position51. It is also conceivable that steps S71and S72occur timely subsequently, i.e., firstly, that a signal is output to the driver which shows the deviation of the reference transducer current position52to the reference transducer target position51and, directly following to the output of the signal, the correction of the reference transducer current position52occurs such that the reference transducer current position52is equal to the reference transducer target position51.

The process ofFIG.8is terminated after step S71and, after step S72, may either return again to step S70, in order check whether the reference transducer current position52is equal to the reference transducer target position51, or may alternatively also be terminated after step S72.

It is explicitly stated that all features disclosed in the description and/or the claims are intended to be disclosed separately and independently from each other for the purpose of original disclosure as well as for the purpose of restricting the claimed invention independent of the composition of the features in the embodiments and/or the claims. It is explicitly stated that all value ranges or indications of groups of entities disclose every possible intermediate value or intermediate entity for the purpose of original disclosure as well as for the purpose of restricting the claimed invention, in particular as limits of value ranges.

Thus, while there have shown and described and pointed out fundamental novel features of the invention as applied to a preferred embodiment thereof, it will be understood that various omissions and substitutions and changes in the form and details of the devices illustrated, and in their operation, may be made by those skilled in the art without departing from the spirit of the invention. For example, it is expressly intended that all combinations of those elements and/or method steps which perform substantially the same function in substantially the same way to achieve the same results are within the scope of the invention. Moreover, it should be recognized that structures and/or elements and/or method steps shown and/or described in connection with any disclosed form or embodiment of the invention may be incorporated in any other disclosed or described or suggested form or embodiment as a general matter of design choice. It is the intention, therefore, to be limited only as indicated by the scope of the claims appended hereto.