Patent ID: 12202485

DETAILED DESCRIPTION

Referring toFIG.1, a vehicle monitoring system10for a commercial vehicle is shown. The commercial vehicle includes a tractor12and a trailer14. The monitoring system10includes image capture devices, such as a front facing camera16, a driver facing camera18and two side cameras20,22. The front facing camera16is used in collision avoidance and adaptive cruise control systems. The driver facing camera18is used to monitor the status of the driver during vehicle operation. The side camera20is used to monitor the blind spot on the driver's side of the tractor12and the side camera22is used to monitor the blind spot on the passenger's side of the tractor12.

However, these cameras16,18,20,22are also used in the vehicle monitoring system10because they have areas of the tractor12and trailer14in view that will assist the vehicle driver in safely maintaining and operating his commercial vehicle.

In one example the cameras16,18,20,22are connected to a central camera controller28. The video signals are transmitted to the camera controller28for processing. In another example, the cameras16,18,20,22include their own separate controllers. The cameras16,18,20,22would communicate via a vehicle communications bus32in that example.

A display30may be in the cab of the tractor12. The display30communicates with the camera controller28and other tractor control systems over the vehicle communications bus32. The vehicle communications bus32may use a standard protocol, such as SAE J1939.

The trailer14is mechanically and electrically connected to the tractor12. The trailer14may be a refrigerated carrier and have a control system panel24on the front of the body of the trailer14. The control system will light a lamp on the control panel24if there is an error in the refrigeration system. The control system may also blink the lamp on the control panel24to transmit a diagnostic code regarding the type of error. The control system may also change color of a lamp on the control panel24, such as changing from a green color to a red color if there is an issue with the refrigeration system.

The trailer14may also be equipped with a tire inflation system. The tire inflation system includes a lamp26mounted near the rear of the trailer14that may be illuminated when there is an issue with the tire inflation system. The lamp26may come on each time the tire inflation system is engaged to inflate the tires. If the lamp is on frequently, there may be an issue with the tires or the tire inflation system itself.

The trailer14will be equipped with an anti-lock braking system (ABS). The antilock braking system has a warning lamp36mounted near the rear of the trailer14. The warning lamp36is illuminated when there is an issue with the ABS.

Other control systems may be on the trailer and include their own warning and status lamps. The controller28can be programmed to identify operation of the control systems through the operation of the warning and status signals.

The trailer14may be equipped with a lift axle system37. The lift axle is lowered when additional weight in the trailer is to be spread over the extra axle and lifted when the trailer is empty or when the vehicle is at slow speeds and cornering. The lift axle system37may be manually lifted or lowered. A vehicle monitoring system10can visually identify whether the lift axle system37is in a raised or lowered position.

The trailer14may have side opening doors, rear opening doors38or a combination of both. The vehicle monitoring system10can visually identify whether the doors are open based on their position in the frame of an image capture device

The trailer14is attached to the tractor12via a tractor-trailer electrical connector34. The connector34includes power and ground and generally does not include separate communications lines. Therefore, communication between the tractor12and trailer14uses power line carrier (PLC) technology, using the SAE J2497 protocol. PLC transmits information regarding the ABS on a trailer14via the power line so that a lamp in the cab is turned on or the display18is changed if there is an ABS error in the trailer14. While the PLC is capable of communicating the status of other trailer systems, it is generally only enabled for turning on the warning lamp in the cab in response to an ABS error in order to fulfill federal regulations. Some advanced systems include controller area network systems using the protocol ISO 11992 between the tractor and trailer. Ethernet is also a possibility for communication. However, tractors equipped with one communication type may be connected to trailers having a different communication type, such that the tractor and the trailer may not be compatible.

The driver is responsible for monitoring all of the systems on the tractor12and trailer14to ensure proper operation of the vehicle, as part of a pre-trip inspection and during on the road travel. Therefore, the present vehicle monitoring system10will provide additional assistance to the driver in looking for issues in the operation of the trailer14, as the system10automates the monitoring of changes in the lamps or other indicators on the trailer14. This is important in autonomous and semi-autonomous tractors, as they may pull existing trailers that have these visual warning systems without a means to fully communicate with the tractor.

The camera controller28includes a memory preprogrammed or available to be programmed with information regarding system indicators and their operation. For example, the camera controller28is programmed to recognize that the ABS warning lamp36is only turned on when there is an issue with the ABS on the trailer14. Therefore, when the ABS warning lamp36is on, then the driver must be notified. The camera controller28may also be programmed with the type of corrective action that is necessary when the vehicle condition is met. The controller28will communicate with the driver via the display30to inform him how to correct the issue found by the vehicle monitoring system10.

The camera controller28may include additional communication capability, such that the controller28can communicate with an off-vehicle server. The off-vehicle server can store the information regarding the issues identified by the vehicle monitoring system10. The time and date of when the issue occurred can be stored locally or remotely. A remote fleet operator may monitor the server to determine when maintenance may be needed on a trailer. Alternatively, the camera controller28itself can transmit a request for necessary maintenance based on the identification of the visual indicator meeting the predetermined condition. Other tractor control systems may receive the request via the communications bus32.

Therefore, a monitoring system for a combination vehicle comprises at least one image capture device mounted on a tractor, which has a trailer mounted control system within its field of view. The trailer mounted control system has a visual indicator. A controller is associated with the at least one image capture device. The controller captures images of the visual indicator, determines if the visual indicator meets a predetermined event condition and provides notification to at least one of a driver of the tractor, a remote fleet operator and a tractor control system in response to the visual indicator meeting the predetermined condition.

FIG.2shows a method40of identifying events on a trailer using a tractor mounted camera, for example side camera20or side camera22. In step42, the method40is initialized. In step44, the camera controller28determines whether side camera20or side camera22can see the control system panel24, trailer warning lamps26associated with tire inflation, ABS warning lamp36or other systems' indicators or position. In the instance of a cab only tractor having a rear window, the driver facing camera18may have the control system panel24in its view. If the camera controller28determines that the cameras18,20,22do not see any indicators, for example, the side camera20or side camera22are not positioned to include the portion of the trailer14having the indicators in their view, the method40moves to step46where the driver is informed that no additional information can be shared about the state of the warning systems. The driver may be informed via a message on the display30. Alternatively, the notification can be to the remote fleet operator or to other systems on the vehicle itself. The method40is stopped. The method40may be re-run on each start up of the tractor12in case the camera positioning has been changed.

If the camera controller28determines that at least one indicator or position of trailer equipment is visible in the field of view of at least one camera18,20,22, the method40continues to step48.

In step48, the controller28begins to log the status of the indicators. In some instances, having the indicator on means the system is working and in other systems having the indicator on means the system is not working properly. The camera controller28will begin logging the status of the indicators for comparison with the preprogrammed information regarding operation of the indicators.

In step50, the camera controller28determines if the number and frequency of changes to the monitored indicators exceed a threshold. The threshold events can be preprogrammed in the camera controller28as in some instances, one change to the lamp can require immediate attention whereas in other systems, the change to the indicator indicates the attention necessary. For example, the threshold for an ABS warning lamp to be on is simply one, as anytime the ABS warning lamp is on, the driver must be notified. However, the tire inflation system may blink its lamp26while an inflation event is occurring but if the lamp26is on frequently, it may mean there is an issue with the tire. The vehicle monitoring system10can also recognize a color change in a visual indicator, such as green meaning the system is okay and red meaning that there is an error. The vehicle monitoring system10can also identify the position of trailer equipment such as the lift axle and the access doors. If the events do not exceed the threshold or meet the predetermined condition, the method40returns to step48to continue to collect events.

If the events are equal to or greater than the threshold established in the camera controller28, the method40continues to step52. In step52, the driver is notified of the potential issue with one of the trailer systems as the camera controller28communicates through the display device30. In another example, the remote fleet operator may be notified of the issue through communication with the off-vehicle server. The electronics on the tractor itself could receive notice of the potential issue, especially for autonomous and semi-autonomous vehicles.

In step54, the system10may propose the corrective action through the display30. The driver may need to stop the vehicle and adjust a setting on the refrigerated trailer cooling system, for example. The driver may need to call for maintenance to be ready for him at the next scheduled stop, the system10may arrange for maintenance automatically or the driver may need to stop the vehicle immediately.

In step56, the system10determines whether the issue has been corrected by monitoring the indicators. If the issue has not been corrected, the notification to the driver is kept live in step58. The method40returns to step52to continue to notify the driver of the issue.

In one example, the camera controller28may communicate with other vehicle systems, such as the engine via the communications bus32to set a torque limit to keep the vehicle speed low until the error is corrected. The display28may be used to indicate that a driver should avoid a certain road or traveling at expressway speeds until the error is corrected. The fleet operator may manage all of these actions remotely.

If the issue was corrected and no further action is needed, the event counter is reset in step60and the method40returns to step48to continue to monitor the indicators.

Therefore, a method for monitoring a vehicle comprises receiving a video signal through a tractor mounted image capture device of a visual indicator of a trailer mounted control system. The method determines a change occurred in the visual indicator and provides a notice to at least one of a driver of the vehicle and a remote fleet operator in response to the change in the visual indicator.

While the present invention has been illustrated by the description of example processes and system components, and while the various processes and components have been described in detail, applicant does not intend to restrict or in any way limit the scope of the appended claims to such detail. Additional modifications will also readily appear to those skilled in the art. The invention in its broadest aspects is therefore not limited to the specific details, implementations, or illustrative examples shown and described. Accordingly, departures may be made from such details without departing from the spirit or scope of applicant's general inventive concept.