Alerting system and method thereof

An alerting system includes an image capturing module continuously captures traffic images surrounding a vehicle and showing at least one traffic sign therein; a gaze detector continuously detects a gaze direction of a driver in the vehicle; a control unit analyzes the traffic images and generates a trigger signal when it determines that the traffic sign changes and the driver fails to notice the change; and an alarming device alerts the driver upon the receipt of the trigger signal.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an alerting system and method thereof, and more particularly to a system and a method thereof capable of alerting a driver when a traffic sign changes and the driver fails to pay attentions to it.

2. Description of the Prior Art

When driving, drivers must always keep attentions on traffic signs to avoid violations. Sometimes, however, there are sudden conditions, such as a jaywalking pedestrian, a cutting-off vehicle, etc. that could divert a driver's focus on the traffic signs. Assuming under such circumstance a traffic light changes and the driver of vehicle does not see it, he/she may not be able to react timely and violation or, in a worst case, collisions may occur.

Additionally, when a traffic light turns red, vehicles behind the traffic light must stop and wait. Occasionally, the waiting may be too long to keep drivers' attentions. When the traffic light turns green, those who are unaware may not be able to move instantly and therefore result in traffic jams.

SUMMARY OF THE INVENTION

In view of the foregoing, the present invention provides an alerting system and method thereof.

According to some embodiments, the present invention discloses an alerting system disposed in a vehicle. The alerting system includes: an image capturing module captures traffic images surrounding the vehicle and showing at least one traffic sign thereon; a gaze detector detects a gaze direction of a driver in the vehicle; a control unit connected to the image capturing module and the gaze detector, wherein the control unit analyzes the traffic images and generates a trigger signal when it determines that the traffic sign changes and the driver fails to notice it; and an alarming device alerts the driver upon the receipt of the trigger signal.

According to another some embodiments, the present invention discloses a method of alerting a driver in a vehicle. The method includes: gathering a plurality of traffic images showing at least one traffic sign; detecting the driver's gaze direction; determining if the traffic sign changes based on the traffic images; and alerting the driver if the traffic sign changes and the driver fails to notice the change.

DETAILED DESCRIPTION

FIG. 1illustrates an alerting system10according to an embodiment of the present invention. As shown inFIG. 1, the alerting system10is arranged on a vehicle300. The alerting system10includes an image capturing module12, a gaze detector14, a control unit16and an alarming device18. The image capturing module12is configured to capture traffic images surrounding the vehicle300. The traffic images may include one or more traffic signs instructing drivers to move, stop or slow vehicles. The gaze detector14is configured to detect a gaze direction of a driver200in the vehicle300. The control unit16is connected to the image capturing module12and the gaze detector14. The control unit16is configured to process the traffic images captured by the image capturing module12and generate a trigger signal if the preset criteria are met. The alarming device18is configured to alert the driver200about the change of the traffic light upon receiving the trigger signal.

FIG. 2depicts an embodiment explaining how the present alerting system10works. As shown, the gaze detector14continuously detects a gaze direction V of the driver200. Meanwhile, the image capturing module12continuously captures the traffic images surrounding the vehicle300including a traffic light400. In one embodiment, the image capturing module12may be arranged inside the vehicle, so the capturing is through the windshield320. One however should appreciate that this sort of arrangement is a mere example and should not in any event become a limitation to the present invention. That is, the image capturing module12may be disposed at any place of the vehicle so long as it can capture crucial traffic images clearly and soundly.

In one scenario, assuming the vehicle300stops because the traffic light400is red (i.e. a first traffic state). While waiting, the driver200looks right to talk to the passenger. Under such circumstance, the gaze detector14also detects the driver200is not looking at the traffic light400because the gaze direction V is toward the right. Meanwhile, the control unit16analyzes the traffic images captured by the image capturing module12. Assuming the control unit16, based on the captured images, determines that the traffic light400just turns green (i.e. a second traffic state), it then generates a trigger signal to the alarming device18. Upon receiving the trigger signal, the alarming device18alerts the driver200about the change of the traffic light400so that the driver200can promptly move the vehicle300. In one embodiment, the alarming device18may alert the driver200via, for instance without limitation, sounds, lights, images, vibrations, or any combination of the above, etc.

There are many known algorithms and methods provided for traffic sign/light recognition based on captured images. For instance, some techniques concern color changes, and some are based upon spectrum. The present invention may adopt any of these technologies so long as the purpose is met.

FIG. 3illustrates another embodiment showing how the alerting system10works in accordance with the present invention. Continuing to the previous example, assuming the alerting system10has alerted the driver200and the gaze detector14also detects that the driver200is now looking onward. Thus, the control unit16concludes that the driver200is aware of the traffic light changes, and consequently it turns off the alarming device18.

According the present invention, the driver200will be alerted while the traffic light has changed and the driver is not looking at the traffic light400to reduce possible traffic jams. It should be noted that the alerting system10of the present invention will not alert the driver200merely because the traffic light changes. Sometimes the driver200does not move the vehicle200not because he/she is unaware of the traffic light but because pedestrians are walking through, or other vehicles are not moving. Thus, the system10of the present invention will alert only when it also determines that the driver200fails to notice the traffic light changes. The determination is made by reference to the driver's gaze direction V. If the gaze direction V is not toward the traffic light400, the system10presumes that the driver200does not see the traffic light and therefore gives alerts.

The red-to-green traffic light change is exampled to explain the function of the alerting system10. It should be noted that any traffic lights or traffic signs may also be applicable in the present invention. For instance, a traffic light indicating when making a turn is permissible will also fall within the scope of the disclosure.

Additionally, the present invention may also be applicable in a scenario where the traffic light is turning red. Similarly, if the alerting system10detects the change from green to red, and also determines that the driver's gaze direction V is not toward the traffic light400, the alerting system10also alerts the driver200to avoid potential traffic tragedies.

FIG. 4illustrates another scenario where an alerting system of the present invention may also apply. Assuming the alerting system10′ is disposed in the vehicle300. Like the above embodiment, the alerting system10′ also includes an image capturing module12, a gaze detector14, a control unit16, and an alarming device18. The functions of these components are identical to the previous discussion and are skipped herein. Apart from that, the alerting system10′ further includes a distance detector19configured to continuously measure the distance between the vehicle300and an adjacent vehicle350before it. Assuming the vehicle300stops because of a red light, the system10′ will alert the driver200only when: i) the traffic light400turns green, ii) the driver's gaze direction V is not toward the traffic light400, and iii) the distance between the vehicles300and350exceeds a default distance. Precisely, if all the above criteria are met, the control unit16issues a trigger signal to enable the alarming device18and therefore to alert the driver200. On the other hand, if, for instance, it is determined that the distance between the two vehicles300and350is less than the default distance, the alert will not be given until the distance becomes greater than the default distance. The reason is, even if the first two criteria are met, the driver200may not be able to move the vehicle300if there is no sufficient space to move forward. Thus, to ease any unnecessary anxiety, the alarming device18will not be enabled under such circumstance. Further, as mentioned previously, the distance detector19is capable of constantly measuring the distance between the two vehicles300and350, so the alerting system10′ can immediately alert the driver200once the vehicle350is moving away (e.g. either moving forward or making a turn).

In another scenario, assuming the vehicle300is moving toward a cross section and the traffic light400ahead is about to change to red. The alerting system10′ of the present invention may alert the driver200when the following conditions are satisfied: i) the traffic light400changes to red, ii) driver200is not looking at the traffic light400, and iii) the distance between the two vehicles300and350is less than a default distance. The third criterion indicates that the front vehicle350has been slowing down because of the red light, so the driver200needs to slow down to prevent collision. In other words, even if the first two criteria are met, the system10will not alert the driver so long as the vehicle350is distant. As mentioned, the distance detector19of the present invention can constantly measure the distance between the vehicles300and the vehicle before it (in the present case, vehicle350), the alerting system10′ is able to alert the driver200immediately once the vehicle300is getting close to the vehicle350(i.e. when their distance is less than the default distance). It should be noted, however, that the third criterion only kicks in when there is a vehicle in front of the vehicle300; if, on the other hand, the vehicle300is the first vehicle about to cross the section in its line, the alerting system10′ of the present invention will give alerts even only the first two criteria are met to avoid the vehicle300from running the red light. By alerting the driver200in such circumstance, the chance of collision can be greatly eliminated.

In some embodiment, the alarming device18may be embedded in the vehicle300. Alternatively, it can be any device capable of achieving the same purpose as described above. For instance, the alarming device18may be a handheld device (e.g. a mobile phone or a tablet) electronically and/or wirelessly connected to the control unit16. Thus, if the driver200is looking at the handheld device while waiting at the red light, once the traffic light400turns green, any sort of alarming, e.g. sounds, lights, vibrations, etc. can be issued via the handheld device to notify the driver200.

FIG. 5is a flowchart500of an alerting method in accordance with the present invention. The method may include the following steps:

Step510: gathering traffic images including a traffic sign instructing a driver in a vehicle to move, stop or slow the vehicle;

Step520: detecting the driver's gaze direction in the vehicle;

Step530: determining if the traffic sign changes based on the traffic images; and

Step540: alerting the driver if the traffic sign changes and the driver fails to see it.

Aside from the steps, the method may further include measuring the distance between the vehicle and the vehicle before it. In one scenario where the vehicle300is waiting at the red light and there is at least one another vehicle ahead of it, the alert will be given if the distance is greater than a default distance; while in another scenario where the vehicle300is moving forward and there is also another vehicle ahead of it, then the alert will be issued if the distance is less than another default distance.

Moreover, as discussed, the determination as to whether the driver is paying attention to the traffic sign is made based on the driver's gaze direction. If it is detected that the driver's gaze is not toward the direction of the traffic sign, the present invention presumes that the driver is not looking at the traffic sign, and consequently, the driver would not be aware of any change of the traffic sign.

In light of foregoing, the alerting system of the present invention alerts the driver of a vehicle when he/she fails to notice the change of the critical traffic sign. According to the disclosure, any sort of alarming, such as sounds, lights, images, vibrations, and/or any combination of the above may be adopted to alert the driver. Moreover, as discussed, the alerting system in the present invention may take a further step and only alert the driver if some additional criteria are also met. For instance, the invention may take the distance between with the front vehicle into account. Based on the design, the driver can not only be promptly but properly notified.