Patent ID: 11961392
Assignee: THE UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. An edge device for monitoring safety of a highway work zone and predicting vehicular intrusion into the highway work zone by vehicles and notifying a user of one or more assisted reality devices in the highway work zone before the vehicular intrusion enters the highway work zone, the edge device comprising:
at least one camera configured to capture images in sequence of the vehicles;
one or more processors; and
a memory storing computer-executable instructions that, when executed, cause the one or more processors to:
perform vehicle detection of the vehicles over an input of a data stream of the images via an input of streaming pixels, from the at least one camera, utilizing just-in-time processing to process a real-time feed from the at least one camera to predict a risk-causing event of a vehicular safety threat to the user, the event being the vehicular intrusion by the vehicles into the highway work zone;
determine a level of safety by tracking the vehicles detected and performing a time sequence analysis of the vehicles, wherein the images captured from the at least one camera are not stored; and
provide real-time alerts of varying levels of audio and visual warnings based on a severity of the vehicular safety threat determined by the edge device, which is located in the highway work zone or at a boundary of the highway work zone between the highway work zone and oncoming traffic, including sending a signal to the one or more assisted reality devices of the user in the highway work zone indicating the level of safety thereto to provide feedback to the user in the highway work zone as soon as the vehicular safety threat is detected by the edge device but before the vehicular safety threat enters the highway work zone to predict the vehicular intrusion into the highway work zone and notify the user of the one or more assisted reality devices before the vehicular safety threat enters the highway work zone to provide time for the user to avoid the vehicular safety threat, wherein the varying levels of warnings are based on risk values within a risk scale attuned to detected risk and vary based on a low risk defined as when no vehicle is detected traveling toward the work zone to high risk define as when the vehicle is moving toward the work zone, and processing employs a real-time deep learning algorithm;
wherein the edge device is configured to send the alerts only to the one or more assisted reality devices and the edge device is further configured to communicate with the one or more assisted reality devices through a local network established for communication between the edge device and the one or more assisted reality devices without requiring continuous access to the internet.