Patent Description:
The present disclosure generally relates to traffic monitoring technology, and in particular, to systems and methods for monitoring a traffic behavior of at least one object.

With the development of communication and multimedia technologies, the exploration of traffic monitoring has developed rapidly nowadays. Commonly, a traffic monitoring system can monitor a traffic behavior of an object (e.g., a vehicle, a pedestrian) by comparing status information (e.g., location information, velocity information) of the object with a traffic rule. However, in some situations, the traffic rule is determined manually by a technician, which improves the cost and complexity of the traffic monitoring and reduces the efficiency and accuracy of the traffic monitoring. Therefore, it is desirable to provide systems and methods for monitoring the traffic behavior of the object efficiently and accurately.

<CIT> relates to a violation detection and recording system for traffic violations such as red light traffic violations or speed violations and a violation evidence management and processing system.

<CIT> relates to a system and method for monitoring vehicle traffic and reporting pedestrian right of way violations by vehicles. The system combines two sensor modalities to monitor traffic intersections and track pedestrian movement and vehicle traffic.

<CIT> relates to a method and apparatus for monitoring traffic using vision-based technologies to recognize events and violations. The traffic monitoring system includes one or more image capture devices that are focused on a roadway where the vehicles travel. The captured images are processed by the traffic monitoring system to identify one or more predefined events of traffic violations.

An aspect of the present disclosure relates to a system for object monitoring. The system may include at least one storage medium including a set of instructions and at least one processor in communication with the at least one storage medium. When executing the set of instructions, the at least one processor may be directed to cause the system to obtain at least one image associated with a predetermined region captured by a capture device; obtain a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on one or more predetermined images associated with the predetermined region; identify at least one object in the at least one image; and monitor a traffic behavior of the at least one object based on the predetermined traffic rule.

In some embodiments, the capture device may include a camera, a video recorder, and/or a sensor.

In some embodiments, to obtain the predetermined traffic rule associated with the predetermined region, the at least one processor may be directed to cause the system to extract one or more traffic signs in the one or more predetermined images associated with the predetermined region and determine the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

In some embodiments, the one or more traffic signs may include a lane line, an indicator sign, a color of a traffic light, and/or a speed limit sign.

In some embodiments, to monitor the traffic behavior of the at least one object based on the predetermined traffic rule, the at least one processor may be directed to cause the system to determine status information associated with the at least object based on the at least one image and monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule.

In some embodiments, the status information associated with the at least object may include a type of the at least one object, location information of the at least one object, velocity information of the at least one object, a moving path of the at least one object, and/or a moving direction of the at least one object.

In some embodiments, to monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, for each of the at least one object, the at least one processor may be directed to cause the system further to determine whether the traffic behavior of the object violates the predetermined traffic rule based on the status information of the object and transmit event information associated with the traffic behavior of the object to a target device in response to determining that the traffic behavior of the object violates the predetermined traffic rule.

In some embodiments, the event information associated with the traffic behavior of the object may include at least one image corresponding to the object, the status information of the object, location information associated with the predetermined region, and/or a traffic violation type.

In some embodiments, the target device may include a traffic management department, a data center, an alarm center, and/or a terminal device associated with the object.

In some embodiments, to monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, for each of the at least one object, the at least one processor may be directed to cause the system further to determine whether the traffic behavior of the object satisfies a predetermined condition based on the status information according to the predetermined traffic rule and transmit reminder information to a terminal device associated with the object in response to determining that the traffic behavior of the object satisfies the predetermined condition.

In some embodiments, the at least one object may include a vehicle and/or a pedestrian.

In some embodiments, the at least one processor may be directed to cause the system further to store the at least one image associated with the predetermined region into a storage device according to a predetermined time interval.

A further aspect of the present disclosure relates to a method implemented on a computing device including at least one processor, at least one storage medium, and a communication platform connected to a network. The method may include obtaining at least one image associated with a predetermined region captured by a capture device; obtaining a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on one or more predetermined images associated with the predetermined region; identifying at least one object in the at least one image; and monitoring a traffic behavior of the at least one object based on the predetermined traffic rule.

A still further aspect of the present disclosure relates to a system for monitoring an object. The system may include a first obtaining module, a second obtaining module, an identification module, and a monitoring module. The first obtaining module may be configured to obtain at least one image associated with a predetermined region captured by a capture device. The second obtaining module may be configured to obtain a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on one or more predetermined images associated with the predetermined region. The identification module may be configured to identify at least one object in the at least one image. The monitoring module may be configured to monitor a traffic behavior of the at least one object based on the predetermined traffic rule.

A still further aspect of the present disclosure relates to a non-transitory computer readable medium including executable instructions. When the executable instructions are executed by at least one processor, the executable instructions may direct the at least one processor to perform a method. The method may include obtaining at least one image associated with a predetermined region captured by a capture device; obtaining a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on one or more predetermined images associated with the predetermined region; identifying at least one object in the at least one image; and monitoring a traffic behavior of the at least one object based on the predetermined traffic rule.

A still further aspect of the present disclosure relates to a system for object monitoring. The system may include at least one storage medium including a set of instructions and at least one processor in communication with the at least one storage medium. When executing the set of instructions, the at least one processor may be directed to cause the system to obtain at least one image associated with a predetermined region captured by a capture device; extract one or more traffic signs in the at least one image; determine a traffic rule based on the one or more traffic signs; and monitor a traffic behavior of at least one object associated with the predetermined region based on the traffic rule.

In some embodiments, to monitor the traffic behavior of the at least one object associated with the predetermined region based on the traffic rule, the at least one processor may be directed to cause the system further to determine status information associated with the at least one object based on the at least one image and monitor the traffic behavior of the at least one object based on the status information according to the traffic rule.

In some embodiments, to monitor the traffic behavior of the at least one object based on the status information according to the traffic rule, for each of the at least one object, the at least one processor may be directed to cause the system further to determine whether the traffic behavior of the object violates the traffic rule based on the status information of the object and in response to determining that the traffic behavior of the object violates the traffic rule, transmit event information associated with the traffic behavior of the object to a target device.

In some embodiments, to monitor the traffic behavior of the at least one object based on the status information according to the traffic rule, for each of the at least one object, the at least one processor may be directed to cause the system further to determine whether the traffic behavior of the object satisfies a predetermined condition based on the status information according to the traffic rule and transmit reminder information to a terminal device associated with the object in response to determining that the traffic behavior of the object satisfies the predetermined condition.

A further aspect of the present disclosure relates to a method implemented on a computing device including at least one processor, at least one storage medium, and a communication platform connected to a network. The method may include obtaining at least one image associated with a predetermined region captured by a capture device; extracting one or more traffic signs in the at least one image; determining a traffic rule based on the one or more traffic signs; and monitoring a traffic behavior of at least one object associated with the predetermined region based on the traffic rule.

A still further aspect of the present disclosure relates to a system for object monitoring. The system may include an image obtaining module, an extraction module, a traffic rule determination module, and a monitoring module. The image obtaining module may be configured to obtain at least one image associated with a predetermined region captured by a capture device. The extraction module may be configured to extract one or more traffic signs in the at least one image. The traffic rule determination module may be configured to determine a traffic rule based on the one or more traffic signs. The monitoring module may be configured to monitor a traffic behavior of at least one object associated with the predetermined region based on the traffic rule.

A still further aspect of the present disclosure relates to a non-transitory computer readable medium including executable instructions. When the executable instructions are executed by at least one processor, the executable instructions may direct the at least one processor to perform a method. The method may include obtaining at least one image associated with a predetermined region captured by a capture device; extracting one or more traffic signs in the at least one image; determining a traffic rule based on the one or more traffic signs; and monitoring a traffic behavior of at least one object associated with the predetermined region based on the traffic rule.

A still further aspect of the present disclosure relates to a system for determining a predetermined traffic rule. The system may include at least one storage medium including a set of instructions and at least one processor in communication with the at least one storage medium. When executing the set of instructions, the at least one processor may be directed to cause the system to obtain one or more predetermined images associated with a predetermined region captured by a capture device; extract one or more traffic signs in the one or more predetermined images; and determine a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

In some embodiments, the at least one processor may be directed to cause the system further to identify at least one object in the at least one image and monitor a traffic behavior of the at least one object based on the predetermined traffic rule.

A further aspect of the present disclosure relates to a method implemented on a computing device including at least one processor, at least one storage medium, and a communication platform connected to a network. The method may include obtaining one or more predetermined images associated with a predetermined region captured by a capture device; extracting one or more traffic signs in the one or more predetermined images; and determining a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

A still further aspect of the present disclosure relates to a system for determining a predetermined traffic rule. The system may include an image obtaining module, an extraction module, and a traffic rule determination module. The image obtaining module may be configured to obtain one or more predetermined images associated with a predetermined region captured by a capture device. The extraction module may be configured to extract one or more traffic signs in the one or more predetermined images. The traffic rule determination module may be configured to determine a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

A still further aspect of the present disclosure relates to a non-transitory computer readable medium including executable instructions. When the executable instructions are executed by at least one processor, the executable instructions may direct the at least one processor to perform a method. The method may include obtaining one or more predetermined images associated with a predetermined region captured by a capture device; extracting one or more traffic signs in the one or more predetermined images; and determining a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

An aspect of the present disclosure relates to systems and methods for object monitoring. The system may obtain at least one image associated with a predetermined region (e.g., a capture range of the capture device) captured by a capture device (e.g., a camera, a video recorder, a sensor) and a predetermined traffic rule associated with the predetermined region. Further, the system may identify at least one object (e.g., a vehicle, a pedestrian) in the at least one image and monitor a traffic behavior of the at least one object based on the predetermined traffic rule. For example, the system may determine whether the traffic behavior of the at least one object violates the predetermined traffic rule.

The predetermined traffic rule may be determined based on one or more predetermined images associated with the predetermined region. For example, the system may extract one or more traffic signs (e.g., a lane line, an indicator sign, a color of a traffic light, a speed limit sign) in the one or more predetermined images and determine the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs. The one or more predetermined images may be pre-stored in a storage device and the predetermined traffic rule may be generated offline based on the one or more predetermined images. Additionally or alternatively, the one or more predetermined images may be captured in real time (which can be considered that the one or more predetermined images are the same as the at least one image associated with the predetermined region) and the predetermined traffic rule may be generated in real time. According to the systems and methods of the present disclosure, a traffic rule associated with a predetermined region can be automatically generated based on images associated with the predetermined region, thereby improving the efficiency and accuracy of the traffic monitoring.

<FIG> is a schematic diagram illustrating an exemplary traffic monitoring system according to some embodiments of the present disclosure. As shown, the traffic monitoring system <NUM> may include a server <NUM>, a network <NUM>, an acquisition device (also referred to as a "capture device" or an "image capture device") <NUM>, a user device (also referred to as a "terminal device") <NUM>, and a storage device <NUM>.

The server <NUM> may be a single server or a server group. The server group may be centralized or distributed (e.g., the server <NUM> may be a distributed system). In some embodiments, the server <NUM> may be local or remote. For example, the server <NUM> may access information and/or data stored in the acquisition device <NUM>, the user device <NUM>, and/or the storage device <NUM> via the network <NUM>. As another example, the server <NUM> may be directly connected to the acquisition device <NUM>, the user device <NUM>, and/or the storage device <NUM> to access stored information and/or data. In some embodiments, the server <NUM> may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof. In some embodiments, the server <NUM> may be implemented on a computing device <NUM> including one or more components illustrated in <FIG> of the present disclosure.

In some embodiments, the server <NUM> may include a processing device <NUM>. The processing device <NUM> may process information and/or data relating to traffic monitoring to perform one or more functions described in the present disclosure. For example, the processing device <NUM> may obtain at least one image associated with a predetermined region and a predetermined traffic rule associated with the predetermined region. Further, the processing device <NUM> may identify at least one object in the at least one image and monitor a traffic behavior of the at least one object based on the predetermined traffic rule. As another example, in order to determine the predetermined traffic rule, the processing device <NUM> may obtain one or more predetermined images associated with the predetermined region and extract one or more traffic signs in the one or more predetermined images. Further, the processing device <NUM> may determine the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs. As a further example, the processing device <NUM> may obtain at least one image associated with a predetermined region and extract one or more traffic signs in the at least one image. Further, the processing device <NUM> may determine a traffic rule based on the one or more traffic signs and monitor a traffic behavior of at least one object associated with the predetermined region based on the traffic rule. In some embodiments, the processing device <NUM> may include one or more processing devices (e.g., single-core processing device(s) or multi-core processor(s)). Merely by way of example, the processing device <NUM> may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), a graphics processing unit (GPU), a physics processing unit (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction-set computer (RISC), a microprocessor, or the like, or any combination thereof.

In some embodiment, the sever <NUM> may be unnecessary and all or part of the functions of the server <NUM> may be implemented by other components (e.g., the acquisition device <NUM>, the user device <NUM>) of the traffic monitoring system <NUM>. For example, the processing device <NUM> may be integrated into the acquisition device <NUM> or the user device140 and the functions (e.g., monitoring a traffic behavior of an object) of the processing device <NUM> may be implemented by the acquisition device <NUM> or the user device140.

The network <NUM> may facilitate exchange of information and/or data for the traffic monitoring system <NUM>. In some embodiments, one or more components (e.g., the server <NUM>, the acquisition device <NUM>, the user device <NUM>, the storage device <NUM>) of the traffic monitoring system <NUM> may transmit information and/or data to other component(s) of the traffic monitoring system <NUM> via the network <NUM>. For example, the server <NUM> may obtain at least one image associated with a predetermined region from the acquisition device <NUM> via the network <NUM>. As another example, the server <NUM> may obtain a predetermined traffic rule associated with the predetermined region from the storage device <NUM>. In some embodiments, the network <NUM> may be any type of wired or wireless network, or combination thereof. Merely by way of example, the network <NUM> may include a cable network (e.g., a coaxial cable network), a wireline network, an optical fiber network, a telecommunications network, an intranet, an Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public telephone switched network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, or the like, or any combination thereof.

The acquisition device <NUM> may be configured to acquire at least one image (the "image" herein refers to a single image or a frame of a video). In some embodiments, the acquisition device <NUM> may include a camera <NUM>-<NUM>, a video recorder <NUM>-<NUM>, a sensor <NUM>-<NUM>, etc. The camera <NUM>-<NUM> may include a gun camera, a dome camera, an integrated camera, a monocular camera, a binocular camera, a multi-view camera, or the like, or any combination thereof. The video recorder <NUM>-<NUM> may include a PC Digital Video Recorder (DVR), an embedded DVR, or the like, or any combination thereof. The sensor <NUM>-<NUM> may include an acceleration sensor (e.g., a piezoelectric sensor), a velocity sensor (e.g., a Hall sensor), a distance sensor (e.g., a radar, an infrared sensor), a steering angle sensor (e.g., a tilt sensor), a traction-related sensor (e.g., a force sensor), or the like, or any combination thereof. The at least one image acquired by the acquisition device <NUM> may be a two-dimensional image, a three-dimensional image, a four-dimensional image, etc. In some embodiments, the acquisition device <NUM> may include a plurality of components each of which can acquire an image. For example, the acquisition device <NUM> may include a plurality of sub-cameras that can capture images or videos simultaneously. In some embodiments, the acquisition device <NUM> may transmit the acquired image to one or more components (e.g., the server <NUM>, the user device <NUM>, the storage device <NUM>) of the traffic monitoring system <NUM> via the network <NUM>.

The user device <NUM> may be configured to receive information and/or data from the server <NUM>, the acquisition device <NUM>, and/or the storage device <NUM> via the network <NUM>. For example, the user device <NUM> may receive event information (e.g., at least one image corresponding to the at least one object, a traffic violation type) associated with a traffic behavior of at least one object from the server <NUM>. As another example, the user device <NUM> may receive reminder information (e.g., a current status of the at least one object, a moving recommendation) from the server <NUM>. In some embodiments, the user device <NUM> may provide a user interface via which a user may view information and/or input data and/or instructions to the traffic monitoring system <NUM>. For example, the user may view event information associated with the traffic behavior of the at least one object obtained from the server <NUM> via the user interface. As another example, the user may input an instruction associated with a traffic monitoring parameter via the user interface. In some embodiments, the user device <NUM> may include a mobile phone <NUM>-<NUM>, a computer <NUM>-<NUM>, a wearable device <NUM>-<NUM>, or the like, or any combination thereof. In some embodiments, the user device <NUM> may include a display that can display information in a human-readable form, such as text, image, audio, video, graph, animation, or the like, or any combination thereof. The display of the user device <NUM> may include a cathode ray tube (CRT) display, a liquid crystal display (LCD), a light emitting diode (LED) display, a plasma display panel (PDP), a three dimensional (3D) display, or the like, or a combination thereof. In some embodiments, the user device <NUM> may be connected to one or more components (e.g., the server <NUM>, the acquisition device <NUM>, the storage device <NUM>) of the traffic monitoring system <NUM> via the network <NUM>.

The storage device <NUM> may be configured to store data and/or instructions. The data and/or instructions may be obtained from, for example, the server <NUM>, the acquisition device <NUM>, and/or any other component of the traffic monitoring system <NUM>. In some embodiments, the storage device <NUM> may store data and/or instructions that the server <NUM> may execute or use to perform exemplary methods described in the present disclosure. For example, the storage device <NUM> may store one or more predetermined images acquired by the acquisition device <NUM> and a predetermined traffic rule determined based on the one or more predetermined images. In some embodiments, the storage device <NUM> may include a mass storage, a removable storage, a volatile read-and-write memory, a read-only memory (ROM), or the like, or any combination thereof. Exemplary mass storage may include a magnetic disk, an optical disk, a solid-state drive, etc. Exemplary removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc. Exemplary volatile read-and-write memory may include a random access memory (RAM). Exemplary RAM may include a dynamic RAM (DRAM), a double date rate synchronous dynamic RAM (DDR SDRAM), a static RAM (SRAM), a thyristor RAM (T-RAM), and a zero-capacitor RAM (Z-RAM), etc. Exemplary ROM may include a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a compact disk ROM (CD-ROM), and a digital versatile disk ROM, etc. In some embodiments, the storage device <NUM> may be implemented on a cloud platform. Merely by way of example, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof.

In some embodiments, the storage device <NUM> may be connected to the network <NUM> to communicate with one or more components (e.g., the server <NUM>, the acquisition device <NUM>, the user device <NUM>) of the traffic monitoring system <NUM>. One or more components of the traffic monitoring system <NUM> may access the data or instructions stored in the storage device <NUM> via the network <NUM>. In some embodiments, the storage device <NUM> may be directly connected to or communicate with one or more components (e.g., the server <NUM>, the acquisition device <NUM>, the user device <NUM>) of the traffic monitoring system <NUM>. In some embodiments, the storage device <NUM> may be part of other components of the traffic monitoring system <NUM>, such as the server <NUM>, the acquisition device <NUM>, or the user device <NUM>.

It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure.

<FIG> is a schematic diagram illustrating exemplary hardware and/or software components of an exemplary computing device according to some embodiments of the present disclosure. In some embodiments, the server <NUM> may be implemented on the computing device <NUM>. For example, the processing device <NUM> may be implemented on the computing device <NUM> and configured to perform functions of the processing device <NUM> disclosed in this disclosure.

The computing device <NUM> may be used to implement any component of the traffic monitoring system <NUM> as described herein. For example, the processing device <NUM> may be implemented on the computing device <NUM>, via its hardware, software program, firmware, or a combination thereof. Although only one such computer is shown, for convenience, the computer functions relating to traffic monitoring as described herein may be implemented in a distributed fashion on a number of similar platforms to distribute the processing load.

The computing device <NUM>, for example, may include COM ports <NUM> connected to and from a network connected thereto to facilitate data communications. In some embodiments, the computing device <NUM> may include a transmission device (not shown) via which the computing device <NUM> may transmit information and/or data to external components. In some embodiments, the transmission device may include a Network Interface Controller (NIC) configured to connect to an external network device to communicate with the network <NUM>. In some embodiments, the transmission device may include a Radio Frequency (RF) module configured to communicate with the network <NUM> via a wireless connection.

The computing device <NUM> may also include a processor (e.g., a processor <NUM>), in the form of one or more processors (e.g., logic circuits), for executing program instructions. For example, the processor <NUM> may include interface circuits and processing circuits therein. The interface circuits may be configured to receive electronic signals from a bus <NUM>, wherein the electronic signals encode structured data and/or instructions for the processing circuits to process. The processing circuits may conduct logic calculations, and then determine a conclusion, a result, and/or an instruction encoded as electronic signals. Then the interface circuits may send out the electronic signals from the processing circuits via the bus <NUM>.

The computing device <NUM> may further include program storage and data storage of different forms including, for example, a disk <NUM>, a read-only memory (ROM) <NUM>, or a random-access memory (RAM) <NUM>, for storing various data files to be processed and/or transmitted by the computing device <NUM>. The computing device <NUM> may also include program instructions stored in the ROM <NUM>, RAM <NUM>, and/or another type of non-transitory storage medium to be executed by the processor <NUM>. The methods and/or processes of the present disclosure may be implemented as the program instructions. The computing device <NUM> may also include an I/O component <NUM>, supporting input/output between the computing device <NUM> and other components. The computing device <NUM> may also receive programming and data via network communications.

Merely for illustration, only one processor is illustrated in <FIG>. Multiple processors <NUM> are also contemplated; thus, operations and/or method steps performed by one processor <NUM> as described in the present disclosure may also be jointly or separately performed by the multiple processors. For example, if in the present disclosure the processor <NUM> of the computing device <NUM> executes both step A and step B, it should be understood that step A and step B may also be performed by two different processors <NUM> jointly or separately in the computing device <NUM> (e.g., a first processor executes step A and a second processor executes step B, or the first and second processors jointly execute steps A and B).

<FIG> is a schematic diagram illustrating exemplary hardware and/or software components of an exemplary terminal device according to some embodiments of the present disclosure. In some embodiments, the user device <NUM> may be implemented on the terminal device <NUM> shown in <FIG>.

As illustrated in <FIG>, the terminal device <NUM> may include a communication platform <NUM>, a display <NUM>, a graphic processing unit (GPU) <NUM>, a central processing unit (CPU) <NUM>, an I/O <NUM>, a memory <NUM>, and a storage <NUM>. In some embodiments, any other suitable component, including but not limited to a system bus or a controller (not shown), may also be included in the terminal device <NUM>.

In some embodiments, an operating system <NUM> (e.g., iOS™, Android™, Windows Phone™) and one or more applications (Apps) <NUM> may be loaded into the memory <NUM> from the storage <NUM> in order to be executed by the CPU <NUM>. The applications <NUM> may include a browser or any other suitable mobile apps for receiving and rendering information relating to traffic monitoring or other information from the processing device <NUM>. User interactions may be achieved via the I/O <NUM> and provided to the processing device <NUM> and/or other components of the traffic monitoring system <NUM> via the network <NUM>.

<FIG> is a flowchart illustrating an exemplary process for generating a traffic rule according to some embodiments of the present disclosure. In some embodiments, the process <NUM> may be implemented as a set of instructions (e.g., an application) stored in the storage ROM <NUM> or RAM <NUM>. The processor <NUM> and/or the modules in <FIG> may execute the set of instructions, and when executing the instructions, the processor <NUM> and/or the modules may be configured to perform the process <NUM>. The operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process <NUM> may be accomplished with one or more additional operations not described and/or without one or more of the operations herein discussed. Additionally, the order in which the operations of the process as illustrated in <FIG> and described below is not intended to be limiting.

In <NUM>, traffic signs in a target region (also referred to as a "predetermined region") may be obtained from multimedia information associated with the target region captured by an image capture device (also referred to as a "capture device") (e.g., the acquisition device <NUM>). In some embodiments, the traffic signs in the target region may be obtained from the multimedia information by a traffic rule generation device <NUM> (e.g., an obtaining module <NUM> illustrated in <FIG>). In some embodiments, the target region may be a region including a capture range of the image capture device.

In some embodiments, the multimedia information may include at least one image associated with the target region, at least one video associated with the target region, acoustic information, text information, or the like, or any combination thereof. In some embodiments, the multimedia information may be obtained from a storage device (e.g., the storage device <NUM>). In some embodiments, the multimedia information may be captured in real-time by the image capture device.

In some embodiments, the traffic signs may include a lane line, an indicator sign, a color of a traffic light, a speed limit sign, or the like, or any combination thereof. More descriptions of the traffic signs may be found elsewhere in the present disclosure (e.g., <FIG>, <FIG>, and the descriptions thereof).

In <NUM>, a traffic rule may be generated based on the traffic signs. In some embodiments, the traffic rule may be generated by the traffic rule generation device <NUM> (e.g., a generation module <NUM> illustrated in <FIG>). As used herein, the traffic rule may refer to a rule or a regulation associated with a road (or a region) that an object (e.g., a vehicle, a pedestrian) on the road (or in the region) must follow. For example, the traffic rule may be "stop at a red light," "go at a green light (i.e., a prescribed moving time period)," "a speed limit associated with a specific region (e.g., an intersection)," "a speed limit associated with a specific road (e.g., a highway)," "a prescribed moving direction associated with a specific road (e.g., a one-way)," "a prescribed moving region associated with a specific region (e.g., an intersection)," "a moving rule (e.g., lane change allowed, no lane change) associated with a specific region," "a prescribed vehicle type associated with a specific lane (e.g., a motor vehicle lane, a non-motor vehicle lane)," "a prescribed parking region," etc. In some embodiments, the traffic rule may be used to monitor at least one object (e.g., a vehicle, a pedestrian) passing through the target region.

In some embodiments, according to process <NUM>, a traffic rule can be automatically generated based on traffic signs in a target region and at least one object passing through the target region can be monitored based on the generated traffic rule, which can solve technical problems that the determination of the traffic rule requires manual intervention, which may result in a high cost and a complexity process. Accordingly, according to process <NUM>, the traffic rule can be automatically generated based on the traffic signs without manual intervention, which can reduce the cost and simplify the process for generating the traffic rule, thereby improving the efficiency and accuracy of the traffic monitoring.

In some embodiments, after the traffic rule is generated based on the traffic signs, the at least one object may be monitored based on the generated traffic rule. Further, when it is detected that the at least one object has a violation behavior (also referred to as an "illegal behavior"), multimedia information corresponding to the violation behavior may be transmitted to a backstage (also referred to as a "target device") (e.g., a traffic management department, a data center, an alarm center, a terminal device associated with the object). According to the embodiments of the present disclosure, when it is detected that the at least one object has the violation behavior based on the generated traffic rule, a video associated with the violation behavior may be recorded and the recorded video may be transmitted to the backstage for subsequent processing by a relevant personnel. For example, the relevant personnel may confirm the violation behavior based on the recorded video and transmit information associated with the violation behavior to the at least one object (e.g., a terminal device of the at least one object). In some embodiments, the multimedia information (e.g., the video) obtained by monitoring the at least one object may be stored according to a predetermined time interval. The predetermined time interval may be a default setting of the traffic monitoring system <NUM> or may be adjustable under different situations.

In some embodiments, status information of the at least one object in the target region may be obtained. When the at least one object is a vehicle, the status information may include a location of the vehicle in the target region, a driving velocity of the vehicle, a driving direction of the vehicle, a driving path of the vehicle, a type (e.g., a motor vehicle, a non-motor vehicle) of the vehicle, or the like, or any combination thereof. When the at least one object is a pedestrian, the status information may include a location of the pedestrian in the target region, a moving path of the pedestrian in the target region, a moving direction of the pedestrian in the target region, or the like, or any combination thereof. The "velocity" used in the present disclosure includes direction and magnitude (which can be referred to as "speed"). Further, the at least one object may be monitored based on the traffic rule and the status information. For example, whether the vehicle is speeding may be monitored by comparing the speed limit in the traffic rule of the target region and the driving velocity of the vehicle. As another example, whether the vehicle is going through a red light may be monitored based on the color of the traffic light and the location of the vehicle. According to the embodiments of the present disclosure, a vehicle or a pedestrian in the target region may be simultaneously monitored and whether the vehicle or the pedestrian has a violation behavior may be determined.

It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations or modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure.

<FIG> are schematic diagrams illustrating exemplary lane lines according to some embodiments of the present disclosure. As illustrated, the lane line may include a lane central line (e.g., <NUM> illustrated in <FIG>, <NUM> illustrated in <FIG>, <NUM> illustrated in <FIG>, <NUM> illustrated in <FIG>), a lane dividing line (e.g., <NUM> illustrated in <FIG>), a guide lane line (e.g., <NUM> illustrated in <FIG>), a lane edge line (e.g., <NUM> and <NUM> illustrated in <FIG>), a stop line (e.g., <NUM> illustrated in <FIG>), a give way line (e.g., <NUM> illustrated in <FIG>, <NUM> illustrated <FIG>), a crosswalk line (e.g., <NUM> illustrated in <FIG>), a diversion line (e.g., <NUM> illustrated in <FIG>), etc..

The lane central line may refer to a line (e.g., a dotted line, a solid line, or a combination thereof) used to separate traffic flows along opposite directions. As illustrated in <FIG>, the lane central line may be a single dotted line <NUM> indicating that a vehicle is allowed to overtake or turn left across the lane central line. As illustrated in <FIG>, the lane central line may be a single solid line <NUM> indicating that a vehicle is not allowed to overtake or turn left across the lane central line. As illustrated in <FIG>, the lane central line may be a combination <NUM> of a dotted line and a solid line indicating that a vehicle in a side of the dotted line is allowed to overtake or turn left across the lane central line and a vehicle in a side of the solid line is not allowed to overtake or turn left across the lane central line. As illustrated in <FIG>, the lane central line may be a double solid line <NUM> indicating that a vehicle is prohibited from overtaking or turning left across the lane central line.

The lane dividing line may refer to a line used to separate traffic flows along a same direction. As illustrated in <FIG>, the lane dividing line may be a dotted line <NUM> indicating that the vehicle is allowed to overtake or change a lane across the lane dividing line.

The guide lane line may refer to a line used to guide a moving direction of a vehicle. As illustrated in <FIG>, the guide lane line may be a solid line <NUM> indicating that a vehicle should move along a direction indicated by the guide lane line (e.g., an arrow in the guide lane line).

The lane edge line may refer to a line used to indicate an edge of a lane. As illustrated in <FIG>, the lane edge line may be a solid line <NUM> indicating an edge of a motor vehicle lane (i.e., a line dividing a motor vehicle lane and a non-motor vehicle lane) or a solid line <NUM> indicating an edge of a non-motor vehicle lane.

The stop line may refer to a line used to indicate a stop position where a vehicle waits for a release signal of a traffic light (e.g., a traffic light <NUM>). As illustrated in <FIG>, the stop line may be a solid line <NUM> indicating that a vehicle should stop behind the stop line when waiting for the release signal.

The give way line may refer to a line used to indicate a position where a vehicle should stop or slow down to give way. As illustrated in <FIG>, the give way line may be a double solid line <NUM> indicating that the vehicle should stop and give way. As illustrated in <FIG>, the give way line may be a double dotted line <NUM> indicating that a vehicle should slow down and give way.

The crosswalk line (also referred to as a "zebra stripe") may refer to a line region used to indicate that pedestrians are allowed to cross a road through the line region. As illustrated in <FIG>, the crosswalk line may be a region <NUM> including a plurality of rectangular blocks (or solid lines).

The diversion line may refer to a line region (e.g., a v-shaped region, a twill region, a circular region) used to indicate that a vehicle must move according to a prescribed route and must not press or cross the diversion line. As illustrated in <FIG>, the diversion line may be a circular line region <NUM>. A shape of the diversion line may be associated with a terrain condition of a road.

<FIG> are schematic diagrams illustrating exemplary indicator signs according to some embodiments of the present disclosure. As illustrated, the indicator signs may include a straight arrow pointing to the front illustrated in <FIG> indicating "ahead only," a curved arrow pointing to the left illustrated in <FIG> indicating "turn left ahead," a curved arrow pointing to the right illustrated in <FIG> indicating "turn right ahead," a combination of a straight arrow pointing to the front and a curved arrow pointing to the left illustrated in <FIG> indicating "ahead or turn left," a combination of a curved arrow pointing to the left and a curved arrow pointing to the right illustrated in <FIG> indicating "right or left only," a straight arrow pointing to the bottom right illustrated in <FIG> indicating "keep right," a straight arrow pointing to the bottom left illustrated in <FIG> indicating "keep left," a combination of a straight arrow pointing to the front and a cross curved arrow pointing to the left illustrated in <FIG> indicating "stereo cross ahead or turn left ahead," a combination of a straight arrow pointing to the front, a straight arrow pointing to the right, and a curved arrow pointing to the right illustrated in <FIG> indicating "stereo cross ahead or turn right ahead," a combination of three curved arrows illustrated in <FIG> indicating "roundabout," a straight arrow pointing to the right illustrated in <FIG> indicating "one way traffic (right)," a straight arrow pointing to the front illustrated in <FIG> indicating "one way traffic (ahead)," a simplified drawing of two people illustrated in <FIG> indicating "walking area," a simplified drawing of a horn illustrated in <FIG> indicating "sound honk," a number illustrated in <FIG> indicating "speed limit (e.g., speed limit "<NUM>/h")," an arrow including two wings illustrated in <FIG> indicating "priority at Intersection," etc..

In <NUM>, multimedia information associated with a target region may be captured. In some embodiments, the multimedia information may be captured by a traffic rule generation device <NUM> (e.g., an acquisition module <NUM> illustrated in <FIG>).

In <NUM>, the multimedia information may be transmitted to an electronic device via a network (e.g., the network <NUM>). In some embodiments, the multimedia information may be transmitted to the electronic device by the traffic rule generation device <NUM> (e.g., a transmission module <NUM> illustrated in <FIG>). Further, the electronic device may obtain traffic signs in the target region from the multimedia information and generate a traffic rule based on the traffic signs. In some embodiments, the traffic rule may be used to monitor at least one object passing through the target region. In some embodiments, the electronic device may be a separate component of the traffic monitoring system <NUM> or may be integrated into one or more components (e.g., the processing device <NUM>, the user device140) of the traffic monitoring system <NUM>.

According to process <NUM>, a traffic rule can be automatically generated based on traffic signs in a target region and at least one object passing through the target region can be monitored based on the generated traffic rule, which can solve technical problems that the determination of the traffic rule requires manual intervention, which may result in a high cost and a complexity process. Accordingly, according to process <NUM>, the traffic rule can be automatically generated based on the traffic signs without manual intervention, which can reduce the cost and simplify the process for generating the traffic rule, thereby improving the efficiency and accuracy of the traffic monitoring.

In some embodiments, for different traffic scenes, different traffic rules may be generated based on traffic signs in the traffic scenes.

At an intersection, an image capture device (e.g., a camera) is set back to the intersection and can capture multimedia information (e.g., images, videos) associated with a target region (e.g., a region including the intersection). Traffic signs (e.g., lane lines (e.g., a dotted line, a solid line, a double line), indicator signs (e.g., moving direction signs)) in the target region may be extracted from the multimedia information. According to the traffic signs, a traffic rule (e.g., a prescribed moving region associated with the intersection, a prescribed moving direction associated with the intersection, a prescribed vehicle type associated with the intersection, a prescribed parking region, a speed limit) may be automatically generated. For example, according to lane central lines, lane edge lines, and lane dividing lines on a road where the intersection is located, the prescribed moving region associated with the intersection may be determined. As another example, according to types (e.g., a solid line or a dotted line) of lane lines on the road, whether a vehicle is allowed to change lane across the lane lines may be determined. As a further example, according to the moving direction signs at the intersection, the prescribed moving direction associated with the intersection may be determined.

When at least one object (e.g., a vehicle, a pedestrian) passes through the intersection, status information (e.g., location information, velocity information, a moving direction, a moving path) of the at least one object may be extracted from the multimedia information. According to the status information and the traffic rule, a traffic behavior of the at least one object may be monitored. For example, according to the prescribed moving region and the moving path of the vehicle at the intersection, whether the vehicle has an illegal lane change may be determined. As another example, according to the prescribed moving direction and the moving direction of the vehicle, whether the vehicle is conversely driving may be determined. As a further example, according to the prescribed moving region and the location information of the pedestrian, whether the pedestrian is on a motor vehicle lane may be determined. As a still further example, according to the prescribed parking region and the location information of the vehicle, whether the vehicle has an illegal parking may be determined.

The image capture device (e.g., the camera) is set at a position facing a traffic light and has a certain distance from the traffic light. Traffic signs (e.g., a color of the traffic light) in the target region may be extracted from the multimedia information captured by the camera. According to the color of the traffic light, a traffic rule (e.g., a prescribed moving time period, a prescribed moving region within the prescribed moving time period) may be automatically generated. When the at least one object passes through the target region, status information (e.g., location information, a moving path) of the at least one object may be extracted from the multimedia information. According to the status information and the traffic rule, a traffic behavior of the at least one object may be monitored. For example, according to the prescribed moving region within the prescribed moving time period and the location information of the at least one object within the prescribed moving time period, whether the at least one object runs a red traffic light may be determined.

According to a type of the vehicle and a location (or a distance) of the vehicle in the multimedia information (e.g., the video) associated with the target region, sizes of the vehicle in different locations (e.g., different frames of the video) of the multimedia information may be determined. Further, a velocity of the vehicle may be determined. According to the velocity of the vehicle and the speed limit in the traffic rule generated based on traffic signs (e.g., a speed limit sign) extracted from the multimedia information, whether the vehicle is speeding or driving at a low speed may be determined. Further, according to velocity information of a plurality of vehicles in the target region, whether a congestion occurs in the target region may be determined.

<FIG> is a schematic diagram illustrating an exemplary process for generating a traffic rule and/or monitoring at least one object based on the traffic rule according to some embodiments of the present disclosure.

Step <NUM>: The image capture device (e.g., a camera <NUM>) may capture multimedia information (e.g., an image, a video) associated with a target region and transmit the multimedia information to a detection module <NUM>.

Step <NUM>: The detection module <NUM> may extract traffic signs (e.g., a lane line, a color of a traffic light, zebra stripes, a roadblock) associated with the target region from the received multimedia information and transmit the traffic signs to a traffic rule generation module <NUM>. The detection module <NUM> may also identify at least one object (e.g., a vehicle, a pedestrian) in the received multimedia information, extract status information (e.g., a type of the vehicle, location information of the vehicle, a moving path of the vehicle, a moving direction of the vehicle, location information of the pedestrian, a moving path of the pedestrian, a moving direction of the pedestrian) associated with the at least one object from the received multimedia information, and transmit the status information to a path tracking module <NUM>. The detection module <NUM> may also determine a relationship between pixel distance information in the multimedia information and actual distance information based on the type of the vehicle and transmit the relationship to the traffic rule generation module <NUM>.

Step <NUM>: The traffic rule generation module <NUM> may generate a traffic rule (which may be used to monitor a traffic behavior of an object) based on the received traffic signs. For example, the traffic rule generation module <NUM> may determine information including a prescribed moving direction for vehicles, whether vehicles are allowed to turn around, cross a lane line, or park, a speed limit of vehicles, etc. Further, the traffic rule generation module <NUM> may determine the traffic rule based on the above information. In some embodiments, the traffic rule may include but not limited to "driving on a lane line," "illegal lane change," "illegal parking," "over speed," "low speed," "running a red light," "a vehicle is driving on a lane which does not match the type of the vehicle," "a pedestrian is moving on a lane," "converse driving," "congestion," etc. Further, the traffic rule generation module <NUM> may transmit the traffic rule to a traffic rule configuration and saving module <NUM>.

Step <NUM>: The traffic rule configuration and saving module <NUM> may generate a configuration of the traffic rule and save the configuration. Further, the traffic rule configuration and saving module <NUM> may transmit the configuration to a violation detection module <NUM>.

Step <NUM>: The path tracking module <NUM> may track the moving path of the at least one object (e.g., a vehicle, a pedestrian). For example, the path tracking module <NUM> may track the moving path of the at least one object by merging a plurality of video frames corresponding to the target region. Further, the path tracking module <NUM> may transmit the status information and the tracked moving path of the at least one object to the violation detection module <NUM>.

Step <NUM>: The violation detection module <NUM> may monitor the traffic behavior of the at least one object based on the traffic rule and the status information and/or the tracked moving path of the at least one object. Further, the violation detection module <NUM> may determine event information (e.g., at least one image corresponding to the at least one object, the status information of the at least one object, location information associated with the target region, a traffic violation type) associated with the traffic behavior of the at least one object and transmit the event information to a violation data reporting module <NUM>.

Step <NUM>: A storage module <NUM> may store the multimedia information (e.g., the image, the video) received from the image capture device according to a predetermined time interval, which can ensure that multimedia information associated with the violation traffic behavior is complete and then the multimedia information can be divided and reported according to time. Further, the storage module <NUM> may transmit the multimedia information associated with the violation traffic behavior to a violation data reporting module <NUM>.

Step <NUM>: The violation data reporting module <NUM> may manage the event information received from the violation detection module <NUM> and the multimedia information associated with the violation traffic behavior received from the storage module <NUM>. Further, the violation data reporting module <NUM> may report the event information and the multimedia information to a violation data management platform <NUM>.

According to the above operations, traffic signs may be automatically identified from multimedia information associated with a traffic scene and a traffic rule may be automatically generated based on the traffic signs. Further, a traffic behavior of at least one object may be monitored based on the traffic rule.

<FIG> is a block diagram illustrating an exemplary traffic rule generation device according to some embodiments of the present disclosure. The traffic rule generation device <NUM> may include an obtaining module <NUM> and a generation module <NUM>. In some embodiments, one or more components of the traffic rule generation device <NUM> may be integrated into the processing device <NUM>.

The obtaining module <NUM> may be configured to obtain traffic signs in a target region from multimedia information associated with the target region captured by an image capture device (e.g., the acquisition device <NUM>). In some embodiments, the traffic signs may include a lane line, an indicator sign, a color of a traffic light, a speed limit sign, or the like, or any combination thereof.

The generation module <NUM> may be configured to generate a traffic rule based on the traffic signs. In some embodiments, the traffic rule may be used to monitor at least one object (e.g., a vehicle, a pedestrian) passing through the target region.

According to the above technical solution, a traffic rule can be automatically generated based on traffic signs in a target region and at least one object passing through the target region can be monitored based on the generated traffic rule, which can solve technical problems that the determination of the traffic rule requires manual intervention, which may result in a high cost and a complexity process. Accordingly, according to the above technical solution, the traffic rule can be automatically generated based on the traffic signs without manual intervention, which can reduce the cost and simplify the process for generating the traffic rule, thereby improving the efficiency and accuracy of the traffic monitoring.

In some embodiments, the generation module <NUM> may monitor the at least one object based on the generated traffic rule. Further, when it is detected that the at least one object has a violation behavior, the generation module <NUM> may transmit multimedia information corresponding to the violation behavior to a backstage (e.g., a traffic management department, a data center, an alarm center, a terminal device associated with the object). According to the embodiments of the present disclosure, when it is detected that the at least one object has the violation behavior based on the generated traffic rule, a video associated with the violation behavior may be recorded and the recorded video may be transmitted to the backstage for subsequent processing by a relevant personnel. In some embodiments, the multimedia information (e.g., the video) obtained by monitoring the at least one object may be stored according to a predetermined time interval.

In some embodiments, the obtaining module <NUM> may obtain status information of the at least one object in the target region. When the at least one object is a vehicle, the status information may include a location of the vehicle in the target region, a driving velocity of the vehicle, a driving direction of the vehicle, a driving path of the vehicle, a type (e.g., a motor vehicle, a non-motor vehicle) of the vehicle, or the like, or any combination thereof. When the at least one object is a pedestrian, the status information may include a location of the pedestrian in the target region, a moving path of the pedestrian in the target region, a moving direction of the pedestrian in the target region, or the like, or any combination thereof. Further, the at least one object may be monitored based on the traffic rule and the status information. According to the embodiments of the present disclosure, a vehicle or a pedestrian in the target region may be simultaneously monitored and whether the vehicle or the pedestrian has a violation behavior may be determined.

The modules in the traffic rule generation device <NUM> may be connected to or communicate with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, or the like, or any combination thereof. The wireless connection may include a Local Area Network (LAN), a Wide Area Network (WAN), a Bluetooth, a ZigBee, a Near Field Communication (NFC), or the like, or any combination thereof. Two or more of the modules may be combined as a single module, and any one of the modules may be divided into two or more units.

<FIG> is a block diagram illustrating an exemplary traffic rule generation device according to some embodiments of the present disclosure. The traffic rule generation device <NUM> may include an acquisition module <NUM> and a transmission module <NUM>. In some embodiments, one or more components of the traffic rule generation device <NUM> may be integrated into the processing device <NUM>.

The acquisition module <NUM> may be configured to capture multimedia information associated with a target region.

The transmission module <NUM> may be configured to transmit the multimedia information to an electronic device. Further, the electronic device may obtain traffic signs in the target region from the multimedia information and generate a traffic rule based on the traffic signs. In some embodiments, the traffic rule may be used to monitor at least one object passing through the target region.

<FIG> is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure. The processing device <NUM> may include a first obtaining module <NUM>, a second obtaining module <NUM>, an identification module <NUM>, and a monitoring module <NUM>.

The first obtaining module <NUM> may be configured to obtain at least one image (e.g., a static image, a video frame) associated with a predetermined region captured by a capture device (e.g., the acquisition device <NUM>).

The second obtaining module <NUM> may be configured to obtain a predetermined traffic rule associated with the predetermined region. In some embodiments, the predetermined traffic rule may be determined based on one or more predetermined images associated with the predetermined region.

The identification module <NUM> may be configured to identify at least one object in the at least one image. As described in connection with <FIG>, the at least one object may include a vehicle or a pedestrian.

The monitoring module <NUM> may be configured to monitor a traffic behavior of the at least one object based on the predetermined traffic rule. In some embodiments, the monitoring module <NUM> may determine status information associated with the at least object based on the at least one image. The status information associated with the at least object may include a type of the at least one object, location information of the at least one object, velocity information of the at least one object, a moving path of the at least one object, a moving direction of the at least one object, or the like, or any combination thereof. Further, the monitoring module <NUM> may monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule.

The modules in the processing device <NUM> may be connected to or communicate with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, or the like, or any combination thereof. The wireless connection may include a Local Area Network (LAN), a Wide Area Network (WAN), a Bluetooth, a ZigBee, a Near Field Communication (NFC), or the like, or any combination thereof. Two or more of the modules may be combined as a single module, and any one of the modules may be divided into two or more units.

For example, the first obtaining module <NUM> and the second obtaining module <NUM> may be combined as a single module which may both obtain the at least one image associated with the predetermined region and the predetermined traffic rule associated with the predetermined region. As another example, the processing device <NUM> may also include a transmission module configured to transmit signals (e.g., electrical signals, electromagnetic signals) to one or more components (e.g., the user device <NUM>) of the traffic monitoring system <NUM>. As a further example, the processing device <NUM> may include a storage module (not shown) used to store information and/or data (e.g., the predetermined region, the at least one image associated with the predetermined region) associated with the traffic monitoring.

<FIG> is a flowchart illustrating an exemplary process for object monitoring according to some embodiments of the present disclosure. In some embodiments, the process <NUM> may be implemented as a set of instructions (e.g., an application) stored in the storage ROM <NUM> or RAM <NUM>. The processor <NUM> and/or the modules in <FIG> may execute the set of instructions, and when executing the instructions, the processor <NUM> and/or the modules may be configured to perform the process <NUM>. The operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process <NUM> may be accomplished with one or more additional operations not described and/or without one or more of the operations herein discussed. Additionally, the order in which the operations of the process as illustrated in <FIG> and described below is not intended to be limiting.

In <NUM>, the processing device <NUM> (e.g., the first obtaining module <NUM>) (e.g., the interface circuits of the processor <NUM>) may obtain at least one image (e.g., a static image, a video frame) associated with a predetermined region captured by a capture device (e.g., the acquisition device <NUM>). In some embodiments, the predetermined region may be a region including a capture range of the capture device.

In some embodiments, the capture device may be mounted in the predetermined region (e.g., an intersection) and configured to capture the at least one image from the predetermined region. In some embodiments, the processing device <NUM> may directly obtain the at least one image from the capture device. In some embodiments, after capturing the at least one image, the capture device may transmit the at least one captured image to a storage device (e.g., the storage device <NUM>) to store according to a predetermined time interval. Accordingly, the processing device <NUM> may obtain the at least one image from the storage device.

In <NUM>, the processing device <NUM> (e.g., the second obtaining module <NUM>) (e.g., the interface circuits or the processing circuits of the processor <NUM>) may obtain a predetermined traffic rule associated with the predetermined region. As described in connection with <FIG>, the predetermined traffic rule may refer to a rule or a regulation associated with a road (or a region) that an object (e.g., a vehicle, a pedestrian) on the road (or in the region) must follow.

In some embodiments, the predetermined traffic rule may be determined based on one or more predetermined images associated with the predetermined region. For example, as described elsewhere in the present disclosure, the processing device <NUM> or a traffic rule generation device <NUM> illustrated in <FIG> may extract one or more traffic signs in the one or more predetermined images and determine the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs. In some embodiments, the one or more predetermined images may be pre-stored in the storage device <NUM> and the predetermined traffic rule may be generated offline based on the one or more predetermined images and stored in the storage device <NUM>. Accordingly, the processing device <NUM> may directly obtain the predetermined traffic rule from the storage device <NUM>. In some embodiments, the one or more predetermined images may be captured in real time (which can be considered that the one or more predetermined images are the same as the at least one image associated with the predetermined region) and the processing device <NUM> may generate the predetermined traffic rule in real time. More descriptions regarding determining the predetermined traffic rule may be found elsewhere in the present disclosure (e.g., <FIG>, <FIG>, and the descriptions thereof).

In <NUM>, the processing device <NUM> (e.g., the identification module <NUM>) (e.g., the processing circuits of the processor <NUM>) may identify at least one object in the at least one image.

As described in connection with <FIG>, the at least one object may include a vehicle or a pedestrian. In some embodiments, the processing device <NUM> may identify the at least one object in the at least one image based on at least one feature (e.g., a shape, a size) of the at least one object. In some embodiments, the processing device <NUM> may identify the at least one object according to an object recognition algorithm (e.g., a Region- Convolutional Neural Network (R-CNN), a Scale Normalization for Image Pyramids (SIPN), a Detection with Enriched Semantics (DES), a Scale-Transferrable Detection Network (STDN)).

In <NUM>, the processing device <NUM> (e.g., the monitoring module <NUM>) (e.g., the processing circuits of the processor <NUM>) may monitor a traffic behavior of the at least one object based on the predetermined traffic rule. As used herein, the traffic behavior may include "walking," "moving," "turning around," "stop," or the like, or a combination thereof.

In some embodiments, the processing device <NUM> may determine status information associated with the at least object based on the at least one image. The status information associated with the at least object may include a type of the at least one object, location information of the at least one object, velocity information of the at least one object, a moving path of the at least one object, a moving direction of the at least one object, or the like, or any combination thereof. Further, the processing device <NUM> may monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule. For example, as described in connection with <FIG>, the processing device <NUM> may monitor the traffic behavior of the at least one object by comparing the status information associated with the at least object with the predetermined traffic rule. More descriptions regarding monitoring the traffic behavior may be found elsewhere in the present disclosure (e.g., <FIG> and the description thereof).

It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations or modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure. For example, one or more other optional operations (e.g., a storing operation) may be added elsewhere in the process <NUM>. In the storing operation, the processing device <NUM> may store information and/or data (e.g., the predetermined region, the at least one image associated with the predetermined region) associated with the traffic monitoring in a storage device (e.g., the storage device <NUM>) disclosed elsewhere in the present disclosure. As another example, operation <NUM> and operation <NUM> may be combined into a single operation in which the processing device <NUM> may both obtain the at least one image associated with the predetermined region and the predetermined traffic rule associated with the predetermined region.

<FIG> is a block diagram illustrating an exemplary traffic rule generation device according to some embodiments of the present disclosure. The traffic rule generation device <NUM> may include an image obtaining module <NUM>, an extraction module <NUM>, and a traffic rule determination module <NUM>. In some embodiments, one or more components of the traffic rule generation device <NUM> may be integrated into the processing device <NUM>.

The image obtaining module <NUM> may be configured to obtain one or more predetermined images associated with a predetermined region captured by a capture device.

The extraction module <NUM> may be configured to extract one or more traffic signs in the one or more predetermined images.

The traffic rule determination module <NUM> may be configured to determine a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

<FIG> is a flowchart illustrating an exemplary process for determining a predetermined traffic rule according to some embodiments of the present disclosure. In some embodiments, the process <NUM> may be implemented as a set of instructions (e.g., an application) stored in the storage ROM <NUM> or RAM <NUM>. The processor <NUM> and/or the modules in <FIG> may execute the set of instructions, and when executing the instructions, the processor <NUM> and/or the modules may be configured to perform the process <NUM>. The operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process <NUM> may be accomplished with one or more additional operations not described and/or without one or more of the operations herein discussed. Additionally, the order in which the operations of the process as illustrated in <FIG> and described below is not intended to be limiting.

In <NUM>, the traffic rule generation device <NUM> (e.g., the image obtaining module <NUM>) may obtain one or more predetermined images associated with a predetermined region captured by a capture device (e.g., camera).

In some embodiments, the traffic rule generation device <NUM> may obtain the one or more predetermined images captured by the capture device in real-time. In some embodiments, the traffic rule generation device <NUM> may obtain the one or more predetermined images stored in the storage device <NUM>.

In <NUM>, the traffic rule generation device <NUM> (e.g., the extraction module <NUM>) may extract one or more traffic signs in the one or more predetermined images. As described in connection with <FIG>, the one or more traffic signs may include a lane line, an indicator sign, a color of a traffic light, a speed limit sign, or the like, or any combination thereof.

In <NUM>, the traffic rule generation device <NUM> (e.g., the traffic rule determination module <NUM>) may determine a predetermined traffic rule associated with the predetermined region based on the one or more traffic signs.

As described in connection with <FIG>, the predetermined traffic rule may refer to a rule or a regulation associated with a road (or a region) that an object (e.g., a vehicle, a pedestrian) on the road (or in the region) must follow. For example, the traffic rule may be "stop at a red light," "go at a green light (i.e., a prescribed moving time period)," "a speed limit associated with a specific region (e.g., an intersection)," "a speed limit associated with a specific road (e.g., a highway)," "a prescribed moving direction associated with a specific road (e.g., a one-way)," "a prescribed moving region associated with a specific region (e.g., an intersection)," "a moving rule (e.g., lane change allowed, no lane change) associated with a specific region," "a prescribed vehicle type associated with a specific lane (e.g., a motor vehicle lane, a non-motor vehicle lane)," "a prescribed parking region," etc..

In some embodiments, the traffic rule generation device <NUM> may obtain feature information (e.g., a color of a traffic light, a speed limit value in the speed limit sign, a moving direction indicated in the indicator sign, a type (e.g., a dotted line, a solid line) of the lane line) included in the one or more traffic signs. Further, the traffic rule generation device <NUM> may determine the predetermined traffic rule associated with the predetermined region based on the feature information. For example, the traffic rule generation device <NUM> may determine a speed limit associated with the predetermined region based on the speed limit value. As another example, the traffic rule generation device <NUM> may determine a moving rule (e.g., lane change allowed, no lane change) associated with the predetermined region based on the type of the lane line.

<FIG> is a flowchart illustrating an exemplary process for monitoring a traffic behavior of at least one object according to some embodiments of the present disclosure. In some embodiments, the process <NUM> may be implemented as a set of instructions (e.g., an application) stored in the storage ROM <NUM> or RAM <NUM>. The processor <NUM> and/or the modules in <FIG> may execute the set of instructions, and when executing the instructions, the processor <NUM> and/or the modules may be configured to perform the process <NUM>. The operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process <NUM> may be accomplished with one or more additional operations not described and/or without one or more of the operations herein discussed. Additionally, the order in which the operations of the process as illustrated in <FIG> and described below is not intended to be limiting.

In <NUM>, the processing device <NUM> (e.g., the monitoring module <NUM>) (e.g., the processing circuits of the processor <NUM>) may determine status information associated with the at least object based on the at least one image.

As used herein, the status information associated with the at least object may include a type (e.g., a motor vehicle, a non-motor vehicle) of the at least one object, location information of the at least one object, velocity information of the at least one object, a moving path of the at least one object, a moving direction of the at least one object, or the like, or any combination thereof.

In <NUM>, the processing device <NUM> (e.g., the monitoring module <NUM>) (e.g., the processing circuits of the processor <NUM>) may monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule.

In some embodiments, for each of the at least one object, the processing device <NUM> may determine whether the traffic behavior of the object violates the predetermined traffic rule based on the status information of the object. For example, it is assumed that a traffic light at an intersection is "red," that is, the predetermined traffic rule is "stop at the red light," the processing device <NUM> may determine a velocity of the object is less than a threshold (e.g., <NUM>/s, <NUM>/s) based on the velocity information of the object. In response to determining that the velocity of the object is larger than or equal to the threshold, the processing device <NUM> may determine that the traffic behavior of the object violates the predetermined traffic rule. As another example, the processing device <NUM> may compare the velocity of the object (e.g., a vehicle) with "a speed limit for the predetermined region. " If the velocity of the object is equal to or higher than the speed limit for the predetermined region, the processing device <NUM> may determine that the traffic behavior of the object violates the predetermined traffic rule.

In response to determining that the traffic behavior of the object violates the predetermined traffic rule, the processing device <NUM> may transmit event information associated with the traffic behavior of the object to a target device. As used herein, the event information associated with the traffic behavior of the object may include at least one image corresponding to the object, the status information of the object, location information associated with the predetermined region, a traffic violation type (e.g., illegal parking, over speeding, running a red light), or the like, or any combination thereof. In some embodiments, the target device may include a traffic management department (e.g., a road and traffic authority, a traffic police brigade), a data center, an alarm center, a terminal device (e.g., the user device <NUM>) associated with the object, or the like, or any combination thereof.

In some embodiments, for each of the at least one object, the processing device <NUM> may determine whether the traffic behavior of the object satisfies a predetermined condition based on the status information according to the predetermined traffic rule. For example, the processing device <NUM> may determine whether a difference between a velocity of the object (e.g., a vehicle) and the speed limit is less than a difference threshold (it is assumed that the velocity of the object is lower than the speed limit). The difference threshold may be a default setting of the traffic monitoring system <NUM> or may be adjustable under different situations. In response to determining that the difference between the velocity of the object and the speed limit is less than the difference threshold, the processing device <NUM> may determine that the traffic behavior of the object satisfies the predetermined condition.

In response to determining that the traffic behavior of the object satisfies the predetermined condition, the processing device <NUM> may transmit reminder information (e.g., "the speed limit is <NUM>/h, the current speed is <NUM>/h, please slow down") to the terminal device (e.g., the user device <NUM>) associated with the object. The reminder information may include a current status (e.g., a current moving speed, a current location, a current moving direction) of the object, a moving recommendation, or the like, or a combination thereof. After receiving the reminder information, the terminal device may display the reminder information via an interface in a form of text, graphics, audio, video, etc..

<FIG> is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure. The processing device <NUM> may include an image obtaining module <NUM>, an extraction module <NUM>, a traffic rule determination module <NUM>, and a monitoring module <NUM>.

The image obtaining module <NUM> may be configured to obtain at least one image (e.g., a static image, a video frame) associated with a predetermined region captured by a capture device (e.g., the acquisition device <NUM>).

The extraction module <NUM> may be configured to extract one or more traffic signs in the at least one image.

The traffic rule determination module <NUM> may be configured to determine a traffic rule based on the one or more traffic signs.

The monitoring module <NUM> may be configured to monitor a traffic behavior of at least one object associated with the predetermined region based on the traffic rule. In some embodiments, the monitoring module <NUM> may determine status information associated with the at least one object based on the at least one image. Further, the monitoring module <NUM> may monitor the traffic behavior of the at least one object based on the status information according to the traffic rule.

The modules in the processing device <NUM> may be connected to or communicate with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, or the like, or any combination thereof. The wireless connection may include a Local Area Network (LAN), a Wide Area Network (WAN), a Bluetooth, a ZigBee, a Near Field Communication (NFC), or the like, or any combination thereof. Two or more of the modules may be combined as a single module, and any one of the modules may be divided into two or more units. For example, the image obtaining module <NUM> and the first obtaining module <NUM> illustrated in <FIG> may be combined as a single module. As another example, the monitoring module <NUM> and the monitoring module <NUM> illustrated in <FIG> may be combined as a single module.

<FIG> is a flowchart illustrating another exemplary process for object monitoring according to some embodiments of the present disclosure. In some embodiments, the process <NUM> may be implemented as a set of instructions (e.g., an application) stored in the storage ROM <NUM> or RAM <NUM>. The processor <NUM> and/or the modules in <FIG> may execute the set of instructions, and when executing the instructions, the processor <NUM> and/or the modules may be configured to perform the process <NUM>. The operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process <NUM> may be accomplished with one or more additional operations not described and/or without one or more of the operations herein discussed. Additionally, the order in which the operations of the process as illustrated in <FIG> and described below is not intended to be limiting.

In <NUM>, the processing device <NUM> (e.g., the image obtaining module <NUM>) (e.g., the interface circuits of the processor <NUM>) may obtain at least one image (e.g., a static image, a video frame) associated with a predetermined region captured by a capture device (e.g., the acquisition device <NUM>). As described in connection with <FIG>, the processing device <NUM> may obtain the at least one image from the capture device or a storage device (e.g., the storage device <NUM>).

In <NUM>, the processing device <NUM> (e.g., the extraction module <NUM>) (e.g., the processing circuits of the processor <NUM>) may extract one or more traffic signs in the at least one image. As described in connection with <FIG>, the one or more traffic signs may include a lane line, an indicator sign, a color of a traffic light, a speed limit sign, or the like, or any combination thereof.

In <NUM>, the processing device <NUM> (e.g., the traffic rule determination module <NUM>) (e.g., the processing circuits of the processor <NUM>) may determine a traffic rule based on the one or more traffic signs. As described in connection with <FIG>, the traffic rule may refer to a rule or a regulation associated with a road (or a region) that an object (e.g., a vehicle, a pedestrian) on the road (or in the region) must follow.

In <NUM>, the processing device <NUM> (e.g., the monitoring module <NUM>) (e.g., the processing circuits of the processor <NUM>) may monitor a traffic behavior of at least one object associated with the predetermined region based on the traffic rule.

In some embodiments, the processing device <NUM> may determine status information associated with the at least one object based on the at least one image. Further, the processing device <NUM> may monitor the traffic behavior of the at least one object based on the status information according to the traffic rule. For example, for each of the at least one object, the processing device <NUM> may determine whether the traffic behavior of the object violates the traffic rule based on the status information of the object. In response to determining that the traffic behavior of the object violates the traffic rule, the processing device <NUM> may transmit event information (e.g., at least one image corresponding to the object, status information of the object, location information associated with the predetermined region, a traffic violation type) associated with the traffic behavior of the object to a target device. As another example, for each of the at least one object, the processing device <NUM> may determine whether the traffic behavior of the object satisfies a predetermined condition based on the status information according to the traffic rule. In response to determining that the traffic behavior of the object satisfies the predetermined condition, the processing device <NUM> may transmit reminder information (e.g., a current status of the object, a moving recommendation) to a terminal device associated with the object.

In some embodiments, the present disclosure may also provide a storage medium storing a computer program thereon. When executed by a processor, the computer program may direct the processor to perform a process (e.g., process <NUM>, process <NUM>, process <NUM>, process <NUM>, process <NUM>, process <NUM>) described elsewhere in the present disclosure. As used herein, the storage medium may include but not limited to a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a disk, an optical disk, or the like, or any combination thereof.

Claim 1:
A method implemented on a computing device (<NUM>) including at least one processor (<NUM>), at least one storage medium (<NUM>, <NUM>, <NUM>), and a communication platform connected to a network (<NUM>), the method comprising:
obtaining (<NUM>) at least one image associated with a predetermined region captured by a capture device (<NUM>), wherein the capture device (<NUM>) is set back to an intersection or at a position facing a traffic light;
obtaining (<NUM>) a predetermined traffic rule associated with the predetermined region, wherein the obtaining (<NUM>) the predetermined traffic rule associated with the predetermined region includes:
extracting one or more traffic signs in one or more predetermined images associated with the predetermined region, and
automatically generating the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs, wherein
the predetermined traffic rule includes a prescribed moving region associated with the predetermined region, a prescribed moving direction associated with the predetermined region, a prescribed vehicle type associated with the predetermined region, a prescribed parking region associated with the predetermined region, and a speed limit associated with the predetermined region; and
identifying (<NUM>) at least one object in the at least one image;
monitoring (<NUM>) a traffic behavior of the at least one object based on the predetermined traffic rule, including:
determining (<NUM>) status information associated with the at least one object based on the at least one image; and
monitoring (<NUM>) the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, wherein the status information associated with the at least one object includes a type of the at least one object.