Method of switching video images and surveillance system

The disclosure provides a method of switching video images and a surveillance system. The method includes the following steps. A first video image is displayed under a first display mode in a monitoring interface. Whether a target object in the first video image enters into a designated region in the first video image is determined. Whether a ratio of the targeted object to the first video image is smaller than or equal to a first threshold is determined when the target object enters into the designated region. When the ratio is smaller than or equal to the first threshold, a second video image is displayed under the first display mode in the monitoring interface. The designated region in the first video image is related to a geographic position, and the second video image is a video image related to the geographic position.

CROSS-REFERENCE TO RELATED APPLICATIONS

This non-provisional application claims priority under 35 U.S.C. § 119(a) on Patent Application No(s). 103133768 filed in Taiwan, R.O.C. on Sep. 29, 2014, the entire contents of which are hereby incorporated by reference.

TECHNICAL FIELD

The disclosure relates to a method of switching video images and a surveillance system, more particularly to a method of switching video images for tracking a target object, and a surveillance system using the same.

BACKGROUND

In general, supervising a workplace or a public place usually needs multiple surveillance apparatuses, and the allocation of the surveillance apparatuses for various scenes is performed to clearly capture the image of each corner in the workplace or public place. For a conventional surveillance system, videos captured by these surveillance apparatuses are usually displayed on respective screens at the same time. For example, a supervisor may monitor a workplace or a public place using nine display screens arranged in a 3 by 3 grid, and each of the display screens displays a video image of a respective scene.

Actually, this is not a most efficient way having a single supervisor simultaneously watching multiple display screens. For example, if a supervisor discovers a person of interest appearing on a certain display screen and this person of interest is moving toward a different location, the supervisor has to memorize a number or location of the display screen associated with this different location in order to pay attention to the proper display screen in real time. It is obvious in such a conventional surveillance system that the supervisor cannot conveniently supervise the movement of the person of interest. Also, if such a person of interest brings about danger during a couple of seconds while the supervisor's attention is diverted, the supervisor cannot assess the situation in real-time and determine a proper plan of action, because of missing some important video images captured during this period.

SUMMARY

For this reason, the disclosure promotes a method of switching video images for tracking a moving target object and then automatically performing the switching of video images related to different geographic positions shown on a monitoring device, whereby a supervisor may conveniently monitor the moving target object shown on the monitoring interface.

According to one or more embodiments, the disclosure provides a method of switching video images. In one embodiment, the method includes the following steps. Display a first video image in a first display mode on a monitoring interface. Determine whether there is a target object on the first video image entering into a designated region in the first video image. Determine whether a ratio of the target object to the first video image is less than or equal to a first threshold when the target object enters into the designated region. Display a second video image in the first display mode on the monitoring interface when the ratio of the target object to the first video image is less than or equal to the first threshold. The designated region in the first video image is related to a geographic position, and the second video image is related to a video image of the geographic position.

In another embodiment, the method includes the following steps. Display a first video image on a monitoring interface. Determine whether a target object on the first video image enters into a designated region in the first video image. Determine whether a ratio of the target object to a second video image is larger than or equal to a third threshold when the target object into the designated region. Display the second video image on the monitoring interface when the ratio of the target object to the second video image is larger than or equal to the third threshold. The designated region in the first video image is related to a geographic position, and the second video image is related to a video image related to the geographic position.

According to one or more embodiments, the disclosure provides a surveillance system for tracking a moving target object and then automatically performing the switching of video images related to different geographic positions shown on a monitoring device so that the supervisor may conveniently monitor the target object shown on the monitoring device.

In one embodiment, the surveillance system includes a first photographic module, a second photographic module, and a monitoring device. The first photographic module captures a first video image. The second photographic module captures a second video image. The monitoring device is connected to the first and second photographic modules in order to receive the first and second video images and performs the foregoing method. The designated region in the first video image is related to a geographic position, and the second video image is related to a video image related to the geographic position.

In summary, the disclosure employs the aforementioned method and surveillance system to determine whether the target object on the first video image enters into the designated region, thereby switching from the first video image displayed on the monitoring interface to the second video image corresponding to a next position of the target object in order to conveniently monitor the target object.

DETAILED DESCRIPTION

Please refer toFIG. 1, which is a functional block diagram of a surveillance system1in an embodiment. As described inFIG. 1, the surveillance system1includes a first photographic module10, a second photographic module12, and a monitoring device14. The monitoring device14is coupled to the first photographic module10and the second photographic module12. In this embodiment, the first photographic module10is used to capture images of a certain geographic position to produce first video images. The second photographic module12is used to capture images of a neighbor geographic position to produce second video images. The monitoring device14is used to receive the first video image from the first photographic module10and the second video image from the second photographic module12.

In practice, the first photographic module10and the second photographic module12are, for example, unlimited to fixed video cameras, PTZ video cameras, fish-eye video cameras or other available photographic devices. Moreover, the first photographic module10and the second photographic module12send their respective video images to the monitoring device14by wire lines or wirelessly. The monitoring device14is, for example, unlimited to a computer having various computing abilities and includes a monitoring interface142(e.g. a display screen). Therefore, a supervisor employs the monitoring interface142to supervise the video images provided by the first photographic module10and the second photographic module12.

It is noticed that although this embodiment is described in which two photographic modules (i.e. the first photographic module10and the second photographic module12) are used to cooperate with one monitoring device (i.e. the monitoring device14), other embodiments are contemplated in which various numbers of photographic modules may be used. Those skilled in the art should understand that this embodiment greatly describes that the monitoring device14is able to perform the switching of various video images produced by various photographic modules in order to automatically track a target object, so the number of photographic modules can be increased according to various designs. The target object herein is, for example, not limited to a human, goods or other target that is necessary to be tracked.

To clarify the method of switching video images in the disclosure, please refer toFIG. 1andFIG. 2.FIG. 2is a flow chart of a method of switching video images in an embodiment. The monitoring interface142of the monitoring device14herein supports various display modes. As described in the drawings, in step S20, the monitoring interface142of the monitoring device14displays a first video image in a first display mode. The first display mode herein is a full-screen mode or a preset mode that is self-defined. For example, when displaying the first video image in the full-screen mode, the monitoring interface142displays only the first video image. In this situation, the supervisor can pay attention to the target object shown in the first video image. Alternatively, when displaying the first video image in the preset mode, the monitoring device14displays the video image from the first photographic module10by a preset size or an original size.

In practice, please refer toFIGS. 3A to 3D, which are schematic diagrams for illustrating the method of switching video images in an embodiment. In step S20, a display block30in the monitoring interface142is displaying a first video image32, as shown inFIG. 3A. Because the disclosure does not limit the type of the first display mode, the display block30may be the monitoring interface142as a whole (i.e. the full-screen mode) or the monitoring interface142in part (i.e. the preset mode). In this example, a certain person to be supervised shown in the first video image32is defined as a target object34, and a region presenting the door shown in the first video image32is defined as a designated region36.

Then, in step S22, the monitoring device14determines whether the target object34on the first video image32enters into the designated region36in the first video image32. If yes, the monitoring device14further determines whether the target object34all has entered as a whole (or in significant part) into the designated region36while the target object34(i.e. a man) just enters (i.e. walks) into the designated region36(i.e. the door) as shown inFIG. 3B. Otherwise, when the target object34still stays outside and has not entered into the designated region36(nor the second video image38) as shown inFIG. 3A, the monitoring interface142of the monitoring device14still continues to display first video images in the first display mode.

In an example, when the monitoring device14detects that the target object34enters into the designated region36in the first video image32, the monitoring device14may further mark the designated region36, into which the target object34enters, in the first video image32. In this way, if there is more than one region in the first video image32for a certain target object to enter into, even though the supervisor does not see which region the target object34moves to, it is able to track the whereabouts of the target object34using the marked designated region36afterwards.

Subsequently, in step S24, after the target object34enters into the designated region36, the monitoring device14further determines whether a ratio of the target object34to the first video image32is less than or equal to a first threshold. It should be noticed that this embodiment is unlimited to which the ratio of the target object34to the first video image32is absolutely identical to the first threshold. To avoid having misunderstanding to the term “less than or equal to” herein, the term “less than or equal to” in this embodiment can be realized as “smaller or the same”. That is, when the target object34has entered into the designated region36, then the monitoring device14further determines whether the ratio of the target object34to the first video image32is less than the first threshold, which should still be covered in step S24. The persons skilled in the art should understand that when such a threshold condition (i.e. the ratio of the target object34to the first video image32is equal to the first threshold) occurs, the outcome of the determination made by the monitoring device14in step S24will not affect the spirit of the disclosure.

Herein, the ratio of the target object34to the first video image32may sufficiently be interpreted as a ratio of the target object34to the designated region36since a ratio of the first video image32to the designated region36is substantially constant, but the disclosure will not be limited thereto. The calculation of such a ratio is performed, for example, but not limited to, by a number of pixels for the target object34and a number of pixels for the first video image32or the designated region36, or by an area of pixels presenting the target object34and an area of pixels presenting the first video image32or the designated region36, or by other available methods known in the art.

As described in step S24with respect toFIG. 3C, in which the target object34has entered (i.e. walked) into the designated region36(i.e. the door), the more the target object34walks into the designated region36deeply (i.e. in a direction vertical to the image plane), the smaller the size of the target object34is. Alternatively, when the target object34turns left or right after entering into the designated region36, the target object34is gradually covered by the background (i.e. the wall) in the first video image32and then the ratio of the target object34to the designated region36also gradually becomes smaller. Therefore, the monitoring device14can determine the timing of switching to a video image of next scene by such a ratio. If the ratio of the target object34to the first video image32is still larger than the first threshold, then the monitoring interface142of the monitoring device14will continue displaying the first video image in the first display mode.

Conversely, if the ratio of the target object34to the first video image32is less than or equal to first threshold, the monitoring interface142displays the second video image38in the first display mode in step S26. As described in step S26with respect toFIG. 3D, when the monitoring device14determines that the ratio of the target object34to the first video image32is less than or equal to the first threshold, it indicates that the target object34has surely entered into the designated region36. Herein, the monitoring device14will directly switch to a video image of a next scene, that is, the second video image38. In a practical example, the first photographic module10is disposed outside the door as the second photographic module12is disposed inside the door, so that the first video image32is an image of outdoor scene captured by the first photographic module10and the second video image38is an image of indoor scene captured by the second photographic module12.

It should be noticed that the first threshold is varied with the positions of the first photographic module10and the second photographic module12in order to obtain previous and current video images of the target object34having a high definition. For example, if the second photographic module12is located very near the door and can capture clear images of the target object34entering into the door, the first threshold may be relatively large. In other words, it may be unnecessary that switching to the second video image38is not performed until the ratio of the target object34to the first video image32has greatly reduced. In contrast, if the second photographic module12is a significant distance away from the door and the second photographic module12cannot capture clear images of the target object34until the target object34enters into the door more deeply, the first threshold may relatively be small. In other words, switching to the second video image38is not performed until the ratio of the target object34to the first video image32becomes sufficiently small.

In another embodiment, the first threshold is zero. In an embodiment in which the first threshold is zero, only if the target object34disappears in the designated region36is the switching of video images performed. For example, if the target object34turns left or right and goes forward after entering into the designated region36, the target object34is gradually covered by the background (i.e. the wall) in the first video image32more and more, resulting in the disappearance of the target object34in the designated region36. In this situation, the ratio of the target object34to the first video image32herein is equal to zero.

In another embodiment, video images of a previous scene and video images of a current scene are simultaneously displayed as described below with respect toFIG. 1andFIG. 4, which is a flow chart of a method of switching video images in another embodiment. As the same as the foregoing embodiment, the monitoring interface142of the monitoring device14displays the first video image32in the first display mode in step S40, and the monitoring device14in step S42determines whether the target object34in the first video image32enters into the designated region36in the first video image32.

However, differently, in step S44, when the target object34enters into the designated region36, the monitoring device14will further determine whether the ratio of the target object34to the first video image32is less than or equal to second threshold. In an example, the monitoring device14determines that the ratio of the target object34to the first video image32is greater than a second threshold. This situation indicates that the target object34has not entered into a next scene yet so that the monitoring interface142of the monitoring device14will still display first video images in the first display mode.

Conversely, in step S46, when the ratio of the target object34to the first video image32is less than or equal to second threshold, the monitoring device14further determines whether the ratio of the target object34to the first video image32is less than or equal to the first threshold. In practice, the second threshold is different from the first threshold so that the disclosure can at different stages decide when to switch from the first video image32to the second video image38.

Embodiments of the relationship between the second threshold and the first threshold are described below with respect toFIG. 5, which is a schematic diagram of video images in a certain ratio in an embodiment. The first threshold T1and the second threshold T2are thresholds of ratio and are used to assist in determining the area of the target object34occupying the designated region36. Generally, when the target object34gradually disappears in the current scene from the designated region36, the target object34is gradually away from the viewer. Therefore, the ratio of the target object34to the designated region36is getting smaller.

In a practical example, as described above, when the target object34enters into the designated region36and the ratio of the target object34to the designated region36is less than or equal to the first threshold T1, the target object34is sufficiently deep into a next scene and the monitoring device14may directly display a video image (i.e. the second video image38) of the next scene in the first display mode in step S48. However, when the target object34has entered into the designated region36and the ratio of the target object34to the designated region36is not less than or equal to the first threshold T1but is less than or equal to the second threshold T2, the target object34is insufficiently deep into the next scene. In this situation, if switching from the first video image32to the second video image38shown in the display block30is suddenly performed, some important details in the video images may accidentally be skipped.

Accordingly, the method further includes step S50, in which the monitoring interface142simultaneously display at least a part of the first video image32and at least a part of the second video image38in the second display mode when the target object34enters into the designated region36and the ratio of the target object34to the designated region36is not less than or equal to the first threshold T1but is less than or equal to the second threshold T2. In this way, the supervisor can simultaneously see the first video image32and the second video image38shown in the display block30. It is noticed that the above second display mode is a picture-in-picture (PIP) mode or a picture-by-picture (PBP) mode, the first video image32and the second video image38may be scaled down, clipped or subjected to other image processes in the second display mode. The persons skilled in the art should understand that one of the two video images simultaneously displayed in the display block30may have different content, image quality, and/or size as compared to its individual display, and thus, will not be repeated hereinafter.

In an example, the second display mode is a row-type PBP mode, in which at least one part of the first video image32and at least one part of the second video image38are simultaneously displayed, as shown in, for example,FIG. 6A, which is a schematic diagram of the monitoring interface in the second display mode in another embodiment. In another example, the second display mode is a column-type PBP mode, in which at least one part of the first video image32and at least one part of the second video image38are simultaneously displayed, as shown in, for example,FIG. 6B, which is a schematic diagram of the monitoring interface in the second display mode in another embodiment. Notice that although the first video image32and the second video image38may be clipped in the second display mode, the clipping is not performed randomly. For example, at least surroundings of the target object34shall remain in the first video image32and the second video image38, whereby the supervisor may efficiently supervise the target object34.

In step S52, as shown inFIG. 4, the monitoring device14determines whether the whole or a first feature of the target object34enters into the second video image38completely or not. When the whole or first feature of the target object34has entered into the second video image38, it indicates the supervisor herein can handle the target object34using the second video image38without the assistance of the first video image32. As a result, the monitoring device14then directly displays a video image of a next scene (i.e. the second video image38) in the first display mode, as described in step S48. Conversely, when the whole or first feature of the target object34has not completely entered into the second video image38yet, then the supervisor still needs the assistance of the first video image32. Herein, the monitoring interface142of the monitoring device14continues displaying the first video image32and the second video image38in the second display mode simultaneously (i.e. returning to step S50).

In an example, the above outcome of determining whether the target object34completely enters into the second video image38, made by the monitoring device14in step S52is based on that the entire edge of the target object34has entered into the second video image38. In another example, the above outcome of determining whether the target object34completely enters into the second video image38, made in step S52is obtained using the determination in step S46, where when the monitoring device14determines that the ratio of the target object34to the first video image32is less than or equal to the above first threshold, the target object34is considered completely-entering into the second video image38. On the other hand, in an example in which the target object34is a human, the first feature of the target object34is this human's face or limbs or something put thereon. In an example, if this human's face has been shown in the second video image38clearly, there is no need to use the assistance of the first video image32. In another example, if this human's arm is clearly shown in the second video image38, the monitoring device14will directly display a video image of a next scene (i.e. a new second video image38) in the first display mode without the assistance of the first video image32when it is predeterminedly unnecessary to see other parts of the human. Although embodiments are described like above, the persons skilled in the art should understand that other embodiments are contemplated in which the so-called first feature is any feature of a target object, which is sufficiently used to identify and handle the target object, and thus, the disclosure will not describe them hereinafter.

In addition to the automatic switching of video images of next scenes by the monitoring device14in the first display mode made, the supervisor can manually control the monitoring device14to display a video image of a next scene in the first display mode. For example, when the monitoring interface142of the monitoring device14simultaneously displays the first video image32and the second video image38in the second display mode, a switching notice may pop up in the monitoring interface142to notify or query the supervisor about the requirement of switching to the second video image38. If the decision of switching to the second video image38in the switching notice is made, the monitoring interface142then displays the second video image38in the first display mode in response.

In an example, the first video image32may show more than one object so that the monitoring device14can calculate a characteristic value (e.g. score) associated with each object and then compare these characteristic values, so as to define the object having the maximum characteristic value to be the target object34as compared to the others. In practice, the monitoring device14predeterminedly has a table of characteristic values in an embodiment. For example, it is not easy to identify the face of a person putting on a safety helmet so that the safety helmet as a feature may have a higher characteristic value. For another example, the face of an unwelcome person who has been blacklisted for a casino or for a suspected habitual-thief may have a higher characteristic value when considered a feature. For another example, if a male is discovered outside a female dressing room, this guy as a feature may have a higher characteristic value. In an embodiment based on the previous examples, the monitoring device14further performs a face recognition procedure to determine a person is male or female or has a certain face in order to give it a characteristic value. For another example, a person who holds a knife or weapon in a railroad car (also known as railcar, railway wagon or railway carriage) or on a platform in a public transport system may have a higher characteristic value because such a guy very possibly puts other people there in peril.

Further, for example, a person wears an overcoat in the summer or carries big luggage may possibly smuggle contraband or steal goods, a preset characteristic value for such people may relatively be lower as compared to the above embodiments. In another example, although a person wearing a vest and/or shorts in the winter looks strange, such a person may not cause immediate jeopardy, and thus, a preset characteristic value for this guy may be much lower. In other words, the supervisor can manually set the characteristic value of each feature on the monitoring device14, and the setting of characteristic values is varied based on the position instance of the surveillance system1. It is noticed that the disclosure will not have any limit in which feature a target object has will lead to a higher characteristic value, and thus, the persons skilled in the art can unlimitedly set the relationship between a feature and its characteristic value according to their actual requirements. In an embodiment, a target object is unlimited to have one or more characteristic values. For example, both the face and dressing of a person can be considered to be the expression of this person. Therefore, the monitoring device14is also capable of maintaining a plurality of tables each records characteristic values in order to arrange, compare, or decide which people should be tracked after each characteristic value is weighted and calculated.

Embodiments are contemplated in which the monitoring device14may decide the timing of switching to the second video image without calculating or determining the ratio of the target object to the first video image. Please refer toFIG. 1andFIG. 7.FIG. 7is a flow chart of a method of switching video images in another embodiment. Steps S60and S62inFIG. 7are the same as the previous embodiments. The monitoring interface142of the monitoring device14displays the first video image32and determines whether the target object34in the first video image32enters into the designated region36in the first video image32.

Differently, in step S64, the monitoring device14determines whether the ratio of the target object34to the second video image38is larger than or equal to a third threshold. When the monitoring device14determines that the ratio of the target object34to the second video image38is still smaller than the third threshold, it indicates that the target object34in the second video image38has not been clear enough or identifiable yet, the monitoring interface142continues displaying the first video image32. When the monitoring device14determines that the target object34shown in the second video image38is clear enough or identifiable, the ratio of the target object34to the first video image32herein does not matter any more and the monitoring interface142directly displays the second video image38, as described in step S66.

As set forth above, either of the method of switching video images and the surveillance system in the disclosure can be used to determine whether a target object enters into a designated region in a first video image, so as to switch to the display of a second video image corresponding to the movement of the target object in the monitoring interface. In this way, when a certain person is set as a target object to be locked onto, the disclosure can track such a target object that is moving and employ the monitoring interface to automatically switch the display of video images. Therefore, the supervisor may not divert attention from the target object or the target object may not suddenly disappear from the supervisor's view, so as to achieve a better and more convenient surveillance of the target object.