Patent Document

[0001]     This application claims the benefit of U.S. Provisional Patent Application 60/537,818, filed 19 Jan. 2004. 
     
    
     BACKGROUND AND SUMMARY OF THE INVENTION  
       [0002]     This invention relates to the field of surveillance systems, and in particular to a video surveillance system that includes blocking zones to reduce false alarms.  
         [0003]     Video surveillance systems are commonly used to detect intruders in protected areas and/or to track objects that traverse protected areas. Generally, video images are processed to identify objects of interest, and to notify an operator of the system of any unauthorized ventures in the protected area. To facilitate an analysis of the potential unauthorized entry (forensics), the path of the object before and after the entry is provided to the operator.  
         [0004]     Exclusion zones are commonly used in video surveillance systems to mask regions of the video image that should not be recorded for privacy reasons (see, for example, U.S. Pat. No. 6,509,926, “SURVEILLANCE APPARATUS FOR CAMERA SURVEILLANCE SYSTEM”, issued 21 Jan. 2003 to Mills et al., and incorporated by reference herein), or to mask regions that trigger false alarms due to motion of trees, reflections, and so on (see, for example, U.S. Pat. No. 5,956,424, “LOW FALSE ALARM RATE DETECTION FOR A VIDEO IMAGE PROCESSING BASED SECURITY ALARM SYSTEM”, issued 21 Sep. 1999 to Wootton et al., and incorporated by reference herein; see also U.S. Pat. No. 6,069,655, “ADVANCED VIDEO SECURITY SYSTEM”, issued 30 May 2000 to Seeley et al., and incorporated by reference herein).  
         [0005]     A problem with conventional exclusion regions is that the video image within the region is masked, so that any and all activity within the region is indiscriminately blocked from view and/or analysis. A user may use an exclusion region to mask a cluster of trees, to prevent false alarms caused by motion of the trees, but if a person or automobile travels in front of these trees, their motion will also be masked from generating an alarm.  
         [0006]      FIGS. 1A and 1B  illustrate example camera views from a video surveillance system.  
         [0007]     In  FIG. 1A , the area in front of an entrance  120  to a secured building  110  is monitored. The example area includes trees  130 . In a conventional surveillance system, one or more exclusion regions would typically be defined to mask the trees  130 , so that movements of the leaves or branches of the trees  130  are not tagged as reportable events. Such masking, however, will also mask the movement of a person  140  in the vicinity of the trees  130 , thereby producing a potential security gap in the surveillance of the area.  
         [0008]     In  FIG. 1B , a section of a room is monitored. The room includes a doorway  160 , and a mirror  150 . When the door is open, any activity in the hallway is visible, including, for example, a person  170  walking by the door. In a conventional surveillance system, an exclusion zone may be defined to mask the activity at the doorway  160 , but in so doing, the recognition of a person entering the room is delayed until the person is beyond the masked area. In like manner, an exclusion zone will typically be defined to cover all mirrors or windows, to mask reflections of a person  180  at the opposite end of the room, or persons beyond the secured premises. If a person walks in front of the masked mirror  150 , however, a substantial amount of the person&#39;s image will be masked, and object-detecting algorithms may fail to identify the remainder image as a trackable object.  
         [0009]     An object of this invention is to provide a scheme that facilitates the advantages provided by exclusion zones without incurring their inherent disadvantages. Another object of this invention is to provide a continuous record of an object&#39;s travel for forensic purposes.  
         [0010]     These objects, and others, are achieved by a method and system that employs blocking zones that are configured to prevent false alarms caused by motion within the zones, but also allow the tracking of objects through the zones. An object that first appears within a blocking zone is not considered to be a reportable object until the object leaves the zone. All reportable objects are tracked, without regard to the blocking zones. Objects that remain within their initial blocking zone are not deemed to be reportable objects, and therefore do not generate alarms. If an object initially appears within overlapping zones, the object is not deemed to be reportable until it leaves each of the zones at least once. The blocking zones do not mask the video images, and thus a complete record of activity is available for forensic purposes. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0011]     The invention is explained in further detail, and by way of example, with reference to the accompanying drawings wherein:  
         [0012]      FIGS. 1A and 1B  illustrate example views provided by a video surveillance system.  
         [0013]      FIGS. 2A and 2B  illustrate example camera fields of view with blocking zones in accordance with this invention.  
         [0014]      FIG. 3  illustrates a flow diagram of an example surveillance system in accordance with this invention.  
         [0015]      FIG. 4  illustrates a block diagram of an example surveillance system in accordance with this invention.  
         [0016]     Throughout the drawings, the same reference numerals indicate similar or corresponding features or functions. The drawings are included for illustrative purposes and are not intended to limit the scope of the invention. 
     
    
     DETAILED DESCRIPTION OF THE INVENTION  
       [0017]      FIGS. 2A and 2B  illustrate example camera fields of view with blocking zones in accordance with this invention.  FIG. 2A  corresponds to  FIG. 1A , and illustrates blocking zones  230  surrounding each tree  130 .  FIG. 2B  corresponds to  FIG. 1B , and illustrates blocking zones  260 ,  250  encompassing the doorway  160  and mirror/window  150 . These blocking zones are illustrated as rectangles, although one of ordinary skill in the art will recognize that the shape of the zone is immaterial to the principles of this invention. In a preferred embodiment of this system, a graphic interface is provided, wherein a reference image corresponding to a field of view of a camera is presented to a user, and the user identifies the bounds of each blocking zone by “drawing” each blocking zone on the reference image. From the user&#39;s drawing, the coordinates of the bounding vertices of the blocking zone are determined and stored.  
         [0018]     Preferably, each blocking zone  230 ,  250 ,  260  is sufficiently sized to include the extent of motion of objects that may appear within the zone but may not constitute reportable motion. That is, a blocking zone  260  is typically associated with a relatively stationary object that exhibits some movement, such as a tree that sways, or a door that swings in a doorframe, and generally encompasses the extent of the movement. For example, the blocking zone  260  about the doorframe  160  includes the extent of the swing of the door, so as to potentially exclude the motion of the door from the reportable motion. A blocking zone  260  is also typically associated with segments of an image within which inconsequential/immaterial movement may occur, such as views through a window or doorway to an area beyond the secured area, movements within a mirror image, and so on.  
         [0019]     In a preferred embodiment of this invention, the blocking zone  260  is defined relative to a given view of the camera, rather than relative to the display screen. In this manner, if the view of the camera changes, such as via the use of a pan-tilt-zoom (PTZ) camera arrangement, the blocking zone  260  will retain its relationship to the object to which it is associated, such as the doorframe  160 .  
         [0020]      FIG. 3  illustrates an example flow diagram of a surveillance system that includes blocking zones in accordance with this invention. For ease of understanding, this invention is described with reference to a single camera surveillance system, although one of ordinary skill in the art will recognize that the principles of this invention are not limited to a single camera system.  
         [0021]     At  310 , an image is received from a camera, and optionally recorded. This image may be processed before recording, to reduce storage requirements; for example, the image may be converted into an MPEG format and stored in this form. In like manner, the image may be processed to facilitate subsequent operations or processes that use the image. For example, stationary background images may be subtracted from the current image, to highlight foreground objects. Similarly, some image processing may be applied to reduce the effects caused by varying lighting or other environmental changes. Optionally, the recording of the images from the camera may be postponed until some suspicious activity is detected, or until some alarm is signaled.  
         [0022]     At  315 , the image is processed to identify potential objects of interest, using techniques common in the art. For example, to qualify as an object of interest, identified clusters of pixels may need to be at least some minimum size, some reasonable shape, and so on.  
         [0023]     At  320 , the track, or path, of each identified object of interest is recorded, using techniques common in the art. If the object is newly identified, a track is created for this object. If the object is determined to correspond to an object in prior images, the current location of the object is concatenated to the existing track. Optionally, only the track of each reportable object (detailed below) is recorded; but, because the storage requirements for tracking is relatively insubstantial, all detected objects are tracked. If an object disappears from view without having been declared reportable (detailed below), the track of that object is deleted. Also optionally, albeit less efficient, if the track of a non-reportable object is not recorded, when the object is determined to be a reportable object, the recorded images can be used to “backtrack” the path of the reportable object to create a complete track of the object&#39;s movements.  
         [0024]     The loop  330 - 375  processes each object, using the aforementioned blocking zones of this invention. For ease of presentation and explanation, all regions of a scene are considered to correspond to one or more zones, and these zones include both blocking and non-blocking zones. Blocking zones may overlap, so that an object can be located in more than one zone at any given time; a non-blocking zone is defined as any region that does not include a blocking zone.  
         [0025]     At  335 , the status of the object is checked. All objects are initially marked as being non-reportable. If the object has previously been deemed to be reportable, no further processing is required for this object.  
         [0026]     If, at  340 , the non-reportable object is a new object, the initial status of the object is determined, at  345 - 355 . If, at  345 , the new object is located within one or more blocking zones, a list of the initial blocking zones that include this new object is created, at  350 . If, on the other hand, at  345 , the new object is located in a non-blocking zone, the object is marked as being reportable.  
         [0027]     If, at  340 , the non-reportable object is not a new object, the object&#39;s prior zone(s) is checked, at  360 , to determine whether a zone-change has occurred. A zone-change is defined herein as a movement/transfer of an object from one zone into another zone. If the object, for example, transfers from a blocking zone to a non-blocking zone, or from a set of multiple zones into a single zone, or into a different set of multiple zones, a zone-change has occurred. If an object merely disappears from a zone, and does not appear in another zone, a zone-change has not occurred. (One of ordinary skill in the art will recognize that if an object disappears and does not appear in another zone, it will not be identified as an object in  315 , and hence will not be included in the loop  330 - 375 . The prior statement is included in the event that this invention is embodied differently from the flow diagram of  FIG. 3 .)  
         [0028]     If a zone change has not occurred, at  360 , no further processing is required, and the object remains as a non-reportable object. If, on the other hand, at  360 , a zone change has occurred, the zone or zones from which the object has departed is/are removed from the list of initial blocking zones that was created at  350 . If, at  370 , this deletion results in an empty list of blocking zones, the object is marked as reportable, at  355 ; otherwise, if there remains at least one blocking zone in the list associated with the object, the object remains non-reportable.  
         [0029]     Consider the following examples.  
         [0030]     If an object initially appears outside all blocking zones, the object is deemed to be a reportable object, at  355 .  
         [0031]     If an object initially appears within a single blocking zone, such as a blocking zone that includes a mirror or window, the single blocking zone is included in the list of blocking zones associated with the object, at  350 . If the object eventually disappears from the single blocking zone and reappears in another zone, the single blocking zone is removed from the list, the list is determined to be empty, and the object is deemed to be a reportable object. Note that if the object is merely a reflection in a mirror, or an image outside a window, and the initial blocking zone includes the mirror or window, the list associated with this object will never be depleted, because the object will not undergo a zone-change, at  360 , and its status as a non-reportable object will not change. If, on the other hand, the object is a person standing in front of the mirror or window, the object will be deemed to be reportable, at  355 , as soon as the object leaves the blocking zone surrounding the mirror or window, at  360 - 365 .  
         [0032]     If an object initially appears in a set of overlapping blocking zones, such as the overlap of blocking zones  230   a  and  230   b  in  FIG. 2A , the list associated with the object will contain blocking zones  230   a  and  230   b . If the object moves to the right, and leaves zone  230   a , this zone,  230   a , will be removed from the list of initial blocking lists that was created at  350  of  FIG. 3 . At this point, the list will still contain blocking zoned  230   b , and thus will not be empty, and the status of the object will remain as non-reportable, at  370 . If the object continues to move to the right, or turns around and travels to the left, and eventually also leaves blocking zone  230   b , then zone  230   b  is removed from the list, the list is determined to be empty, and the object is deemed to be reportable. On the other hand, if the object is a branch of one of the trees in zones  230   a ,  230   b  that appears in the overlap of  230   a ,  230   b , it will not be deemed to be reportable unless it travels beyond  230   a  and also travels beyond  230   b , which is highly unlikely if the zones are properly defined. Thus, branches swaying within the overlay area and somewhat beyond will not be deemed to be reportable, whereas a person who appears in the overlay area and eventually moves beyond the overlap areas  230   a ,  230   b  will be identified as a reportable object.  
         [0033]     Note that the list that is used to determine whether a non-reportable object becomes a reportable object is created when the object is initially identified within one or more blocking zones, and the only actions on this list are potential deletions. Once the list becomes empty, the object is declared to be reportable, and thereafter the blocking zones have no effect on the tracking of the reportable objects. In this manner, the masking effects provided by the conventional exclusion zones is effectively provided for objects that never travel beyond their original blocking zone, whereas, as contrast to the conventional exclusion zones, the blocking zones have no effect on objects that travel beyond their initial blocking zones, or objects that initially appeared outside of a blocking zone.  
         [0034]     The loop  380 - 395  assesses each reportable object to determine whether to sound an alarm, at  385 - 390 , using techniques common in the art. Because only reportable objects are assessed, non-reportable objects, such as reflections in mirrors, swaying branches, and the like that remain within their initial blocking zone do not generate false alarms.  
         [0035]     For completeness,  FIG. 4  illustrates an example surveillance system in accordance with this invention. One or more cameras  410  provide images to an image processor  420 . The images are also provided to a recorder  470 , in either their original form or in a processed formed, such as an MPEG encoding. The image processor  420  optionally pre-processes the images to facilitate the recognition of objects within each image, for example, by subtracting a stationary background image from each image.  
         [0036]     An object recognizer  430  receives the images from the image processor  420 , and identifies potentially reportable objects, using conventional techniques such as recognition based on size and/or shape of groups of adjacent pixels exhibiting common motion. An object tracker  440  records the track or path of each identified object.  
         [0037]     The object tracker  440  also distinguishes between reportable objects and non-reportable objects, based on whether each object that initially appears within a blocking zone eventually leaves the blocking zone, as detailed above. The object tracker  440  provides the identification and track of each reportable object to an alarm detector/processor  450 , for subsequent notification to a user terminal  460  of any potential or actual alarm conditions.  
         [0038]     The foregoing merely illustrates the principles of the invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements which, although not explicitly described or shown herein, embody the principles of the invention and are thus within its spirit and scope. For example, one of ordinary skill in the art will recognize that the object tracking, at  320  in  FIG. 3 , could be limited to the tracking of reportable objects, by placing the tracking process after the loop  330 - 375 . Similarly, in  FIG. 4 , the object recognizer  430  could be configured to only report reportable objects to the object tracker  440 . In like manner, the detection of a zone-change at  360  in  FIG. 3  could be limited to a comparison of the current zone of the object to the list of initial blocking zones to determine whether the object has departed the initial zones. These and other system configuration and optimization features will be evident to one of ordinary skill in the art in view of this disclosure, and are included within the scope of the following claims.  
         [0039]     In interpreting these claims, it should be understood that: 
        a) the word “comprising” does not exclude the presence of other elements or acts than those listed in a given claim;     b) the word “a” or “an” preceding an element does not exclude the presence of a plurality of such elements;     c) any reference signs in the claims do not limit their scope;     d) several “means” may be represented by the same item or hardware or software implemented structure or function;     e) each of the disclosed elements may be comprised of hardware portions (e.g., including discrete and integrated electronic circuitry), software portions (e.g., computer programming), and any combination thereof;     f) hardware portions may be comprised of one or both of analog and digital portions;     g) any of the disclosed devices or portions thereof may be combined together or separated into further portions unless specifically stated otherwise; and     h) no specific sequence of acts is intended to be required unless specifically indicated.

Technology Category: g