Abstract:
A monitoring device to monitor and to count people in a certain area includes an extracting module to extract images of persons from a first signal; and a computing module to process the images of persons from the extracting module. The extracting module removes background of the first signal and extracts images of persons for the computing module. The computing module obtains coordinates of a center of each image of persons and a value of hue of each image of persons. The computing module can match images of persons to persons to be monitored and can constantly determine the instant number of persons being monitored.

Description:
FIELD 
       [0001]    The subject matter herein generally relates to a device and a method for monitoring people, and a method for monitoring and counting people. 
       BACKGROUND 
       [0002]    To monitor a plurality of persons, their individual features can be established and the individual people tracked. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0003]    Implementations of the present technology will now be described, by way of example only, with reference to the attached figures. 
           [0004]      FIG. 1  is a block diagram of an embodiment of a monitoring device of the present disclosure. 
           [0005]      FIG. 2  is a schematic diagram of an embodiment of an extracting module of the monitoring device in  FIG. 1 . 
           [0006]      FIG. 3  is another schematic diagram of the embodiment of the extracting module in  FIG. 2 . 
           [0007]      FIG. 4  is a schematic diagram of an embodiment of a first process of a computing module of the monitoring device in  FIG. 1 . 
           [0008]      FIG. 5  is a schematic diagram of a second process of the computing module in  FIG. 4 . 
           [0009]      FIG. 6  is a schematic diagram of a third process of the computing module in  FIG. 4 . 
           [0010]      FIG. 7  is a schematic diagram of a fourth process of the computing module in  FIG. 4 . 
           [0011]      FIG. 8  is a schematic diagram of a fifth process of the computing module in  FIG. 4 . 
           [0012]      FIG. 9  is a schematic diagram of a sixth process of the computing module in  FIG. 4 . 
           [0013]      FIG. 10  is a schematic diagram of a seventh process of the computing module in  FIG. 4 . 
           [0014]      FIG. 11  is a schematic diagram of an eighth process of the computing module in  FIG. 4 . 
           [0015]      FIG. 12  is a schematic diagram of an embodiment of the monitoring device for counting people. 
           [0016]      FIG. 13  is a schematic diagram of an embodiment of the monitoring device for counting people. 
           [0017]      FIG. 14  is a flow chart of an embodiment of a monitoring method of the present disclosure. 
           [0018]      FIG. 15  is a flow chart of an embodiment of a counting method of the present disclosure. 
       
    
    
     DETAILED DESCRIPTION 
       [0019]    It will be appreciated that for simplicity and clarity of illustration, where appropriate, reference numerals have been repeated among the different figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein can be practiced without these specific details. In other instances, methods, procedures, and components have not been described in detail so as not to obscure the related relevant feature being described. Also, the description is not to be considered as limiting the scope of the embodiments described herein. The drawings are not necessarily to scale and the proportions of certain parts may be exaggerated to better illustrate details and features of the present disclosure. 
         [0020]    Several definitions that apply throughout this disclosure will now be presented. 
         [0021]    The term “coupled” is defined as connected, whether directly or indirectly through intervening components, and is not necessarily limited to physical connections. The connection can be such that the objects are permanently coupled or releasably coupled. The term “comprising,” when utilized, means “including, but not necessarily limited to”; it specifically indicates open-ended inclusion or membership in the so-described combination, group, series and the like. 
         [0022]    The disclosure will now be described in relation to a monitoring device. 
         [0023]      FIG. 1  illustrates a monitoring device  100 . 
         [0024]    The monitoring device  100  can comprise a storing module  10 , an extracting module  11 , a computing module  12 , and a signal acquisition module  13 . 
         [0025]    The signal acquisition module  13  is configured to provide a first signal of image or video. 
         [0026]    In one embodiment, the signal acquisition module  13  can comprise a camera. 
         [0027]    In one embodiment, the signal acquisition module  13  may get the first external signal. 
         [0028]    The storing module  10  is configured to store personal information of persons to be monitored. The personal information can comprise color information. 
         [0029]    The extracting module  11  is configured to receive the first signal from the signal acquisition module  13 . The extracting module  11  is also configured to extract images of persons from the first signal. 
         [0030]    The computing module  12  is configured to process the images of persons extracted by the extracting module  11 . 
         [0031]    In one embodiment, the computing module  12  compares the extracted images of persons to personal information stored in the storing module  10 , to establish a mapping relationship. Thus, the computing module  12  matches the extracted images of persons to personal information stored in the storing module  10 . 
         [0032]      FIG. 2  illustrates an embodiment of the extracting module  11 . The extracting module  11  is configured to remove a background of an image of the first signal. 
         [0033]    The extracted images of persons can comprise a first image  1  and a second image  2 . The first image  1  is on the left-hand-side of  FIG. 2  corresponding to the second image  2 . 
         [0034]    The extracting module  11  analyzes pixels which may be comprised in the images of persons through connected component analysis-labeling. The extracting module  11  crops or cuts the images of persons from the image of the first signal. 
         [0035]      FIG. 3  illustrates an image-cutting process that the extracting module  11  uses to cut the images of persons off from the image of the first signal. 
         [0036]    In the embodiment, the extracting module  11  marks four endpoints of the first image  1 . 
         [0037]    The four endpoints are configured to indicate the leftmost, the rightmost, the topmost, and the bottommost points of the first image  1 . 
         [0038]    Similarly, the extracting module  11  marks four endpoints of the second image  2 . The four endpoints are configured to indicate the leftmost, the rightmost, the topmost, and the bottommost of the second image  2 . 
         [0039]    The extracting module  11  cuts the first image  1  and the second image  2  off from the image of the first signal. 
         [0040]      FIG. 4  illustrates a first process used by the computing module  12  to establish the centers of the first image  1  and of the second image  2 . 
         [0041]    A central attachment point of the four endpoints of the first image  1  is regarded as the center of the first image  1 . Coordinates of the center of the first images are defined as (a1, b1). 
         [0042]    A central attachment point of the four endpoints of the second image  2  is regarded as the center of the second image  2 . Coordinates of the center of the second images are defined as (a2, b2). 
         [0043]      FIG. 5  illustrates a second process used by the computing module  12  to process the first image  1  to achieve a value of Hue and a value of Hue level of the first image  1 . 
         [0044]    The computing module  12  processes RGB (red, green, blue) information of the first image  1 . The computing module  12  gets a HSV (hue, saturation, value) information of the first image  1 , according to a preset formula, based on RGB information of the first image  1 . 
         [0045]    A value of hue can be used to distinguish different persons. 
         [0046]    In the embodiment, a value of hue level can be obtained through multiplying the value of hue by four. 
         [0047]    In a histogram of the value of hue of the first image  1  in  FIG. 5 , a small difference in the value of hue can be regarded as not affecting the value of hue level. Thus, errors caused by light or lighting angles can be reduced. 
         [0048]    The histogram of the value of hue of the first image  1  is similar to a histogram of the value of hue level of the first image  1 . Thus, the hue level of the first image  1  can be configured to distinguish between persons. 
         [0049]      FIG. 6  illustrates a third process that the computing module  12  uses to process the second image  2  to get a value of Hue and a value of Hue level of the second image  2 . 
         [0050]    In a histogram of the value of hue of the second image  2  in  FIG. 6 , a small difference in the value of hue can be regarded as not affecting the value of hue level. Thus, errors caused by light or lighting angles can be reduced. 
         [0051]    The histogram of the value of hue of the second image  2  is similar to a histogram of the value of hue level of the first image  1 . Thus, the hue level of the second image  2  can be configured to distinguish between persons. 
         [0052]      FIG. 7  illustrates a process employed by the computing module  12  to compare the images. 
         [0053]    The extracting module  11  extracts a plurality of frames of images from the first signal. The extracting module  11  provides the plurality of frames of images to the computing module  12 . 
         [0054]    When the storing module  10  does not store information of persons to be monitored, the computing module  12  determines that the first image  1  and the second image  2  are introducing new persons to be monitored. 
         [0055]    The computing module  12  defines the coordinates (a1, b1) of the center of the first image  1  to be a center of the coordinates of a first person A to be monitored. 
         [0056]    The computing module  12  defines the coordinates (a2, b2) of the center of the second image  2  to be a center of the coordinates of the second person B to be monitored. 
         [0057]    The coordinates of persons to be monitored may be changed in other frames of images. The computing module  12  monitors the coordinates of persons as indications of their presence. 
         [0058]    In one embodiment, the extracting module  11  extracts a plurality of images from a second frame. The computing module  12  compare coordinates of images in a second frame to the coordinates (a1, b1) of the first person A in the first frame. The computing module  12  calculates a distance between the coordinates (a1, b1) of the first person A to coordinates of images from the extracting module  11 . The computing module  12  compares and finds an image which has a smallest distance to the first person A first because a person&#39;s movement between two frames must be small. 
         [0059]    In at least one embodiment, the computing module  12  selects three images which are closest to the person to be monitored between two frames. 
         [0060]      FIG. 8  illustrates a comparison of values of hue level of images between two frames based on the first person A. Parts which are not overlap are a different value. 
         [0061]    The computing module  12  defines an image of a value of hue level which has a smallest difference in value to be an image of the first person A in a next frame. 
         [0062]    In one embodiment, the computing module can get an image of the first person A in the next frame through the comparison of values of hue level only. 
         [0063]    In one embodiment, when an image in a frame is established to be an image of a person x, the image in the frame and the image of the person x are deleted from all queues awaiting comparison. 
         [0064]      FIG. 9  illustrates that when the computing module  12  determines that a second image  2  of a t+ 1  frame is the second person B, the computing module  12  deletes all comparisons about the second person B of the t+ 1  frame in the waiting queue. 
         [0065]      FIG. 10  illustrates that when all persons to be monitored are established in one frame and there are still images of persons in respect of whom a mapping has not yet been established, the computing module  12  defines the images as images of new persons and stores information of them as new persons to be monitored. The computing module  12  also numbers the new persons to be monitored. 
         [0066]    In one embodiment, when the computing module  12  adds a new person L to be monitored and the person L undergoing monitoring cannot be mapped in next or future frames, the computing module  12  deletes information of the person L. 
         [0067]      FIG. 11  illustrates that when coordinates of a person C to be monitored is unchanging in next or future frames, the computing module  12  deletes information of the person C. 
         [0068]      FIGS. 12-13  show an embodiment that the monitoring device  100  for counting people. 
         [0069]    The computing module  12  set a counting line  121  in a monitoring area  1000 . 
         [0070]    In one frame, the first image  1  and the second image  2  are in the monitoring area  1000 . Each of the first image  1  and the second image  2  has a first endpoint F and a second endpoint S. The first endpoint F is closer to the counting line  121  than to the second endpoint S. When the first endpoint F and the second endpoint S pass the counting line  121 , in that order, in future frames, the computing module  12  determines that the person has passed the counting line  121  and thus increases the count by 1. 
         [0071]      FIG. 14  illustrates a flowchart of a monitoring method  200 . The example method is provided by way of example, as there are a variety of ways to carry out the method. The method described below can be carried out using the configurations illustrated in  FIG. 1 , for example, and various elements of these figures are referenced in explaining the example method. Each block shown in  FIG. 14  represents one or more processes, methods, or subroutines carried out in the example method. Furthermore, the illustrated order of blocks is by example only, and the order of the blocks can be changed. Additional blocks can be added or fewer blocks can be utilized without departing from this disclosure. The example method can begin at block  201 . 
         [0072]    Block  201 , removing background to extract images of persons. 
         [0073]    Block  202 , computing coordinates of centers of images of persons and value of hue level of images of persons. 
         [0074]    Block  203 , comparing distances between coordinates of persons to be monitored and coordinates of centers of images of persons. 
         [0075]    Block  204 , comparing value of hue level of persons to be monitored and value of hue level of images of persons. 
         [0076]    Block  205 , adding images of persons which are not establish mapped with persons to be monitored as new persons to be monitored. 
         [0077]    Block  206 , eliminating errors. 
         [0078]    The monitoring method  200  can comprise: deleting an image in a frame and an image of a person from all queues of comparison when the image in the frame is established to be the image of the person. 
         [0079]    The monitoring method  200  can comprise: deleting information of a person when the person monitor cannot be mapped with images of persons in next frames. 
         [0080]    The monitoring method  200  can comprise: deleting information of a person when a coordinate of the person is not changed in next frames. 
         [0081]      FIG. 15  illustrates a flowchart of a counting method  300 . The example method is provided by way of example, as there are a variety of ways to carry out the method. The method described below can be carried out using the configurations illustrated in  FIG. 1 , for example, and various elements of these figures are referenced in explaining the example method. Each block shown in  FIG. 15  represents one or more processes, methods, or subroutines carried out in the example method. Furthermore, the illustrated order of blocks is by example only, and the order of the blocks can be changed. Additional blocks can be added or fewer blocks can be utilized, without departing from this disclosure. The example method can begin at block  301 . 
         [0082]    Block  301 , setting a counting line in a monitoring area. 
         [0083]    Block  302 , monitoring movement of persons in the monitoring area. 
         [0084]    Block  303 , determining whether both of a first endpoint and a second endpoint are across the counting line. When both of a first endpoint and a second endpoint are across the counting line, the method proceeds to block  304 . When not both of a first endpoint and a second endpoint are across the counting line, the method proceeds to block  302 . 
         [0085]    Block  304 , increasing the count. 
         [0086]    Block  305 , determining whether a person to be monitored has left the monitoring area. When the person has left the monitoring area, the method ends. When the person has not left the monitoring area, the method proceeds to block  302 . 
         [0087]    While the disclosure has been described by way of example and in terms of the embodiment, it is to be understood that the disclosure is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements as would be apparent to those skilled in the art. Therefore, the range of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.