Patent ID: 12217508

DESCRIPTION OF EMBODIMENTS

First Example Embodiment

First, an overview of a processing system of the present example embodiment will be described with reference to an example ofFIG.1. The processing system of the present example embodiment emits an electromagnetic wave having a wavelength of 30 micrometers or more and 1 meter or less toward persons6passing through a first area1, and receives a reflected wave. In the case of the illustrated example, a sensor panel2emits the electromagnetic wave and receives the reflected wave. Then, a registration apparatus4determines whether the person6possesses a pre-designated object (for example, a dangerous object such as a pistol) on the basis of a signal of the reflected wave received by the sensor panel2.

Furthermore, a camera3captures an image of the person6passing through the first area1in at least either before passing through the first area1, during passing through the first area1, or after passing through the first area1, and generates a person image indicating the appearance of the person6. Then, the registration apparatus4registers the person image of the person6determined to possess the pre-designated object, in a first list (black list) of a database5.

In this way, the processing system of the present example embodiment performs walk-through type belongings inspection on the person6passing through the first area1, and captures an image of the person6to generate a person image indicating the appearance of the person6. Then, the processing system registers the person image of the person6determined to possess the pre-designated object, in the first list. According to such a processing system of the present example embodiment, processing efficiency and convenience of belongings inspection are improved.

Next, details of the configuration of a processing system20will be described in detail.FIG.2illustrates an example of a functional block diagram of the processing system20. As illustrated inFIG.2, the processing system20includes an image capturing unit21, an electromagnetic wave transmission/reception unit22, a determination unit23, a registration unit24, and a storage unit25. In the case of the example ofFIG.1, the sensor panel2corresponds to the electromagnetic wave transmission/reception unit22, the camera3corresponds to the image capturing unit21, the registration apparatus4corresponds to the determination unit23and the registration unit24, and the database5corresponds to the storage unit25.

The electromagnetic wave transmission/reception unit22emits an electromagnetic wave (for example, a microwave, a millimeter wave, a terahertz wave, and the like) having a wavelength of 30 micrometers or more and 1 meter or less toward the persons6passing through the first area1, and receives a reflected wave. The electromagnetic wave transmission/reception unit22is, for example, a radar. The electromagnetic wave transmission/reception unit22can be configured by adopting any technology. For example, the electromagnetic wave transmission/reception unit22may be the sensor panel2composed of a radar in which a plurality of antennas are arranged, as in the example ofFIG.1.

The determination unit23determines whether the person6passing through the first area1possesses a pre-designated object, on the basis of a signal of the reflected wave received by the electromagnetic wave transmission/reception unit22. The “designation of an object” is, for example, designation of a category (type) such as “pistol” and “knife”, and it is not necessary to designate a detailed type, model, and the like of each category. For example, according to a determination method using machine learning to be described below, it is possible to detect that even an unknown type or model in a designated object is possessed. Hereinafter, an example of the determination method by the determination unit23will be described, but this is merely an example and the present invention is not limited thereto.

For example, the determination unit23may generate a transmission image on the basis of the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22. Then, the determination unit23may determine whether the person6possesses the pre-designated object, on the basis of a shape appearing in the transmission image.

As an example of the determination method based on the shape appearing in the transmission image, the use of machine learning is conceivable. For example, an estimation model, in which a transmission image (training data) of a pre-designated object is prepared and an object appearing in the transmission image is estimated by machine learning based on the training data, may be generated. Then, the determination unit23may determine whether the pre-designated object is appearing in the transmission image, on the basis of the generated transmission image and estimation model. As another example, the determination unit23may search for a pre-designated object in a transmission image by template matching using a template indicating the shape of the pre-designated object.

Furthermore, the determination unit23may determine whether the person6possesses the pre-designated object, on the basis of a feature value (transmission feature value) appearing in the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22. That is, the determination unit23may perform the above determination by using the signal of the reflected wave as is without generating any transmission image. Even in such a case, an example using the estimation model based on the aforementioned machine learning or the use of an example using the template matching is conceivable.

The pre-designated object is an object that is not preferable to be possessed by the person6passing through the first area1, and examples thereof include, but not limited to, a dangerous object such as a knife and a pistol.

When the electromagnetic wave transmission/reception unit22continuously transmits/receives an electromagnetic wave, the determination unit23can classify a signal of a reflected wave for each person6and determine whether each person6possesses a pre-designated object on the basis of the signal of the reflected wave of each person6.

The following is conceivable as an example of the process of classifying a signal of a reflected wave for each person6. First, features appearing in a signal of a reflected wave and a transmission image generated from the signal differ depending on when the person6exists in the first area1and when the person6does not exist in the first area1. When the person6does not exist in the first area1, for example, a reflected wave reflected by a facing wall is received by the electromagnetic wave transmission/reception unit22. When the person6exists in the first area1, for example, a reflected wave reflected by a wall and the person6is received by the electromagnetic wave transmission/reception unit22.

For example, the electromagnetic wave transmission/reception unit22may transmit/receive an electromagnetic wave in advance in a state where no person exits in the first area1, and a signal of a reflected wave received in such a state may be held as a reference signal. Then, the determination unit23may use the reference signal or a transmission image generated from the reference signal, and specify whether the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22indicates a “state where the person6exists in the first area1” or a “state where the person6does not exist in the first area1”. For example, the determination unit23may specify whether the signal of the reflected wave indicates which of the two states, on the basis of whether a difference between the signal of the reflected wave and the reference signal is equal to or more than a threshold or whether a difference between a transmission image generated from the signal of the reflected wave and a transmission image generated from the reference signal is equal to or more than a threshold.

In addition, the entry/exit of the person6to the first area1may be determined by using an optical image generated by another apparatus (sensor such as a camera) other than the aforementioned apparatus or sensor information from a human sensor and the like, so that the “timing (time period)” in which each person6exists in the first area1″ may be specified. On the basis of the specified “timing (time period)” in which each person6exists in the first area1″, the determination unit23may classify a signal of a reflected wave for each person6.

On the basis of the specified result, the determination unit23can specify the timing when each person6has entered the first area1(timing when the state where the person6does not exist in the first area1has changed to the state where the person6exists in the first area1) and the timing when each person6has exit the first area1(timing when the state where the person6exists in the first area1has changed to the state where the person6does not exist in the first area1). On the basis of the specified result, the determination unit23can classify a signal of a reflected wave for each person6. Specifically, the determination unit23can use the signal of the reflected wave from the “timing when a certain person6enters the first area1” to the “timing when a certain person6exits the first area1” that appears immediately after that, as data of one person6.

The image capturing unit21captures an image of the person6passing through the first area1and generates a person image indicating the appearance (including a face) of the person6. The image capturing unit21is a camera that receives light such as visible light and infrared light and generates an image. The image capturing unit21is installed at a position and an orientation, in which an image of the person6can be captured, at least at any timing before passing through the first area1, after passing through the first area1, and during passing through the first area1. One image capturing unit21may be installed, or a plurality of image capturing units21may be installed.

The image capturing unit21may continuously capture a moving image, capture a still image at a predetermined capturing timing, or capture a moving image for a predetermined period of time from the predetermined capturing timing.

The predetermined capturing timing can be a timing when the person6has been detected at a predetermined position. The predetermined position may be a position in the first area1, any position in a capturing area (view area) of the camera3, a position immediately before the capturing area (view area) of the camera3or the first area1(immediately before being directed to the traveling direction), or other positions.

The above capturing timing may be determined, for example, on the basis of the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22. That is, on the basis of the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22, it may be detected that the person6has entered the first area1(capturing timing). A means for detecting that the person6has entered the first area1on the basis of the signal of the reflected wave received by the electromagnetic wave transmission/reception unit22is as described above. Furthermore, the above capturing timing may be determined on the basis of a signal sensed by another sensor. For example, the person6may be detected at a predetermined position by a human sensor installed at the predetermined position.

The registration unit24registers, in the first list, the person image of the person6determined by the determination unit23to possess the pre-designated object. The storage unit25stores the first list.

FIG.3schematically illustrates an example of the first list. In the case of the illustrated example, information (serial number) for identifying persons6registered in the first list, person images generated by the image capturing unit21, feature values indicating the features of appearance of the persons6extracted from the person images, transmission images generated related to the persons6, date and time (detection date and time) when the persons6have been detected in the first area1, and the type of pre-designated objects (belongings) determined to be possessed by the persons6are registered in association with one another. The first list may not include information on some items in illustrated example, or may include information on other items.

The registration unit24may also register the person images generated by the image capturing unit21and the determination result of the determination unit23in a log in association with each other. In the log, the person images of all persons6who have passed through the first area1and the determination result of the determination unit23are registered. The storage unit25can store the log.

FIG.4schematically illustrates an example of the log. In the case of the illustrated example, information (serial number) for identifying a plurality of logs from each other, the person images generated by the image capturing unit21, the feature values indicating the features of the appearance of the persons6extracted from the person images, the transmission images generated related to the persons6, the date and time (detection date and time) when the persons6have been detected in the first area1, the determination result of the determination unit23, and names of the pre-designated objects (belongings) determined to be possessed by the persons6are registered in association with one another. The log may not include information on some items in illustrated example, or may include information on other items.

The registration unit24may also register the person images generated by the image capturing unit21and the determination result of the determination unit23in a pre-generated second list in association with each other. The second list may be, for example, a list of prospective visitors, a blacklist of persons requiring special attention, or others. The storage unit25can store the second list.

FIG.5schematically illustrates an example of the second list. In the case of the illustrated example, information (serial number) for identifying the persons6registered in the second list from each other, names, and face images are registered in advance. Other information is registered on the basis of information generated by the image capturing unit21, the electromagnetic wave transmission/reception unit22, and the determination unit23.

In the case of the illustrated example, as other information, visit flags indicating whether persons6have visited, the person images generated by the image capturing unit21, the feature values indicating the features of the appearance of the persons6extracted from the person images, the transmission images generated related to the persons6, the date and time (detection date and time) when the persons6have been detected in the first area1, the determination result of the determination unit23, and the names of the pre-designated objects (belongings) determined to be possessed by the persons6are registered in association with one another. The second list may not include information on some items in illustrated example, or may include information on other items.

The registration unit24can specify which person6in the second list is the person6detected in the first area1, by collating the face images registered in the second list in advance with the person images generated by the image capturing unit21.

A means for associating the person images generated by the image capturing unit21and the determination result of the determination unit23with each other in relation to the same person6is not particularly limited. For example, the person images and the determination result of the determination unit23may be assigned time stamps. On the basis of the time stamps, the registration unit24may associate the person images regarding the same person6and the determination result of the determination unit23with each other. The association may also be implemented by other means.

Next, an example of a processing flow of the processing system20will be described with reference to a flowchart ofFIG.6. The processing flow to be described below is merely an example and can be appropriately modified on the basis of the configuration of the aforementioned each functional unit.

When the processing is started, the electromagnetic wave transmission/reception unit22repeats the emission of an electromagnetic wave having a wavelength of 30 micrometers or more and 1 meter or less and the reception of a reflected wave at predetermined intervals. Then, when a signal of the reflected wave is achieved from the electromagnetic wave transmission/reception unit22(S10), the determination unit23determines whether a person6has entered the first area1on the basis of the signal (S11). Since the details of the determination process are as described above, description thereof will be omitted.

When it is determined that the person6has not entered the first area1(No at S11), the determination unit23waits for the acquisition of a signal of a next reflected wave unless there is an instruction to end the processing (No at S17).

On the other hand, when it is determined that the person6has entered the first area1(Yes at S11), the determination unit23determines on the basis of the signal of the reflected wave whether the person6who has entered the first area1possesses a pre-designated object, and inputs the determination result to the registration unit24(S13). Since the details of the determination process are as described above, description thereof will be omitted.

When it is determined that the person6has entered the first area1(Yes at S11), the determination unit23notifies the registration unit24that the person6has entered the first area1. The registration unit24acquires a person image from the image capturing unit21in response to the notification (S12).

For example, the image capturing unit21may continuously capture a moving image. Then, the registration unit24may request a person image from the image capturing unit21in response to the above notification, and the image capturing unit21may return, to the registration unit24, a person image generated at the timing of the request or immediately before or immediately after the request.

In addition, the image capturing unit21may be configured to capture a still image at a predetermined capturing timing, or capture a moving image for a predetermined period of time from the predetermined capturing timing. When it is determined that the person6has entered the first area1(Yes at S11), the determination unit23may notify the image capturing unit21that the person6has entered the first area1. The image capturing unit21may capture a still image, or capture a moving image for a predetermined period of time in response to the notification, and input a generated image to the registration unit24.

Thereafter, the registration unit24registers the acquired person image and the determination result of the determination unit23in the log (seeFIG.4) in association with each other (S14).

Next, when the registered determination result indicates “the person6possesses a pre-designated object” (Yes at S15), the registration unit24registers the acquired person image in the first list (seeFIG.3) (S16). On the other hand, when the registered determination result indicates “the person6possesses no pre-designated object” (No at S15), the registration unit24does not register the acquired person image in the first list (seeFIG.3).

Next,FIG.7illustrates an example of a screen output by the processing system20. Although the illustrated screen includes all of areas A to E, the screen output by the processing system20may include at least a part of the areas A to E.

In the area B, a person image of a person6newly detected in the first area1(person image generated by the capturing unit21) is displayed. In the area C, the determination result of the determination unit23regarding the person6and the detection date and time are displayed.

In the area E, the person image and the transmission image of the person6are displayed. As in the example, at least one of a plurality of image capturing units21may capture an image of the person6from the same direction as the emission direction in which the electromagnetic wave transmission/reception unit22emits an electromagnetic wave (so that an optical axis is substantially parallel). Then, a person image E2and a transmission image E1observed from the same direction may be displayed side by side. As in the illustrated example, the position of a detected pre-designated object in the image may be clearly indicated by a frame W and the like.

In the area A, various UI components are displayed. For example, the person image displayed in the area B and/or the area E may be a part (one frame image) of a dynamic image generated by the image capturing unit21. Then, the playback, stop, pause, and the like of the dynamic image may be instructed via the UI components displayed in the area A.

In the area D, the logs (seeFIG.4) stored in the storage unit25is displayed. The processing system20may accept user input for selecting one from the logs displayed in the area D. In the area B, the area C, and the area E, information on the selected log may be displayed instead of information on the person6newly detected in the first area1.

Next, an example of the hardware configuration of the processing system20will be described. Each functional unit included in the processing system20is implemented by an arbitrary combination of hardware and software centering on a central processing unit (CPU) of an arbitrary computer, a memory, a program loaded on the memory, a storage unit such as a hard disk for storing the program (can store programs downloaded from a storage unit such as a compact disc (CD), a server on the Internet, and the like in addition to programs stored in advance from the shipping stage of an apparatus), and a network connection interface. It is understood by a person skilled in the art that there are various modifications in the implementation method and apparatus.

FIG.8is a block diagram illustrating an example of the hardware configuration of the processing system20. As illustrated inFIG.8, the processing system20includes a processor1A, a memory2A, an input/output interface3A, a peripheral circuit4A, and a bus5A. The peripheral circuit4A includes various modules. The processing system20may not include the peripheral circuit4A. The processing system20may be composed of a plurality of physically and/or logically separated apparatuses, or may be composed of one physically and/or logically integrated apparatus. When the processing system20is composed of a plurality of physically and/or logically separated apparatuses, each of the plurality of apparatuses may include the above hardware configuration.

The bus5A is a data transmission path through which the processor1A, the memory2A, the peripheral circuit4A, and the input/output interface3A transmit/receive data to/from one another. The processor1A is, for example, an arithmetic processing unit such as a CPU and a graphics processing unit (GPU). The memory2A is, for example, a memory such as a random access memory (RAM) and a read only memory (ROM). The input/output interface3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, and the like, an interface for outputting information to an output device, an external device, an external server, and the like, and the like. The input device is, for example, a keyboard, a mouse, a microphone, a physical button, a touch panel, and the like. The output device is, for example, a display, a speaker, a printer, a mailer, and the like. The processor1A can output a command to each module and perform a calculation based on the calculation result thereof.

Next, an advantageous effect of the processing system20of the present example embodiment will be described. The processing system20of the present example embodiment performs walk-through type belongings inspection on a person6passing through the first area1, and captures an image of the person6to generate a person image indicating the appearance of the person6. Then, the processing system20registers the person image of the person6determined to possess a pre-designated object, in the first list. According to such a processing system of the present example embodiment, it is possible to inspect belongings without being conscious of any person6. As a consequence, processing efficiency and convenience of the belongings inspection are improved. Furthermore, as the processing efficiency and convenience are improved, it is possible to perform inspection even in a soft target area where a plurality of persons6can enter, without requiring authentication and the like for entry.

Furthermore, the first list in which the person6determined to possess the pre-designated object is registered is generated, so that various processes for enhancing security for a facility can be performed by using the list after the inspection. Various processes for enhancing security for the facility can be performed by using the first list after the inspection, so that it is less necessary to secure the identity of the person6at the time of inspection. As a consequence, it is less necessary to allow a security guard and the like to stay in an inspection place, thereby acquiring an effect of reduction of labor costs, and the like. Specific examples of various processes will be described in the following example embodiments.

Furthermore, according to the processing system20of the present example embodiment, the person image and the determination result of the determination unit23can be registered in the log in association with each other. Therefore, it is possible to confirm the determination result of the determination unit23regarding each of a plurality of persons6who have visited a facility.

Furthermore, according to the processing system20of the present example embodiment, the transmission image and details (inspection result, belongings, and the like) of the determination result of the determination unit23can be associated with each other in the first list, the log, and the like. Therefore, it is possible to quickly access the transmission image of each person6and the details of the determination result of the determination unit23from the first list and the log. As a consequence, for example, a worker can access the transmission image of each person6and the details of the determination result of the determination unit23from the first list and the log, and confirm whether the registered determination result is correct.

Hereinafter, modifications of the processing system20of the present example embodiment will be described. The processing system20may determine whether a person6possesses a pre-designated object by using another apparatus such as an explosive detector, and register the determination result. Even in such a case, the same advantageous effect is implemented.

Furthermore, the method of the arrangement of the sensor panel2illustrated inFIG.1is merely an example, and the present invention is not limited thereto. For example, the sensor panel2may be arranged to have a predetermined angle with respect to the traveling direction, a plurality of sensor panels2may be arranged, or other arrangement methods may be adopted.FIG.19toFIG.24illustrate examples of the arrangement method of the sensor panel2. In the example ofFIG.19, one sensor panel2is arranged and a person6is turned in front of the sensor panel2. In the examples ofFIG.20andFIG.21, a plurality of sensor panels2are arranged to interpose a position, where the person6passes, therebetween. In the example ofFIG.22, a plurality of sensor panels2are arranged at curved positions of a passage in which a person6is turned by a predetermined angle for direction change.FIG.23is an example in which sensor panels2are installed above an escalator, stairs, and the like. For example, the sensor panels2can be installed behind a ceiling having an angle with respect to a horizontal direction as illustrated in the drawing.FIG.24is an example in which sensor panels2are installed above and below stairs and the like. For example, the sensor panels2can be installed behind a ceiling having an angle with respect to a horizontal direction as illustrated in the drawing. Furthermore, the sensor panels2may be embedded in the stairs. Even in the modifications, the same advantageous effect is implemented.

Second Example Embodiment

A processing system20of the present example embodiment is different from the first example embodiment in that, when a person6determined to possess a pre-designated object and having a person image registered in the first list has been registered in a white list generated in advance, the processing system20has a function of deleting the person image of the person6from the first list.

An example of the functional block diagram of the processing system20is illustrated inFIG.2, as in the first example embodiment.

When the person6registered in the first list has been registered in the white list generated in advance, the registration unit24deletes the person image of the person6from the first list. The storage unit25stores the white list.

FIG.9schematically illustrates an example of the white list. In the illustrated example, names and face images of persons6have been registered in the white list. The registration unit24can determine whether the person6registered in the first list has been registered in the white list, by collating the face images registered in the white list in advance with the person images generated by the image capturing unit21.

FIG.10schematically illustrates another example of the white list. In the illustrated example, names and face images of persons6and names of objects permitted to be possessed have been registered in the white list. In the case of the example, when the person6registered in the first list has been registered in the white list and an object determined to be possessed by the person6is an object permitted to be possessed, the registration unit24deletes the person image of the person6from the first list. That is, even though the person6registered in the first list has been registered in the white list, when the object determined to be possessed by the person6is an object not permitted to be possessed, the registration unit24does not delete the person image of the person6from the first list.

The white list may include information on other items such as feature values extracted from face images, contact information (addresses and phone numbers), information indicating belonging destinations, and the like.

The other configurations of the processing system20are the same as those of the first example embodiment.

According to the processing system20of the present example embodiment described above, the same advantageous effect as the processing system20of the first example embodiment can be implemented.

Furthermore, according to the processing system20of the present example embodiment, a person6registered in the white list can be deleted from the first list. For example, security guards, bodyguards, and the like who patrol a facility may possess a knife, a pistol, and the like for security. When such a person6is registered in the first list, is monitored, or activities of the person6are restricted in the facility, it is not preferable because a processing load of a computer is unnecessarily increased or the work of security guards and bodyguards are hindered. The processing system20of the present example embodiment can reduce such inconvenience.

Third Example Embodiment

A processing system20of the present example embodiment performs a process for improving security by using the aforementioned first list. Specifically, as illustrated inFIG.11, a tracking apparatus10of the processing system20has a function of detecting and tracking a person6registered in the first list (database5) within an image generated by a surveillance camera11installed in a facility. Hereinafter, details of the processing system20will be described.

FIG.12illustrates an example of a functional block diagram of the processing system20. As illustrated inFIG.12, the processing system20includes an image capturing unit21, an electromagnetic wave transmission/reception unit22, a determination unit23, a registration unit24, a storage unit25, a tracking unit26, and a surveillance capturing unit32. In the case of the example ofFIG.12, the surveillance camera11corresponds to the surveillance capturing unit32, the tracking apparatus10corresponds to the tracking unit26, and the database5corresponds to the storage unit25.

The surveillance capturing unit32is installed in any position in a facility and continuously captures a moving image. One surveillance capturing unit32may be installed or a plurality of surveillance capturing units32may be installed.

The tracking unit26detects a person6registered in the first list within a surveillance image generated by the surveillance capturing unit32(the surveillance camera11). For example, the tracking unit26detects a person within the surveillance image, and detects the person6registered in the first list within the surveillance image by collating an image of the detected person with person images registered in the first list. Then, the tracking unit26tracks the detected person by using a person tracking technology.

The tracking unit26may register history of a detection result and a tracking result for each person6registered in the first list. For example, information indicating a place where an image of each person6has been captured (for example, moving image file identification information, elapsed time from the beginning of a moving image file, and the like) may be registered for each person6registered in the first list. The position of each person6may be registered in the surveillance image.

Furthermore, the surveillance capturing unit32may include a microphone and collect audio. When the audio collected by the surveillance capturing unit32satisfies a predetermined condition (for example, scream is detected or explosion sound is detected), the tracking unit26may notify a surveillant that the audio satisfies the predetermined condition, and notify the surveillant of a person existing in the surveillance image generated by the surveillance capturing unit32and registered in the first list. For example, the tracking unit26may transmit, to the surveillant, a surveillance image in which the person registered in the first list is emphasized by a frame and the like.

The other configurations of the processing system20are the same as those of the first and second example embodiments.

According to the processing system20of the present example embodiment described above, the same advantageous effect as the processing systems20of the first and second example embodiments can be implemented.

Furthermore, according to the processing system20of the present example embodiment, it is possible to detect and track a person6registered in the first list (database5) within an image generated by the surveillance camera11installed in a facility. Therefore, a manager of the facility can recognize the position of a person6registered in the first list in a timely manner.

Furthermore, according to the processing system20of the present example embodiment, information indicating a place where an image of each person6has been captured (for example, moving image file identification information, elapsed time from the beginning of a moving image file, and the like) can be registered for each person6registered in the first list. The use of such registration information makes it possible for a surveillant to efficiently browse a portion of a surveillance image (moving image) in which an image of the person6registered in the first list is captured.

Furthermore, when audio collected by the surveillance capturing unit32satisfies the predetermined condition, the processing system20of the present example embodiment can notify a surveillant of a “person6registered in the first list”, who exists in that area. Such a processing system20can notify a surveillant of a person requiring special attention at an appropriate timing.

Fourth Example Embodiment

A processing system20of the present example embodiment performs a process for improving security by using the aforementioned first list. Specifically, as illustrated inFIG.13, in the present example embodiment, a gate8is installed in a facility. When an image generated by a camera9provided in the gate8is acquired, a gate control apparatus7of the processing system20determines whether a person6captured in the acquired image has been registered in the first list (database5). On the basis of the determination result, the gate control apparatus7controls the opening and closing of the gate8. Hereinafter, details of the processing system20will be described.

FIG.14is an example of a functional block diagram of the processing system20. As illustrated inFIG.14, the processing system20includes an image capturing unit21, an electromagnetic wave transmission/reception unit22, a determination unit23, a registration unit24, a storage unit25, a gate control unit27, and a gate capturing unit28. In the case of the example ofFIG.13, the camera9corresponds to the gate capturing unit28, the gate control apparatus7corresponds to the gate control unit27, and the database5corresponds to the storage unit25. Although not illustrated in the drawing, the processing system20may also include the tracking unit26and the surveillance capturing unit32.

The gate capturing unit28captures an image of a person6in front of the gate8. The gate capturing unit28may continuously capture a moving image, or capture a still image at a predetermined timing (for example, timing when the person6in front of the gate8is detected by a human sensor and the like).

The gate control unit27determines whether a person6captured in an image generated by the gate capturing unit28has been registered in the first list (database5). For example, the gate control unit27detects a person within the image generated by the gate capturing unit28, and determines whether the person6captured in the image generated by the gate capturing unit28has been registered in the first list (database5), by collating an image of the detected person with person images registered in the first list.

Then, the gate control unit27controls the opening and closing of the gate8according to whether the person6captured in the image generated by the gate capturing unit28has been registered in the first list. For example, when the person6captured in the image generated by the gate capturing unit28has been registered in the first list, the gate control unit27may output an instruction to close the gate8. On the other hand, when the person6captured in the image generated by the gate capturing unit28has not been registered in the first list, the gate control unit27may output an instruction to open the gate8.

The gate8performs an opening and closing operation on the basis of an instruction output from the gate control unit27. For example, when a closing instruction is acquired in an opened state, the gate8performs a closing operation. When an opening instruction is acquired in a closed state, the gate8performs an opening operation. When an opening instruction is acquired in an opened state, the gate8maintains the opened state without performing the opening and closing operation. When a closing instruction is acquired in a closed state, the gate8maintains the closed state without performing the opening and closing operation. The gate8that performs an opening and closing operation on the basis of an instruction (electric signal) can be configured by adopting any technology.

The other configurations of the processing system20are the same as those of the first to third example embodiments.

According to the processing system20of the present example embodiment described above, the same advantageous effect as the processing systems20of the first to third example embodiments can be implemented.

Furthermore, according to the processing system20of the present example embodiment, the opening and closing of the gate8can be controlled by using the first list. As a consequence, it is possible effectively prevent a person requiring special attention, who possesses a dangerous object and the like, from passing through the gate8and entering an area thereafter.

In the above description, the opening and closing of the gate8is controlled according to whether a person6captured in an image generated by the camera9installed in the gate8has been registered in the first list; however, as a modification, the opening and closing of the gate8may be controlled according to the determination result of belongings inspection by the determination unit23. For example, when the gate8is installed immediately after the first area1where walk-through type belongings inspection is performed or when a subsequent movement route of a person6who has passed through the first area1is determined (there is no escape route) and the processing system20can recognize the position of the person6up to the gate8, the modification can be adopted. Even in the modification, the same advantageous effect is implemented.

Fifth Example Embodiment

A processing system20of the present example embodiment performs a process for improving security by using the aforementioned first list. Specifically, as illustrated inFIG.15, in the present example embodiment, a branch point is installed in a facility. After the branch point, for example, it may be divided into a plurality of routes, a plurality of windows, a plurality of persons in charge, a plurality of inspection stations, or others.

When an image generated by a camera14provided at the branch point is acquired, a guidance apparatus13of the processing system20determines whether a person6captured in the acquired image has been registered in the first list (database5). On the basis of the determination result, the guidance apparatus13determines an option to which the person6is guided among a plurality of options after the branch point, and outputs the determination content to an output apparatus12. Hereinafter, details of the processing system20will be described.

FIG.16is an example of a functional block diagram of the processing system20. As illustrated inFIG.16, the processing system20includes an image capturing unit21, an electromagnetic wave transmission/reception unit22, a determination unit23, a registration unit24, a storage unit25, a guidance control unit29, and a branch point capturing unit30. In the case of the example ofFIG.15, the camera14corresponds to the branch point capturing unit30, the guidance apparatus13corresponds to the guidance control unit29, and the database5corresponds to the storage unit25. Although not illustrated in the drawing, the processing system20may also include the tracking unit26and the surveillance capturing unit32. Furthermore, the processing system20may also include the gate control unit27and the gate capturing unit28.

The branch point capturing unit30captures an image of a person6in front of the branch point. The branch point capturing unit30may continuously capture a moving image, or capture a still image at a predetermined timing (for example, timing when the person6in front of the branch point is detected by a human sensor and the like).

The guidance control unit29determines whether a person6captured in an image generated by the branch point capturing unit30has been registered in the first list (database5). For example, the guidance control unit29detects a person within the image generated by the branch point capturing unit30, and determines whether the person6captured in the image generated by the branch point capturing unit30has been registered in the first list (database5), by collating an image of the detected person with person images registered in the first list.

Then, the guidance control unit29provides guidance after the branch point according to whether the person6captured in the image generated by the branch point capturing unit30has been registered in the first list. For example, the content of guidance related to when the person6has been registered in the first list and when the person6has not been registered in the first list may be registered in advance. For example, when the person6has been registered in the first list, guidance to a “first route” may be registered, and when the person6has not been registered in the first list, guidance to a “second route” may be registered. Then, the guidance control unit29may allow the output apparatus12to output guidance related to the determination result regarding whether the person6captured in the image generated by the branch point capturing unit30has been registered in the first list. The output apparatus12is an output apparatus such as a display, a speaker, and a projection apparatus.

The other configurations of the processing system20are the same as those of the first to fourth example embodiments.

According to the processing system20of the present example embodiment described above, the same advantageous effect as the processing systems20of the first to fourth example embodiments can be implemented.

Furthermore, according to the processing system20of the present example embodiment, a person6at the branch point can be appropriately guided by using the first list. As a consequence, a person requiring special attention, who possesses a dangerous object and the like, can be guided to a predetermined place, and appropriate processing such as detailed inspection and securing of identity can be performed.

In the above description, the content to be guided is determined according to whether a person6captured in an image generated by the camera14installed at the branch point has been registered in the first list; however, as a modification, the content to be guided may be determined according to the determination result of belongings inspection by the determination unit23. For example, when the branch point is installed immediately after the first area1where walk-through type belongings inspection is performed or when a subsequent movement route of a person6who has passed through the first area1is determined (there is no escape route) and the processing system20can recognize the position of the person6up to the branch point, the modification can be adopted. Even in the modification, the same advantageous effect is implemented.

Sixth Example Embodiment

A processing system20of the present example embodiment performs a process for improving security by using the aforementioned first list. Specifically, as illustrated inFIG.17, a notification apparatus16of the processing system20transmits the first list (database5) to a surveillant terminal15. Then, a surveillant17confirms the first list via the surveillant terminal15. Hereinafter, details of the processing system20will be described.

FIG.18illustrates an example of a functional block diagram of the processing system20. As illustrated inFIG.18, the processing system20includes an image capturing unit21, an electromagnetic wave transmission/reception unit22, a determination unit23, a registration unit24, a storage unit25, and a notification unit31. In the case of the example ofFIG.17, the notification apparatus16corresponds to the notification unit31and the database5corresponds to the storage unit25. Although not illustrated in the drawing, the processing system20may also include the tracking unit26and the surveillance capturing unit32. Furthermore, the processing system20may also include the gate control unit27and the gate capturing unit28. Furthermore, the processing system20may also include the guidance control unit29and the branch point capturing unit30.

The notification unit31transmits the first list to the surveillant terminal15via a network such as the Internet, or a wired cable. For example, the notification unit31may transmit the first list to the surveillant terminal15whenever the first list is updated. The surveillant terminal15may be a portable terminal such as a smart phone, a tablet terminal, a smart watch, and a mobile phone, or may be a stationary terminal.

The other configurations of the processing system20are the same as those of the first to fifth example embodiments.

According to the processing system20of the present example embodiment described above, the same advantageous effect as the processing systems20of the first to fifth example embodiments can be implemented.

Furthermore, according to the processing system20of the present example embodiment, it is possible to transmit the first list to the surveillant terminal15. As a consequence, the surveillant17can confirm the first list via the surveillant terminal15.

Although the present invention has been described with reference to example embodiments (and examples), the present invention is not limited to the above example embodiments (and examples). Various modifications that a person skilled in the art can appreciate may be applied to the structure and details of the present invention within the scope of the present invention.

Some or all of the above example embodiments may be described as in the following supplementary notes; however, the present invention is not limited thereto.1. A processing system including: an image capturing means that captures an image of a person passing through a first area and generates a person image indicating an appearance of the person; an electromagnetic wave transmission/reception means that emits an electromagnetic wave having a wavelength of 30 micrometers or more and 1 meter or less toward the person passing through the first area, and receives a reflected wave; a determination means that determines whether the person possesses a pre-designated object, based on a signal of the received reflected wave; and a registration means that registers, in a first list, the person image of the person determined to possess the pre-designated object.2. The processing system according to 1, wherein the determination means generates a transmission image based on the signal of the received reflected wave, and determines whether the person possesses the pre-designated object, based on a shape appearing in the transmission image.3. The processing system according to 1, wherein the determination means extracts a transmission feature value based on the signal of the received reflected wave, and determines whether the person possesses the pre-designated object, based on the transmission feature value.4. The processing system according to any one of 1 to 3, wherein the registration means registers the person image and a determination result of the determination means in a log in association with each other.5. The processing system according to any one of 1 to 4, further including a tracking means that detects a person registered in the first list within an image generated by a surveillance camera, and tracks the person within the image.6. The processing system according to any one of 1 to 5, further including: a gate capturing means that captures an image of a person in front of a gate; and a gate control means that controls opening and closing of the gate according to whether a person captured in an image generated by the gate capturing means has been registered in the first list.7. The processing system according to any one of 1 to 6, further including: a branch point capturing means that captures an image of a person in front of a branch point; and a guidance control means that provides guidance after the branch point according to whether a person captured in an image generated by the branch point capturing means has been registered in the first list.8. The processing system according to any one of 1 to 7, further including a notification means that transmits the first list to a surveillant terminal.9. The processing system according to any one of 1 to 8, wherein, when a person registered in the first list has been registered in a white list generated in advance, the registration means deletes the person image of the person from the first list.10. The processing system according to any one of 1 to 9, wherein the determination means detects a timing when a person has entered the first area and a timing when the person has exited the first area, based on a signal of the received reflected wave, and divides a signal of the received reflected wave for each person based on the detected timing.11. The processing system according to any one of 1 to 10, wherein a screen that indicates at least a part of the person image generated by the image capturing means, a determination result of the determination means, a transmission image generated based on a signal of the reflected wave received by the electromagnetic wave transmission/reception means, and a log being generated by the registration means and indicating a determination result of the determination means for each of a plurality of persons who have passed the first area, is output.12. A processing method including, by a processing system: capturing an image of a person passing through a first area and generating a person image indicating an appearance of the person; emitting an electromagnetic wave having a wavelength of 30 micrometers or more and 1 meter or less toward the person passing through the first area, and receiving a reflected wave; determining whether the person possesses a pre-designated object, based on a signal of the received reflected wave; and registering, in a first list, the person image of the person determined to possess the pre-designated object.13. A program that causes a computer of a processing system to function as: an image capturing means that captures an image of a person passing through a first area and generates a person image indicating an appearance of the person; a determination means that determines whether the person possesses a pre-designated object, based on a signal of a reflected wave of an electromagnetic wave having a wavelength of 30 micrometers or more and 1 meter or less and being emitted toward the person passing through the first area; and a registration means that registers, in a first list, the person image indicating an appearance of the person determined to possess the pre-designated object and being generated by capturing an image of the person passing through the first area.