Monitoring system, monitoring method, and program

A monitoring system includes a schedule storage unit configured to store schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use an information processing device, an imaging unit configured to capture an image of users using the information processing device, a user determination unit configured to determine whether all users corresponding to the set of face identification information stored in association with the period information match users included in the captured image in the period indicated by the period information on the basis of the captured image captured by the imaging unit and the schedule information stored in the schedule storage unit, and a use control unit configured to control whether to permit use of the information processing device on the basis of a determination result determined by the user determination unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a 371 U.S. National Stage of International Application No. PCT/JP2015/081661, filed on Nov. 10, 2015, which claims the benefit of and priority to Japanese Patent Application No. 2014-236919, filed on Nov. 21, 2014. The entire disclosures of the above applications are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to a monitoring system, a monitoring method, and a program.

BACKGROUND ART

A monitoring system for monitoring an operator of an information processing device or the like is known (for example, refer to Patent Literature 1). In the monitoring system described above, monitoring is performed so that, for example, a person does not stay alone in a controlled area in which an operation is performed to prevent an operator from performing an unauthorized operation or taking out information.

DOCUMENT OF THE PRIOR ART

Patent Literature

SUMMARY OF INVENTION

Problems to be Solved by the Invention

However, although the above-described monitoring system can prevent a person from staying alone in a controlled area, it is possible for an unauthorized operation to be performed and not noticed by the other worker because workers monitor each other to prevent an unauthorized operation. That is, the above-described monitoring system is insufficient for inhibiting an unauthorized operation by a worker.

The present invention has been made in view of solving the above problem, and an objective of the present invention is to provide a monitoring system, a monitoring method, and a program capable of inhibiting an unauthorized operation by a worker.

Means for Solving the Problems

To solve the above problem, a monitoring system according to an aspect of the present invention includes a schedule storage unit configured to store schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use an information processing device, an imaging unit configured to capture an image of users using the information processing device, a user determination unit configured to determine whether all users corresponding to the set of face identification information stored in association with the period information match users included in the captured image in the period indicated by the period information on the basis of the captured image captured by the imaging unit and the schedule information stored in the schedule storage unit, and a use control unit configured to control whether to permit use of the information processing device on the basis of a determination result determined by the user determination unit.

In the monitoring system of the present invention, the use control unit may permit the use of the information processing device and display a display image including the captured image on a display unit of the information processing device when it is determined by the user determination unit that all of the users corresponding to the set of face identification information in the period match the users included in the captured image, and the use control unit may prohibit the use of the information processing device when it is determined by the user determination unit that not all of the users corresponding to the set of face identification information match the users included in the captured image.

In the monitoring system of the present invention, the schedule storage unit may store the schedule information and authentication key information for authenticating the use of the information processing device in association with each other, and the user determination unit may acquire the schedule information in association with the authentication key information acquired by the information processing device from the schedule storage unit and determine whether all of the users corresponding to the set of face identification information in the period match the users included in the captured image on the basis of the acquired schedule information and the captured image.

A monitoring method according to an aspect of the present invention is a monitoring method of a monitoring system that includes a schedule storage unit configured to store schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use an information processing device, and includes an imaging step in which an imaging unit captures an image of users using the information processing device, a user determining step in which a user determination unit determines whether all users corresponding to the set of face identification information stored in association with the period information match users included in the captured image in the period indicated by the period information on the basis of the captured image captured in the imaging step and the schedule information stored in the schedule storage unit, and a use controlling step in which a use control unit controls whether to permit use of the information processing device on the basis of a determination result determined by the user determination unit.

A program recorded in a computer-readable recording medium according to an aspect of the present invention executes, in a computer of a monitoring system that includes a schedule storage unit configured to store schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use an information processing device, an imaging step in which an imaging unit captures an image of users using the information processing device, a user determining step in which a user determination unit determines whether all users corresponding to the set of face identification information whose date and time of use of the information processing device is within the period indicated by the period information match users included in the captured image on the basis of the captured image captured in the imaging step and the schedule information stored in the schedule storage unit, and a use controlling step in which a use control unit controls whether to permit use of the information processing device on the basis of a determination result determined by the user determination unit.

Advantageous Effects of the Invention

According to the present invention, an unauthorized operation by a worker can be inhibited.

EMBODIMENTS FOR CARRYING OUT THE INVENTION

Hereinafter, a monitoring system according to an embodiment of the present invention will be described with reference to the drawings.

First Embodiment

FIG. 1is a block diagram illustrating an example of a monitoring system1according to a first embodiment.

As illustrated in the drawing, the monitoring system1includes a face authentication server10, a registration terminal20, and an information processing terminal30. Further, the face authentication server10, the registration terminal20, and the information processing terminal30are connected to one another via a network NT.

In the example illustrated inFIG. 1, the monitoring system1may include a plurality of information processing terminals30although a single information processing terminal30is described in the description. Likewise, in the example illustrated inFIG. 1, the monitoring system1may include a plurality of registration terminals20although a single registration terminal20is described in the description.

The face authentication server10is a server device configured to store information used in face authentication of users using the information processing terminal30. Here, users refer to people who use (utilize) the information processing terminal30, and the users include, for example, a worker who performs various information processing tasks using the information processing terminal30and a monitoring person who monitors the worker.

The face authentication server10includes, for example, a server storage unit11and a server control unit12.

The server storage unit11stores information utilized in various processes of the face authentication server10. The server storage unit11stores, for example, information used to authenticate faces of users. The server storage unit11includes, for example, a face authentication storage unit111and a schedule storage unit112.

The face authentication storage unit111is a storage unit configured to store a face authentication database in which information related to face authentication of users is pre-registered. The face authentication storage unit111pre-stores, for example, user identification information for identifying users and face identification information of the users in association with each other. Here, face identification information refers to information for identifying facial images of users and is, for example, feature data of faces extracted from facial images of the users. Here, an example of data of the face authentication storage unit111will be described with reference toFIG. 2.

FIG. 2is a view illustrating an example of the data of the face authentication storage unit111according to the present embodiment.

As illustrated inFIG. 2, the face authentication storage unit111stores, for example, a “user ID,” a “username,” and “face identification information” in association with one another. Here, the “user ID” indicates identification information for uniquely identifying a user, and the “username” indicates a name of a user. Each of the “user ID” and the “username” is user identification information for identifying a user. The “face identification information” is feature data of a face of a user.

In the example illustrated inFIG. 2, it is shown that a user whose “user ID” is “0001” has “OO Taro” as a “username”, and “face identification information” of the user is stored in association with the “user ID” and the “username” in the face authentication storage unit111.

Referring back toFIG. 1, the schedule storage unit112is a storage unit configured to register schedule information of users using the information processing terminal30. The schedule storage unit112stores, for example, schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use the information processing terminal30. Further, the schedule information stored in the schedule storage unit112is registered (stored) by a system administrator through the registration terminal20, which will be described below. Here, an example of data of the schedule storage unit112will be described with reference toFIG. 3.

FIG. 3is a view illustrating an example of the data of the schedule storage unit112according to the present embodiment.

As illustrated inFIG. 3, the schedule storage unit112, for example, stores a “reservation NO.,” “terminal information.” an “authentication key.” “use period information,” “first user information,” and “second user information” in association with one another. Here, the “reservation NO.” indicates a reservation number for using the information processing terminal30, and the “terminal information” indicates identification information of the information processing terminal30that is scheduled to be used. Also, the “authentication key” indicates an authentication key for logging into the information processing terminal30. The “use period information” indicates a use period in which use of the information processing terminal30is scheduled and includes, for example, a “start date and time” and an “end date and time.” Further, the “start date and time” indicates a date and time at which a start of the use of the information processing terminal30is scheduled, and the “end date and time” indicates a date and time at which an end of the use of the information processing terminal30is scheduled.

The “first user information” and the “second user information” indicate information of users who are scheduled to use the information processing terminal30. The “first user information” and the “second user information” each contain a “user ID,” a “username,” and “face identification information.” Further, the “user ID,” the “username.” and the “face identification information” are the same as the information stored in the face authentication storage unit111.

In the example illustrated inFIG. 3, it is shown that schedule information whose “reservation NO.” is “001” has “T0001” as “terminal information,” “YYY . . . Y” as an “authentication key,” “2014-10-27 10:00:00” as a “start date and time,” and “2014-10-27 10:30:00” as an “end date and time.” It is shown that, for this schedule information, a “user ID” and a “username” of “first user information” are “0001” and “OO Taro,” and feature data of a face of “OO Taro” is stored as “face identification information.” Also, it is shown that a “user ID” and a “username” of “second user information” are “0002” and “OX Ichiro,” and feature data of a face of “OX Ichiro” is stored as “face identification information.”

In this way, the schedule storage unit112stores schedule information and authentication key information (an “authentication key”) for authenticating use of the information processing terminal30in association with each other.

Further, in the example illustrated inFIG. 3, information of three or more users may also be registered as the users although an example in which information of two users is registered is described.

Referring again toFIG. 1, the server control unit12is a processor that includes, for example, a central processing unit (CPU) or the like and collectively controls the face authentication server10. The server control unit12includes, for example, a registration processing unit121.

The registration processing unit121registers information on face authentication of users in the face authentication storage unit111and schedule information in the schedule storage unit112. The registration processing unit121, for example, adds information on face authentication of a new user to the face authentication storage unit111or deletes information on face authentication of a registered user by a request from the registration terminal20that will be described below.

The registration processing unit121, for example, registers schedule information in the schedule storage unit112by a request from the registration terminal20, which will be described below. That is, the registration processing unit121prepares, for example, schedule information based on at least two or more pieces of designated face identification information from pieces of face identification information stored in the face authentication storage unit111and stores the prepared schedule information in the schedule storage unit112.

Specifically, the registration processing unit121acquires a “user ID,” a “username,” and “face identification information” corresponding to two or more users designated by the registration terminal20from the face authentication storage unit111. The registration processing unit121prepares schedule information based on two or more sets of information associated with the acquired “user ID,” “username,” and “face identification information” and designated “terminal information” and a designated “authentication key” and “use period information.” The registration processing unit121stores the prepared schedule information in the schedule storage unit112.

The registration processing unit121, for example, modifies or deletes registered schedule information by a request from the registration terminal20, which will be described below.

The registration terminal20is a terminal device used by a system administrator. The registration terminal20transmits, for example, a request for information on face authentication of users input by the system administrator to be registered in the face authentication storage unit111based on a pre-application of users of the information processing terminal30to the face authentication server10via the network NT. Also, the registration terminal20transmits, for example, a request for schedule information to be registered in the schedule storage unit112based on information input by the system administrator using an application from the user of the information processing terminal30to the face authentication server10via the network NT.

The information processing terminal30(an example of an information processing device) is a terminal device for users to perform various information processing tasks (a task of investigation, interpretation, and the like of various systems), and the information processing terminal30performs, for example, authentication based on an authentication key stored in a universal serial bus (USB) memory by being connected to the USB memory (for example, a dongle) to permit a connection to and start of utilizing (logging into) the information processing terminal30when the authentication result is “OK” (authorized). Also, the information processing terminal30permits the use of the information processing terminal30when users in facial images included in a captured image captured by an imaging unit33, which will be described below, match two or more users pre-registered in the schedule storage unit112of the above-described face authentication server10and a period is within a use period pre-registered in the schedule storage unit112.

The information processing terminal30includes an input unit31, a display unit32, the imaging unit33, a storage unit34, and a control unit35.

The input unit31is, for example, an input device such as a keyboard or a mouse. The input unit31accepts various operations and information input by the users of the information processing terminal30and outputs the various operations and information input to the control unit35.

The display unit32is, for example, a display device such as a liquid crystal display. The display unit32displays, for example, various pieces of information output from the control unit35. The display unit32displays, for example, various pieces of information input through input of users or a captured image captured by the imaging unit33, which will be described below.

The imaging unit33is, for example, a camera, captures an image of users using the information processing terminal30, and outputs the captured image to the control unit35.

The storage unit34stores information utilized in various processes of the information processing terminal30. The storage unit34stores, for example, information such as the captured image captured by the imaging unit33.

The control unit35is a processor including a CPU or the like and collectively controls the information processing terminal30. The control unit35includes, for example, a user determination unit351and a use control unit352.

The user determination unit351determines whether all of at least two or more pre-registered users appear in the captured image on the basis of the captured image captured by the imaging unit33and the schedule information pre-registered in the schedule storage unit112. The user determination unit351determines, for example, whether all users whose registered date and time of use of the information processing terminal30is within a period indicated by the period information match the users included in the captured image. That is, the user determination unit351acquires, for example, schedule information in association with the authentication key information acquired at a login time from the schedule storage unit112. Further, the user determination unit351may store the acquired schedule information in the storage unit34. The user determination unit351determines whether all users corresponding to a set of face identification information stored in association with the period indicated by the period information match the users included in the captured image on the basis of the acquired schedule information and captured image.

In the description below, a “state in which all users corresponding to a set of face identification information match users included in the captured image” will be described by being referred to as a “state in which users are approved.”

Here, the user determination unit351extracts feature data of a face of each of the users based on facial images of users included in the captured image. That is, the user determination unit351extracts, for example, feature data of a face of each of two users when facial images of two people appear in the captured image. The user determination unit351compares the extracted feature data of each of the users with feature data of faces of users (pre-registered users) included in the acquired schedule information.

The user determination unit351determines that the users included in the captured image match the registered users when feature data of faces extracted from the captured image match feature data of faces of the registered users within a predetermined ratio. In this way, the user determination unit351determines whether the users included in the captured image match the registered users on the basis of predetermined feature data of facial images. Then, the user determination unit351determines that the above-described state in which users are approved is reached when all of the users included in the acquired schedule information are included in the captured image.

Further, for example, when all of the users included in the schedule information are included in the captured image, the user determination unit351determines that the above-described state in which users are approved is reached even when facial images of different people are included in the captured image.

In any one of cases (1) and (2) below or in both of the cases, the user determination unit351determines that the above-described state in which users are approved is not reached.

(1) when a date and time of use of the information processing terminal30is not within a range of use period information included in the schedule information

(2) when at least one of the registered users included in the schedule information does not match any user included in the captured image

The user determination unit351regularly executes the above-described determination processing after the information processing terminal30is logged in. That is, the user determination unit351regularly acquires a captured image from the imaging unit33. The user determination unit351regularly determines, for example, whether the above-described state in which users are approved is reached on the basis of the acquired captured image and the schedule information stored in the storage unit34.

The use control unit352controls whether to permit use of the information processing terminal30on the basis of a determination result determined by the user determination unit351. The use control unit352permits, for example, the use of the information processing terminal30when the user determination unit351determines that the above-described state in which users are approved is reached. That is, the use control unit352permits the use of the information processing terminal30when all of at least two or more pre-registered users appear in the captured image. In this case, for example, the use control unit352permits the use of the information processing terminal30and displays a display image including the captured image on the display unit32of the information processing terminal30.

For example, when it is determined by the user determination unit351that the above-described state in which users are approved is not reached, the use control unit352prohibits the use of the information processing terminal30. Here, to “prohibit the use of the information processing terminal30” indicates, for example, locking a display screen of the display unit32or logging out a user. The use control unit352, for example, logs out a user right after logging in and locks the display screen of the display unit32at times other than right after logging in.

Next, an operation of the monitoring system1according to the present embodiment will be described with reference to the drawings.

First, a usage example of the information processing terminal30of the monitoring system1will be described with reference toFIG. 4.

FIG. 4is a view illustrating the usage example of the information processing terminal30according to the present embodiment.

In the example illustrated inFIG. 4, an example in which two users U1and U2use the information processing terminal30is illustrated. Here, one of the users U1and U2is a worker and the other user is a monitoring person who monitors the worker. It is assumed that the two users U1and U2perform an information processing task using the information processing terminal30as a group.

In this example, a state in which the users U1and U2match users pre-registered in the schedule storage unit112is illustrated. The imaging unit33captures a captured image including facial images of the users U1and U2who are about to perform a task using the information processing terminal30. The user determination unit351acquires the captured image and acquires schedule information in association with authentication key information acquired at a login time from the schedule storage unit112. The user determination unit351determines whether the above-described state in which users are approved is reached on the basis of the acquired schedule information and captured image. Here, because the state in which users are approved is reached, the use control unit352permits the use of the information processing terminal30, permits a display of the information processing task to be displayed on the display unit32, and displays the captured image captured by the imaging unit33as a sub-image SG1on the display unit32. In this state, the users U1and U2execute various information processing tasks by operating the input unit31or the like.

FIG. 5is a view illustrating a display example of the information processing terminal30according to the present embodiment.

In the example illustrated in the drawing, a display example of a case in which the use of the information processing terminal30is permitted in the state illustrated inFIG. 4is illustrated. In this case, as illustrated in the drawing, the sub-image SG1of the captured image and a work image SG2that is currently being worked on are displayed on a display screen G1.

Further, the use control unit352displays the captured image in which the users U1and U2appear on the display unit32as the sub-image SG1and displays usernames (for example, “OO Taro” and the like) of the users U1and U2recognized from facial images.

In the state illustrated inFIGS. 4 and 5, for example, when at least one of the users U1and U2leaves his/her seat, the user determination unit351determines that the above-described state in which users are approved is not reached. Due to this, the use control unit352prohibits the use of the information processing terminal30and locks the display screen G1.

Next, an example of an operation of the monitoring system1according to the present embodiment will be described with reference toFIG. 6.

FIG. 6is a flowchart illustrating an example of an operation of the monitoring system1according to the present embodiment.

In the drawing, first, the information processing terminal30performs authentication using an authentication key (Step S101). That is, for example, a USB memory in which the authentication key (authentication key information) is stored is connected to the information processing terminal30by a user, and the control unit35performs authentication using the authentication key acquired from the USB memory.

Next, the control unit35determines whether the authentication by the authentication key is “OK” (Step S102). When the authentication is “OK” (Step S102: YES), the control unit35advances the process to Step S103. When the authentication is not “OK” (Step S102: NO), the control unit35returns the process to Step S101.

In Step S103, the user determination unit351of the control unit35acquires a captured image. That is, the user determination unit351operates the imaging unit33and acquires the captured image captured by the imaging unit33. The user determination unit351stores, for example, the acquired captured image in the storage unit34.

The user determination unit351acquires schedule information corresponding to the authentication key (Step S104). That is, the user determination unit351acquires the schedule information corresponding to the above-described authentication key from the schedule storage unit112of the face authentication server10via the network NT. The user determination unit351stores, for example, the acquired schedule information in the storage unit34. Further, at least two or more users are registered in the schedule information.

Next, the user determination unit351determines whether a current date and time are within a use period in the acquired schedule information (Step S105). When the current date and time are within the use period in the acquired schedule information (Step S105: YES), the user determination unit351advances the process to Step S106. When the current date and time are not within the use period in the acquired schedule information (Step S105: NO), the user determination unit351advances the process to Step S107.

In Step S106, the user determination unit351determines whether all of the users registered in the schedule information match users included in the captured image (whether the above-described state in which users are approved is reached). That is, based on facial images of the users included in the captured image stored in the storage unit34, the user determination unit351extracts feature data of a face of each of the users. The user determination unit351compares the extracted feature data of the face of each of the users with the feature data (face identification information) of faces of the users (pre-registered users) included in the acquired schedule information. The user determination unit351determines that the users included in the captured image match the registered users when the feature data of the faces extracted from the captured image match the feature data of the faces of the registered users by a predetermined ratio. Then, the user determination unit351determines that all of the users registered in the above-described schedule information match the users included in the captured image when all of the users included in the acquired schedule information are included in the captured image.

The user determination unit351advances the process to Step S108when it is determined that all of the users registered in the schedule information match the users included in the captured image (S106: YES). The user determination unit351advances the process to Step S107when it is determined that not all of the users registered in the schedule information match the users included in the captured image (Step S106: NO).

In Step S107, the use control unit352locks the display screen and prohibits the use. That is, the use control unit352locks the display screen of the display unit32of the information processing terminal30to prohibit the use of the information processing terminal30. After Step S107, the use control unit352returns the process to Step S103.

In Step S108, the use control unit352displays the captured image as a sub-image. That is, for example, as illustrated inFIG. 5, the use control unit352displays the captured image stored in the storage unit34as the sub-image on the display unit32.

Next, the use control unit352unlocks the display screen and allows the use (Step S109). That is, the use control unit352displays a normal display on the display screen of the display unit32of the information processing terminal30and permits the use of the information processing terminal30. In this way, two or more users may perform various information processes by using the information processing terminal30.

Next, the use control unit352determines whether a predetermined amount of time has elapsed (Step S110). That is, the use control unit352uses a timer or the like (not illustrated) to determine whether the predetermined amount of time has elapsed. When the predetermined amount of time has elapsed (Step S110: YES), the use control unit352returns the process to Step S103and repeats the process from Step S103to Step S110. When the predetermined amount of time has not elapsed (Step S110: NO), the use control unit352repeats the process of Step S110until the predetermined amount of time elapses.

Next, an operation of a modified example of the monitoring system1of the present embodiment will be described with reference toFIG. 7.

FIG. 7is a flowchart illustrating the operation of the modified example of the monitoring system1according to the embodiment.

In the modified example, after use of the information processing terminal30is permitted, the use control unit352prohibits the use of the information processing terminal30when it is determined that the above-described state in which users are approved is not reached a predetermined number of times or more in a row by the user determination unit351.

Because a process from Step S201to Step S209illustrated inFIG. 7is the same as the process from Step S101to Step S109illustrated inFIG. 6, a description thereof will be omitted here.

In Step S210, the use control unit352initializes a variable N (N=0).

Next, the use control unit352determines whether a predetermined amount of time has elapsed (Step S211). That is, the use control unit352uses a timer or the like (not illustrated) to determine whether the predetermined amount of time has elapsed. When the predetermined amount of time has elapsed (Step S211: YES), the use control unit352advances the process to Step S212. When the predetermined amount of time has not elapsed (Step S211: NO), the use control unit352repeats the process of Step S211until the predetermined amount of time elapses.

In Step S212, the user determination unit351acquires a captured image. That is, the user determination unit351operates the imaging unit33to acquire a captured image captured by the imaging unit33. The user determination unit351stores, for example, the acquired captured image in the storage unit34.

Next, the user determination unit351determines whether a current date and time are within a use period in the acquired schedule information (Step S213). When the current date and time are within the use period in the acquired schedule information (Step S213: YES), the user determination unit351advances the process to Step S214. When the current date and time are not within the use period in the acquired schedule information (Step S213: NO), the user determination unit351advances the process to Step S207.

In Step S214, the user determination unit351determines whether all of the users registered in the schedule information match users included in the captured image (whether the above-described state in which users are approved is reached). The determination processing by the user determination unit351is the same as the process of Step S206(process of Step S106illustrated inFIG. 6). The user determination unit351advances the process to Step S208when it is determined that all of the users registered in the schedule information match the users included in the captured image (Step S214: YES). The user determination unit351advances the process to Step S215when it is determined that not all of the users registered in the schedule information match the users included in the captured image (Step S214: NO).

In Step S215, the use control unit352adds “1” to the variable N (N=N+1).

Next, the use control unit352determines whether a value of the variable N has reached a predetermined threshold value or larger (N≥predetermined threshold value) (Step S216). When the value of the variable N has reached the predetermined threshold value or larger (Step S216: YES), the use control unit352advances the process to Step S207and locks the display screen. When the value of the variable N is less than the predetermined threshold value (N<predetermined threshold value) (Step S216: NO), the use control unit352returns the process to Step S211.

In this way, in the present modified example, after the use of the information processing terminal30is permitted, the use control unit352prohibits the use of the information processing terminal30when it is determined that the state in which users are approved is not reached a predetermined number of times or more in a row by the user determination unit351.

As described above, the monitoring system1according to the present embodiment includes the schedule storage unit112, the imaging unit33, the user determination unit351, and the use control unit352. The schedule storage unit112stores schedule information in association with a set of face identification information (for example, feature data of faces) for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use the information processing terminal30(the information processing device). The imaging unit33captures an image of the users using the information processing terminal30. The user determination unit351determines whether all users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the period indicated by the period information match users included in the captured image on the basis of the captured image captured by the imaging unit33and the schedule information stored in the schedule storage unit112. The use control unit352controls whether to permit the use of the information processing terminal30on the basis of a determination result determined by the user determination unit351. For example, the use control unit352permits the use of the information processing terminal30when it is determined that all of the users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the period match the users included in the captured image.

In this way, for example, because the information processing terminal30can be used when all of two or more users pre-stored (pre-registered) in the schedule storage unit112as schedule information are included in a captured image, the monitoring system1according to the present embodiment can inhibit an unauthorized operation by a worker (a user). That is, in the monitoring system1according to the present embodiment, instead of an unauthorized operation being prevented simply by workers monitoring each other, a task needs to be performed so that an image of two or more users pre-registered as schedule information is captured by the imaging unit33. When, for example, not all of the two or more users pre-stored (pre-registered) in the schedule storage unit112as the schedule information are included in the captured image, the monitoring system1according to the present embodiment may prevent the use of the information processing terminal30. Due to this, because rules for performing a task while checking with a plurality of people can be made strict, the monitoring system1according to the present embodiment may inhibit an unauthorized operation by a worker (a user). The monitoring system1according to the present embodiment can reduce the possibility that an unauthorized operation will be performed and not get caught by another worker.

In the present embodiment, when it is determined by the user determination unit351that all users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the above-described period match the users included in the captured image, the use control unit352permits the use of the information processing terminal30and displays a display image including the captured image on the display unit32of the information processing terminal30. The use control unit352prohibits the use of the information processing terminal30when it is determined by the user determination unit351that the above-described matching state is not reached.

In this way, when not all of the two or more users pre-stored (pre-registered) in the schedule storage unit112as the schedule information are included in the captured image, the monitoring system1according to the present embodiment may physically prohibit the use of the information processing terminal30. Also, by displaying a display image including the captured image on the display unit32of the information processing terminal30, the monitoring system1according to the present embodiment can cause an operator to be aware that he or she is being monitored. Therefore, the monitoring system1according to the present embodiment can further reduce the possibility that an unauthorized operation is performed.

In the present embodiment, the schedule storage unit112stores schedule information and authentication key information (for example, an authentication key) for authenticating the use of the information processing terminal30in association with each other. The user determination unit351acquires the schedule information associated with the authentication key information acquired by the information processing terminal30from the schedule storage unit112. The user determination unit351determines whether or not all of the users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the above-described period match the users included in the captured image on the basis of the acquired schedule information and captured image.

In this way, because the registered schedule information can be searched for on the basis of the authentication key information, the monitoring system1according to the present embodiment can promptly select target schedule information. Also, by associating the authentication key information and the schedule information with each other, the monitoring system1according to the present embodiment can reduce unauthorized use of the information processing terminal30. For example, by authentication key information corresponding to a user being distributed (for example, a USB memory containing the authentication key information being distributed) when registering the schedule information to the schedule storage unit112, the monitoring system1according to the present embodiment can reduce the possibility that the information processing terminal30will be used in an unauthorized manner.

Also, in the present embodiment, the user determination unit351regularly determines whether all of the users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the above-described period match the users included in the captured image. After the use of the information processing terminal30is permitted, the use control unit352may prohibit the use of the information processing terminal30when it is determined that the users do not match a predetermined number of times or more in a row by the user determination unit351.

In this way, for example, when at least one of a plurality of pre-registered users leaves his/her seat for a predetermined period or longer (the predetermined number of times or more) and does not appear in the captured image, the monitoring system1according to the present embodiment can forcibly prohibit the use of the information processing terminal30. The monitoring system1according to the present embodiment does not prohibit the use of the information processing terminal30when the period (the number of times) in which at least one user leaves his/her seat is less than the predetermined period (the predetermined number of times). Due to this, for example, when a case in which a facial image cannot be properly recognized due to a worker facing sideward, downward, or the like for an instant occurs in a short amount of time, the monitoring system1according to the present embodiment does not unnecessarily prohibit the use of the information processing terminal30and thus does not lower operation efficiency thereof.

Also, the monitoring system1according to the present embodiment includes the face authentication storage unit111and the registration processing unit121. The face authentication storage unit111pre-stores user identification information (for example, a user ID and the like) for identifying users and face identification information (for example, feature data of faces) of the users in association of each other. The registration processing unit121prepares schedule information based on at least two or more designated pieces of face identification information among pieces of face identification information stored in the face authentication storage unit111. The registration processing unit121stores (registers) the prepared schedule information in the schedule storage unit112.

In this way, the monitoring system1according to the present embodiment does not have to prepare face identification information of users every time schedule information is registered because the face identification information of the users is pre-stored in the face authentication storage unit111. Due to this, the monitoring system1according to the present embodiment can perform preparation of the schedule information by a simple means of acquiring target face identification information from the face authentication storage unit111. That is, the monitoring system1according to the present embodiment can execute registration of the schedule information by a simple means.

A monitoring method according to the present embodiment is a monitoring method of the monitoring system1that includes the schedule storage unit112configured to store schedule information in association with a set of face identification information for identifying facial images of at least two or more users and period information indicating a period in which the two or more users use the information processing terminal30. The monitoring method according to the present embodiment includes an imaging step, a user determining step, and a use controlling step. In the imaging step, the imaging unit33captures an image of users using the information processing terminal30. In the user determining step, the user determination unit351determines whether all users corresponding to the set of face identification information whose date and time of use of the information processing terminal30are within the period indicated by the period information match the users included in the captured image on the basis of the captured image captured in the imaging step and the schedule information stored in the schedule storage unit112. In the use controlling step, the use control unit352controls whether to permit use of the information processing terminal30on the basis of a determination result determined by the user determination unit351.

In this way, like the above-described monitoring system1, the monitoring method according to the present embodiment can inhibit an unauthorized operation by a worker (a user).

Second Embodiment

Next, a monitoring system1aaccording to a second embodiment will be described with reference toFIG. 8.

FIG. 8is a block diagram illustrating an example of the monitoring system1aaccording to the second embodiment.

As illustrated in the drawing, the monitoring system1aincludes a face authentication server10, a registration terminal20, an information processing terminal30a, a video recording server40, and a video record checking terminal50. Further, the face authentication server10, the registration terminal20, the information processing terminal30a, the video recording server40, and the video record checking terminal50are connected to one another via a network NT.

In the drawing, like reference numerals will be assigned to the same elements as those inFIG. 1, and descriptions thereof will be omitted.

The present embodiment is different from the first embodiment in that the information processing terminal30aincludes a registration update unit353and in that the monitoring system1aincludes the video recording server40and the video record checking terminal50. Hereinafter, these differences will be described in detail below.

The information processing terminal30aincludes an input unit31, a display unit32, an imaging unit33, a storage unit34, and a control unit35a. The control unit35ais a processor that includes a CPU or the like and collectively controls the information processing terminal30a. The control unit35aincludes, for example, a user determination unit351, a use control unit352, and the registration update unit353.

After the use control unit352permits use of the information processing terminal30a, the registration update unit353newly generates face identification information (for example, feature data of a face) corresponding to each user included in schedule information used by the user determination unit351on the basis of a captured image captured by the imaging unit33. The registration update unit353updates the face identification information corresponding to each target user stored in the face authentication storage unit111of the face authentication server10to the newly generated face identification information. That is, the registration update unit353updates the face identification information stored in the face authentication storage unit111of the face authentication server10to face identification information extracted from the latest facial image captured by the imaging unit33. Further, the registration update unit353may allow a process of updating the face identification information stored in the face authentication storage unit111to be performed every time a user performs a task using the information processing terminal30aor regularly such as weekly and monthly.

The video recording server40is a server device configured to collect and record image data (for example, screen shot data) of a display screen displayed on the display unit32of the information processing terminal30aat predetermined intervals. The video recording server40includes, for example, a server storage unit41and a server control unit42. Further, a user's face, name, command line on which work is done, and the like may be recorded in the image data of the display screen.

The server storage unit41stores information utilized in various processes of the video recording server40. The server storage unit41stores, for example, the above-described image data of the display screen. The server storage unit41includes, for example, a video recording information storage unit411.

The video recording information storage unit411stores, for example, a display image (for example, screen shot data) including a captured image and display date and time information indicating a date and time at which the display image is displayed in association with each other. Here, the display image including the captured image is, for example, image data such as the display screen G1illustrated inFIG. 5. Further, the video recording information storage unit411may store, for example, the display image including the captured image, the display date and time information, and identification information (for example, terminal information) of the information processing terminal30ain association with one another.

The information (video recording information) stored in the video recording information storage unit411may be read later by the video record checking terminal50, which will be described below, and is used to check a user who used the information processing terminal30aand content of a task performed by the user.

The server control unit42is, for example, a processor including a CPU or the like and collectively controls the video recording server40. The server control unit42includes, for example, a video recording processing unit421.

The video recording processing unit421stores at least the above-described display image and the display date and time information in association with each other in the video recording information storage unit411at predetermined intervals. The server control unit42acquires, for example, the terminal information of the information processing terminal30a, the display image including the captured image, and the display date and time information from the information processing terminal30avia the network NT at predetermined intervals. The video recording processing unit421sequentially adds to and stores the acquired terminal information, display image including the captured image, and display date and time information in association with one another in the video recording information storage unit411.

The video record checking terminal50is a terminal device used by a system administrator and is used to check information stored in the video recording information storage unit411of the video recording server40. The video record checking terminal50transmits, for example, a request for information stored in the video recording information storage unit411of the video recording server40to be read to the video recording server40via the network NT. The video record checking terminal50acquires the information stored in the video recording information storage unit411via the network NT and displays the acquired information on a display unit (not illustrated).

Because other constitutions and basic operations of the monitoring system1aaccording to the present embodiment are the same as in the above-described monitoring system1according to the first embodiment, descriptions thereof will be omitted here.

As described above, the monitoring system1aaccording to the present embodiment includes the video recording information storage unit411and the video recording processing unit421. The video recording information storage unit411stores the display image including the captured image and the display date and time information indicating the date and time at which the display image is displayed in association with each other. The video recording processing unit421stores the display image and the display date and time information in association with each other in the video recording information storage unit411at predetermined intervals.

In this way, because a user who used the information processing terminal30a, a use date and time, content of a task, and the like can be checked later, when a problem such as any unauthorized operation is performed occurs, the monitoring system1aaccording to the present embodiment can easily confirm a cause (a user, content of a task, etc.). By making the fact that video recording information is being recorded in the video recording information storage unit411known, the monitoring system1aaccording to the present embodiment exhibits an effect of inhibiting an unauthorized operation by a worker.

The monitoring system1aaccording to the present embodiment includes the registration update unit353. After the use control unit352permits use of the information processing terminal30a, the registration update unit353newly generates face identification information corresponding to each of the users included in the schedule information used by the user determination unit351on the basis of the captured image captured by the imaging unit33. The registration update unit353updates the face identification information corresponding to each of the users stored in the face authentication storage unit111to the newly generated face identification information.

In this way, the monitoring system1aaccording to the present embodiment can reduce erroneous determination of user face authentication because the registered face identification information can be regularly updated. The monitoring system1aaccording to the present embodiment can reduce the possibility that a user will be erroneously determined due to, for example, the user getting a tan or changing his/her hairstyle.

Further, the present invention is not limited to each of the embodiments described above and can be modified within a scope that does not depart from the gist of the present invention.

For example, in each of the embodiments described above, although an example in which the information processing terminal30(or30a) includes the user determination unit351and the use control unit352has been described, another device (for example, the face authentication server10or the like) may include the user determination unit351and the use control unit352.

Also, some of the elements included in the face authentication server10and the video recording server40may be included in other devices.

Although an example in which the information processing terminal30aincludes the registration processing unit121has been described, another device may include the registration processing unit121.

The registration terminal20may include, for example, a function of the video record checking terminal50.

In each of the embodiments described above, although an example in which, when all of users included in schedule information are included in a captured image, the user determination unit351determines that the above-described state in which users are approved is reached even when facial images of different people are included in the captured image has been described, embodiments are not limited thereto. For example, when facial images of different people are included in the captured image, as in the example described above, the user determination unit351may determine that the state in which users are approved is not reached.

When a device other than the information processing terminal30(or30a) corresponding to terminal information registered as schedule information is used, the user determination unit351may determine that the state in which users are approved is not reached. In this way, the monitoring system1(or1a) may further inhibit an unauthorized operation by a worker (a user).

In each of the embodiments described above, although an example in which the information processing terminal30(or30a) acquires authentication key information via a USB memory has been described, the information processing terminal30(or30a) may acquire the authentication key information via, for example, the input unit31or the like.

Also, although an example in which the information processing terminal30(or30a) performs authentication using the authentication key information has been described, the information processing terminal30(or30a) may not perform authentication using the authentication key information and, for example, may allow determination processing by the user determination unit351due to a start key of the input unit31being pressed.

Further, each of the elements included in the above-described monitoring system1(or1a) has a computer system therein. Additionally, a program for realizing functions of each of the elements included in the above-described monitoring system1(or1a) may be recorded in a computer readable recording medium, and the program recorded in the recording medium may be read by a computer system and executed to perform processing in each of the elements included in the above-described monitoring system1(or1a). Here, “to cause a computer system to read and execute a program recorded in a recording medium” includes installing the program in a computer system. The “computer system” referred to here includes hardware such as an operating system (OS) and a peripheral device.

Also, the “computer system” may include a plurality of computer devices connected via a network including the Internet or a communication line such as a wide area network (WAN), a local area network (LAN), or a dedicated line. The “computer readable recording medium” refers to a storage device such as a hard disk embedded in a computer system and a portable medium including a flexible disk, a magneto-optical disk, a read-only memory (ROM), and a compact disc (CD)-ROM. In this way, the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM.

The recording medium also includes a recording medium provided inside or outside and accessible by a distribution server for distributing the program. Further, a constitution in which the program is divided into a plurality of parts, downloaded at different times, and then combined in each of the constitutions included in the monitoring system1(or1a) is possible, and distribution servers configured to distribute the divided parts of the program may be different. Furthermore, the “computer readable recording medium,” such as a volatile memory (a random access memory (RAM)) inside a computer system serving as a server or a client when the program is transmitted via a network, holds the program for a certain amount of time. The program may be for realizing some of the above-described functions. Furthermore, the program may be a so-called differential file (a differential program) that can realized the above-described functions through a combination with a program already recorded in the computer system.

Part or all of the above-described functions may be realized as an integrated circuit such as a large scale integration (LSI). Each of the above-described functions may be individually implemented as a processor, or a part or all thereof may be integrated into a processor. A method of forming an integrated circuit is not limited to an LSI, and may be realized by a dedicated circuit or a universal processor. When an integrated circuit technology replacing an LSI emerges due to an advance in semiconductor technology, an integrated circuit using such technology can be used.

REFERENCE SYMBOLS