Information processing apparatus, mode selection method, and mode selection program

There is provided an information processing apparatus capable of setting a privacy mode intuitively and easily. The information processing apparatus capable of selecting the privacy mode includes: an imaging unit configured to acquire an image; a determination unit configured to acquire an output value related to the brightness of the image acquired by the imaging unit to determine whether the output value related to the brightness of the image meets a predetermined condition; and a mode selection unit configured to select the privacy mode when the determination unit determines that the output value related to the brightness of the image meets the predetermined condition.

FIELD OF THE INVENTION

The present invention relates to an information processing apparatus, a mode selection method, and a mode selection program.

BACKGROUND OF THE INVENTION

Recently, the rate of camera-carrying information processing apparatuses such as laptop personal computers (hereinafter called “laptop PCs”) and the like has been increasing. A camera mounted in an information processing apparatus is used, for example, for chatting using a VoIP application such as Skype (registered trademark), doing video conferencing, and the like, i.e., mainly used to take shots or video of a user of the information processing apparatus. For the above uses, the camera is placed to face the user. Therefore, the camera-carrying information processing apparatus is equipped with a privacy mode function to keep such a state that the user will not be displayed, such as to mask a camera image, from the standpoint of privacy protection or the like (see Patent Document 1).

SUMMARY OF THE INVENTION

However, the user is required to perform burdensome operations in order to set the privacy mode, such as to operate the information processing apparatus to open a property screen of the mounted camera and set the privacy mode from this property screen.

Further, when the occasion to use the camera arises after setting the privacy mode, the user is also required to perform similar burdensome operations in order to release the privacy mode. Thus, the user is required to perform troublesome operations in order to set or release the privacy mode, lacking user-friendliness.

The present invention has been made in view of such circumstances, and it is an object thereof to provide an information processing apparatus, a mode selection method, and a mode selection program, capable of setting a privacy mode intuitively and easily.

In order to solve the above problems, the present invention adopts the following measures.

An information processing apparatus according to a first aspect of the present invention includes: an imaging unit configured to acquire an image; a determination unit configured to acquire an output value related to the brightness of the image acquired by the imaging unit to determine whether the output value related to the brightness of the image meets a predetermined condition; and a mode selection unit configured to select a privacy mode when the determination unit determines that the output value related to the brightness of the image meets the predetermined condition.

A mode selection method according to a second aspect of the present invention includes: an imaging step to acquire an image; a determination step to acquire an output value related to the brightness of the image acquired in the imaging step and determine whether the output value related to the brightness of the image meets a predetermined condition; and a mode selection step to select a privacy mode when it is determined in the determination step that the output value related to the brightness of the image meets the predetermined condition.

A mode selection program according to a third aspect of the present invention causes a computer to execute: an imaging process to acquire an image; a determination process to acquire an output value related to the brightness of the image acquired in the imaging process and determine whether the output value related to the brightness of the image meets a predetermined condition; and a mode selection process to select a privacy mode when it is determined in the determination process that the output value related to the brightness of the image meets the predetermined condition.

The above-described aspects of the present invention have the effect of allowing a user to set the privacy mode intuitively and easily.

DETAILED DESCRIPTION OF THE INVENTION

One embodiment of an information processing apparatus1according to the present invention will be described below with reference to the accompanying drawings. In the embodiment, the description will be made by taking a laptop PC as an example of the information processing apparatus1. However, the information processing apparatus1is not limited to the laptop PC, and it may be a desktop PC, or a portable information processing terminal such as a tablet or a smartphone.

FIG. 1is a schematic external view of the information processing apparatus1according to the embodiment of the present invention.

As an example, the information processing apparatus1includes a main body-side chassis2and a display-side chassis3, both of which have substantially rectangular parallelepiped shapes, as illustrated inFIG. 1.

The main body-side chassis2includes an input unit4. The input unit4is a user interface to allow a user to perform input operations, having a keyboard composed of various keys used to enter characters, commands, and the like, a touch pad used to move a cursor on a screen, select any one of various menus, and the like.

The display-side chassis3includes a display unit5that displays images. In the embodiment, the display unit5is an LCD (Liquid Crystal Display), but the display unit5is not limited to the LCD. The display unit5may be another display unit such as an organic EL (Electroluminescence) display, or a touch panel. The LCD converts input display data to a video signal, and displays, on a display screen, various pieces of information according to the converted video signal.

The display-side chassis3also includes a camera7and a light source8to acquire an image. The camera7is arranged substantially at the center of the display-side chassis3above the display screen side of the LCD to be able to take an image of a front subject. The light source8is arranged substantially at the center of the display-side chassis3above the display screen side of the LCD to emit, to the front subject, auxiliary light involved in shooting with the camera7.

The main body-side chassis2and the display-side chassis3are joined in respective end portions by a pair of right and left joining parts6. The joining parts6are hinges to support the main body-side chassis2and the display-side chassis3openably and closably.

FIG. 2is a block diagram illustrating a schematic hardware configuration of the information processing apparatus1according to the embodiment of the present invention. For example, the information processing apparatus1includes a CPU (Central Processing Unit)21, a main memory22, a storage unit23, a display unit5, an input unit4, a communication unit26, the camera7, and the light source8. These units are connected to one another directly or indirectly through a bus28.

For example, the CPU21controls the entire information processing apparatus1under an OS (Operating System) stored in the storage unit23connected through the bus28, and executes various programs stored in the storage unit23to execute various processes such as a mode selection process to be described later.

The main memory22is composed of a cache memory and a RAM (Random Access Memory), which are writable memories used as working memories to read a program executed by the CPU21and write data processed by the execution program.

The storage unit23is, for example, a ROM (Read Only Memory), an HDD (Hard Disk Drive), a flash memory, and the like to store the OS, such as Windows (registered trademark), iOS (registered trademark), Android (registered trademark), or the like, to control the entire information processing apparatus1, various hardware drivers for operating peripheral devices, applications for use in specific business, various data and files, and the like. Further, in the storage unit23, a program to execute the mode selection process to be described later and various data necessary to execute the mode selection process are stored.

The display unit5is, for example, the LCD to provide a display under the control of the CPU21.

The input unit4includes, for example, a keyboard, a mouse, and the like to be used by a user performing input operations.

The communication unit26is an interface to connect to a network so as to communicate with another information processing apparatus1in order to exchange information.

The camera7is controlled by the CPU21, for example, based on user's input operations and the like. The light source8emits auxiliary light involved in shooting with the camera7under the control of the CPU21.

FIG. 3is a functional block diagram illustrating an example of the functions of the information processing apparatus1. As illustrated inFIG. 3, for example, the information processing apparatus1includes, as main components, an imaging unit31, a determination unit32, an ambient light detecting unit33, an ambient light comparing unit34, and a mode selection unit35. Various processes to be described later, which are implemented by these units, are implemented, for example, by the CPU21of the information processing apparatus1reading a mode selection program stored in the storage unit23into the main memory22and executing the mode selection program. For example, the mode selection program stored in the main memory22or the storage unit23may be a program downloaded from a predetermined server or installed and stored from a predetermined recording medium, or a program stored in the storage unit23at the time of manufacturing. The various processes for mode selection in the information processing apparatus1to be described later are implemented by the functions of the mode selection program.

In the embodiment, a case where the camera7is covered with a user's finger as an example will be described, but the camera7may be covered with a user's palm, or the like. In the embodiment, a user's action to cover the camera7with the finger does not include an action to cover the camera7with the finger for a long time. In other words, the user's action to cover the camera7with the finger means such shielding that the user touches the camera7, for example, with the finger for a short time. When the camera7is an optical type camera, the state of covering the camera7is a state of blocking light to a sensor such as an image sensor that detects information based on the light inside the camera7. Specifically, in the embodiment, the light is blocked by covering a lens of the camera7with the finger. However, the user's action is not limited to the action to cover the lens as long as the light to the sensor is blocked. For example, when there is a shielding object such as a shutter between the lens and the image sensor, the light to the sensor may be blocked by the shielding object.

The imaging unit31includes, for example, the camera7to capture an image and acquire image data to be processed. The camera7is arranged above the display surface on the display-side chassis3to shoot the user of the information processing apparatus1. The imaging unit31also includes the light source8that emits auxiliary light upon shooting with the camera7. An example of including the light source8is described, but the light source8can be omitted.

The camera7may be a camera for capturing an image obtained in the normal visual light range or an IR camera. When the camera7is an IR camera, an IR LED is used as the light source8. Further, a 3D camera or the like may be used as the camera7.

The determination unit32acquires an output value related to the brightness of the image acquired by the imaging unit31, and determines whether the output value related to the brightness of the image meets a predetermined condition. For example, the output value related to the brightness of the image acquired by the imaging unit31is acquired to compare the output value related to the brightness of the image with a predetermined threshold value. For example, the output value related to the brightness of the image is compared with a preset threshold value to determine whether the camera7is covered with the user's finger or the like. The output value related to the brightness of the image illustratively means information indicative of the luminance or exposure of the acquired image, a frame rate set along with the brightness of the acquired image, a correction value used for automatic exposure compensation, a gain value of the image sensor, or the like. In the embodiment, the description is made by exemplifying a case where the frame rate set along with the brightness of the acquired image is adopted as the output value related to the brightness of the image. The frame rate of the information processing apparatus1varies along with the brightness of the image acquired by the imaging unit31such as 30 fps when the image is bright and 10 fps when the image is dark. Note that the above-mentioned frame rate is just an example, and the present invention is not limited thereto. Further, when the frame rate or the like is set by the imaging unit31not to vary according to the brightness of the acquired image, mode switching may not be performed.

The threshold value is set in the range between an output value related to the brightness of an image acquired from the imaging unit31before the camera7is covered and an output value related to the brightness of an image acquired from the imaging unit31after the camera7is covered so that respective output values can be discriminated from each other. In the embodiment, since the output value related to the brightness of each image is illustratively described as the frame rate, the threshold value is also described as the frame rate. Specifically, when the frame rate of the information processing apparatus1varies between 30 fps when the image is bright and 10 fps when the image is dark, a value capable of detecting that the camera7is covered with the finger can be set as the threshold value appropriately in the range from 30 fps to 10 fps.

The ambient light detecting unit33detects an ambient brightness of the information processing apparatus1. Specifically, the ambient light detecting unit33is a sensor provided in the information processing apparatus1in a position different from the imaging unit31. In the embodiment, the sensor is described as an ambient light sensor (hereinafter abbreviated as “ALS”). The ambient light detecting unit33detects, for example, an ambient illuminance to detect the ambient brightness of the information processing apparatus1. The ambient light detecting unit33is not limited to the ALS as long as it is a sensor capable of detecting the ambient brightness.

The ambient light comparing unit34compares an output value related to the ambient brightness detected by the ambient light detecting unit33with a predetermined ambient threshold value. Specifically, the ambient light comparing unit34compares the output value related to the detected ambient brightness with an ambient threshold value for preset ambient brightness to determine whether the brightness around the information processing apparatus1is high. As will be described later, both determination results of the determination unit32and the ambient light comparing unit34can be referred to determine such a state that an image acquired by the imaging unit31is dark despite the fact that the brightness around the information processing apparatus1is high. Thus, it can be determined accurately that the camera7of the information processing apparatus1is covered by the user on purpose. In the embodiment, since the ambient light detecting unit33is the ALS to detect the illuminance, an illuminance capable of determining whether the brightness around the information processing apparatus1is high is set appropriately as the ambient threshold value.

As illustrated inFIG. 4, the mode selection unit35selects either of an imaging mode to perform normal imaging (see the left side ofFIG. 4), and a privacy mode (see the right side ofFIG. 4) to put a restriction on the acquisition of an image in the imaging unit31, the acquisition environment, or the output of the acquired image. In the privacy mode, for example, the imaging unit31is restricted not to acquire any image, the light source8included in the imaging unit31is turned off to restrict the auxiliary light not to output light upon image acquisition with the camera7, the imaging unit31is restricted not to output image data to the outside even when imaging is performed, or image output is so restricted that an image to mask the captured image will be output to the outside instead of the captured image. In order to select a mode, both comparison results of the determination unit32and ambient light comparing unit34are input to the mode selection unit35. As mode selection conditions, when the determination unit32determines that the frame rate of the image is less than the predetermined threshold value, and the ambient light comparing unit34determines that the ambient illuminance is more than the predetermined ambient threshold value, the mode selection unit35determines that the camera7is covered by the user on purpose and hence selects the privacy mode. Otherwise, the mode selection unit35determines that the camera7is not covered or the brightness around the information processing apparatus1becomes totally dark, and hence selects and sets the imaging mode.

In the state where the privacy mode is selected, the privacy mode may be released when the predetermined conditions on which the privacy mode is selected are met again, or when any other predetermined condition is met. Specifically, in the state where the privacy mode is selected, when the same conditions as the conditions on which the privacy mode was selected are met, that is, when the determination unit32determines that the frame rate of the image is less than the predetermined threshold value, and the ambient light comparing unit34determines that the ambient illuminance is more than the predetermined ambient threshold value, the mode selection unit35determines that the camera7is covered by the user on purpose again. In this case, the mode selection unit35may select the imaging mode, that is, release the privacy mode. Further, in the state where the privacy mode is selected, when a condition different from the conditions on which the privacy mode was selected is met, such as that the information processing apparatus1is powered off, the privacy mode may be released.

Next, a mode selection method executed by the information processing apparatus1according to the embodiment will be described.FIG. 5is a flowchart illustrating a procedure of the mode selection method performed by the information processing apparatus1according to the embodiment. The processing flow illustrated inFIG. 5is started, for example, when a VoIP application such as Skype (registered trademark) is started, and then repeated in predetermined periods. Note that the operation of the information processing apparatus1according to the embodiment may be carried out continuously and repeatedly in the background when the information processing apparatus1is started regardless of the start of a specific application.

When the information processing apparatus1is started, the determination unit32acquires a frame rate D1of an image acquired by the imaging unit31(S100), and compares the frame rate D1of the acquired image with a preset threshold value TH1(S101).

When it is determined that the frame rate D1of the image acquired by the imaging unit31is equal to or more than the preset threshold value TH1(NO determination in S101), this processing is ended.

When it is determined that the frame rate D1of the image acquired by the imaging unit31is less than the preset threshold value TH1(YES determination in S101), the ambient light detecting unit33detects an ambient illuminance D2of the information processing apparatus1(S102), and the ambient light comparing unit34compares the ambient illuminance D2detected by the ambient light detecting unit33with a predetermined ambient threshold value TH2(S103).

When the ambient light comparing unit34determines that the ambient illuminance D2is equal to or less than the predetermined ambient threshold value TH2(NO determination in S103), this processing is ended.

When the ambient light comparing unit34determines that the ambient illuminance D2is more than the predetermined ambient threshold value TH2(YES determination in S103), it is then determined whether the currently selected mode is the privacy mode (S104).

When the currently selected mode is determined not to be the privacy mode (NO determination in S104), the privacy mode is selected (S105). On the other hand, when the currently selected mode is determined to be the privacy mode (YES determination in S104), the imaging mode is selected. Thus, the privacy mode is released (S106).

In the embodiment, although the case where the operation illustrated inFIG. 5is repeated in the predetermined periods is described, the processing may also be performed continuously and repeatedly without using the predetermined period.

As described above, according to the information processing apparatus1of the embodiment, the mode selection method, and the mode selection program, the user can set the privacy mode promptly when wanting to set the privacy mode by such an intuitive and simple way as to touch the camera7provided in the information processing apparatus1with the finger. Further, since the privacy mode can be released easily by performing a similar operation, the imaging mode and the privacy mode can be switched to each other without performing troublesome setting operations. Further, since the mode switching is controlled based on the output value related to the brightness of the image acquired by the imaging unit31and the output value related to the ambient brightness, accurate mode switching can be performed by simple comparisons without the need to perform image processing and the like. Therefore, the mode switching can be controlled with low power consumption without affecting the execution of any other program on the information processing apparatus1.

As a variation of the embodiment, an IR camera9may also be provided as illustrated inFIG. 6in addition to the camera7for capturing an image obtained in the visual light range. In this case, an IR LED10is provided as auxiliary light used to perform shooting with the IR camera9. In this variation, control to select either the imaging mode or the privacy mode as mentioned above is applied to both or either of the camera7and the IR camera9.

As another variation of the embodiment, among the mode selection conditions on which the mode selection unit35makes a selection, only the determination result of the determination unit32may be used without using the determination result of the ambient light comparing unit34. When only the determination result of the determination unit32is used as the mode selection condition, the privacy mode is selected when the determination unit32determines that the frame rate D1of the image is less than the predetermined threshold value TH1. Then, in the state where the privacy mode is being selected, the privacy mode may be released when the determination unit32determines that the frame rate D1of the image is less than the predetermined threshold value TH1.

The output values related to the brightness of images acquired by the imaging unit31may be different between a case where the camera7is covered by the user under a bright environment and a case where the camera7is covered by the user under a dark environment. Therefore, as still another variation of the embodiment, a threshold value setting unit may further be provided to change the threshold value used by the determination unit32according to the ambient brightness. In this case, since the threshold value with which the output value related to the brightness of an image acquired by the imaging unit31is compared is also changed according to the ambient environment (brightness), more accurate mode switching can be performed.

Specifically, the threshold value is changed to increase the brightness when the ambient brightness of the information processing apparatus1is equal to or more than a preset first criterion value, and the threshold value is changed to decrease the brightness when the ambient brightness of the information processing apparatus1is equal to or less than a second criterion value smaller than the first criterion value. Further, without being limited to this example, a table in which the ambient brightness and the threshold value are associated with each other may be provided to set the threshold value according to the ambient brightness by referring to this table.

Further, the threshold value mentioned above may also be changed according to the output value related to the brightness of the image acquired from the imaging unit31, or changed based on the output value related to the ambient brightness detected by the ambient light detecting unit33.

When the user closes the information processing apparatus1(laptop PC) (nonuse state), since the camera7is shielded, the output value related to the brightness of an image to be acquired becomes less than the predetermined threshold value. In such a situation, especially in the case where only the determination result of the determination unit32is used as the mode switching condition like in the variation 2, there is a possibility that mode switching unintended by the user may be performed by closing the information processing apparatus1. Therefore, as yet another variation of the embodiment, a use state determination unit may further be provided to determine whether the information processing apparatus1is in use. In this case, when the information processing apparatus1makes a transition from the nonuse state to the use state, the mode selected just before the mode selection unit35is put into the nonuse state may be maintained. In this case, since the mode before the information processing apparatus1becomes the nonuse state is maintained even when the mode switching conditions are fulfilled, the mode switching unintended by the user can be prevented.

As the use state determination unit that determines whether the information processing apparatus1is in use, a sensor such as a lid switch to detect whether the information processing apparatus1is closed can be used. Further, when the information processing apparatus1used is a mobile terminal such as a smartphone, the sensor may be a G sensor or the like that determines whether the mobile terminal is placed with the screen directed downward. Further, it may be determined whether the information processing apparatus1is in a standby state such as a sleep mode to determine whether the information processing apparatus1is in use.

In a case where an openable and closable physical shielding object is provided for the camera7to cover the front face of the camera7, when the physical shielding object is closed by the user, since the output value related to the brightness of the image acquired by the imaging unit31becomes less than the threshold value, the privacy mode is set. After that, when the physical shielding object is removed by the user, for example, when the physical shielding object is opened, the user expects to release the privacy mode in order to perform imaging. However, the information processing apparatus1according to the embodiment mentioned above is configured not to release the privacy mode only by the gesture of the user to open the physical shielding object, i.e., the privacy mode is maintained until the imaging unit31is covered again with the user's finger or the like.

Therefore, in order to improve user-friendliness, this variation is to enable the user to release the privacy mode easily with the user's operation to open the physical shielding object.

For example, suppose that the determination unit32determines that the state where the output value related to the brightness of the image is less than the predetermined threshold value is maintained for a predetermined time or more. In this case, the privacy mode is switched to the imaging mode in this variation when the output value related to the brightness of the image exceeds the predetermined threshold value. As the means used to cover the camera7, for example, a plastic tape or the like may also be used. Here, the “predetermined time” is set on the assumption that the imaging unit31is covered with the physical shielding object for a long time, i.e., the “predetermined time” is set to a certain amount of time to distinguish from the user's operation to cover the camera7with the user's finger for a short time as described in the embodiment mentioned above.

Specifically, when it is determined that the output value related to the brightness of the image acquired by the imaging unit31is less than the predetermined threshold value, the privacy mode is first selected. Then, the time elapsed after the transition to the privacy mode is measured by a time measuring unit such as a timer. When this measured time is equal to or more than a predetermined time threshold value, it is determined that the camera7is covered with the physical shielding object. After that, when the determination unit32determines that the output value related to the brightness of the image is equal to or more than the predetermined threshold value, it is determined that the physical shielding object is removed from the imaging unit31to release the privacy mode. On the other hand, when the time measured by the time measuring unit is less than the predetermined time threshold value, the operation is determined to be the gesture of the user who intends to perform mode switching, and hence the privacy mode is maintained.

According to this configuration, the time measured by the time measuring unit is compared with the time threshold value to determine whether the camera7is covered with the user's finger or with the physical shielding object so as to determine, depending on the determination result, whether the privacy mode is maintained or released. Therefore, for example, even when the camera7is covered with the physical shielding object, the privacy mode can be maintained or released to match user's expectations. Further, there is no need to newly provide a sensor used to detect that the camera7is physically covered such as that the physical shielding object covers the camera7.

In the case where the light source8is provided, if the light source8is covered with the physical shielding object together with the camera7, the heat dissipation of the light source8may be impaired. Therefore, it is helpful to turn off the light source8in the privacy mode. Especially, when the IR LED10highly required to dissipate heat is used, the light source8can be turned off. For example, when the camera7is the IR camera9and an IR LED is used as the light source8, or when the IR camera9and the IR LED10are provided like in the variation 1 mentioned above, it is helpful to turn off the light source8and the IR LED10in the privacy mode.

As yet another variation of the embodiment, it may be determined whether the camera7is covered, based on the output value related to the color of an image acquired by the imaging unit31in combination with the output value related to the brightness of the acquired image. In this variation, a color determination unit is provided, in addition to the configuration of the above-mentioned embodiment, to determine whether the image acquired by the imaging unit31is a single color or not, and the mode selection unit35sets/releases the privacy mode based on the comparison result of the determination unit32and the comparison result of the color determination unit.

For example, when the camera7is covered with a child's finger, thin paper, or the like, or when the camera7is covered in a very bright place such as outdoors, since the image acquired from the imaging unit31does not become dark enough, there is a possibility that an accurate determination as to whether the camera7is covered cannot be made merely by the output value related to the brightness of the image. Specifically, when the camera7is covered with the child's finger or the like, the image acquired by the imaging unit31becomes a little dark and turns totally red. Therefore, an evaluation value related to red color, e.g., chromaticity (such as a range indicating a ratio of R, G, and B), is preset. In this case, when the whole screen acquired by the imaging unit31can be evaluated as having the same chromaticity, it is determined that the camera7is covered by the user regardless of the output value related to the brightness of the image to perform mode switching. Thus, covering the imaging unit31by the user can be detected more accurately, and hence accurate mode switching, i.e., setting and releasing the privacy mode, can be performed.

The evaluation value related to the color evaluated by the color determination unit is not limited to the evaluation value related to red color, and the evaluation value can be set for any color. In other words, the color determination unit in this variation determines whether the whole screen is a uniform color regardless of the shades of the color, and in the case of the uniform color, it may be determined that the camera7is covered to perform mode switching.

According to this configuration, since mode switching is performed according to whether the image is a single color in such a situation that the image acquired from the imaging unit31is not dark enough even when the camera7is covered by the user to set the privacy mode, the determination as to the brightness of the image can be complemented and hence more accurate mode switching can be performed.