Display device for displaying in one screen a figure of a user seen from multiple different directions, and display method and recording medium for the same

A display device includes: first and second cases that are connected to each other so as to be capable of moving relatively; a first image-capture unit that is provided in the first case and images a first image; a second image-capture unit that is provided in the second case and images a second image; a first display unit that is provided in the first case; a second display unit that is provided in the second case; a face recognition unit that determines whether the first image and the second image include a face seen from front; and a display control unit that causes the first display unit to display the first image and the second image when the face recognition unit determines that the first image includes a face seen from front, the display control unit causing the second display unit to display the first image and the second image when the face recognition unit determines that the second image includes a face seen from front.

This application is a National Stage Entry of PCT/JP2014/056535 filed on Mar. 12, 2014, which claims priority from Japanese Patent Application 2013-066752 filed on Mar. 27, 2013, the contents of all of which are incorporated herein by reference, in their entirety.

TECHNICAL FIELD

The present invention relates to a display device, a display method, and a display program.

BACKGROUND ART

There is, for example, a device that images the figure of both sides of a user using two image-capture units, and displays on a display unit an image that is a combination of the two side images that have been captured (for example, refer to Patent Document 1).

There also exists a device that images the figure seen from the front and the figure seen from the rear of a user by two image-capture units. This device for example displays the figure seen from the front on a display unit and displays to the user by reflection in a mirror an image expressing the figure seen from the side (for example, refer to Patent Document 2).

PRIOR ART DOCUMENTS

Patent Document

SUMMARY OF THE INVENTION

Problem to be Solved by the Invention

However, in the device disclosed in Patent Document 1, cameras must be installed corresponding to the standing position of the user, leading to the constitution of the entire device becoming large in scale. For this reason, there is the problem of not being able to apply this kind of art to tablet terminals, mobile terminals and the like.

In the device disclosed in Patent Document 2, the display unit displays differing first and second images showing the user. The second image that is displayed by the display unit is reflected in a mirror. In this way, since a mirror is required, the constitution of the entire device becomes large in scale. For that reason, there is the problem of not being able to apply this kind of art to tablet terminals, mobile terminals and the like.

The present invention has been achieved in view of the above circumstances. An exemplary object of the present invention is to provide a display device, a display method, and a display program capable of solving the aforementioned issues.

Means for Solving the Problem

A display device according to an exemplary aspect of the present invention includes: first and second cases that are connected to each other so as to be capable of moving relatively; a first image-capture unit that is provided in the first case and images a first image; a second image-capture unit that is provided in the second case and images a second image; a first display unit that is provided in the first case; a second display unit that is provided in the second case; a face recognition unit that determines whether the first image and the second image include a face seen from front; and a display control unit that causes the first display unit to display the first image and the second image when the face recognition unit determines that the first image includes a face seen from front, the display control unit causing the second display unit to display the first image and the second image when the face recognition unit determines that the second image includes a face seen from front.

A display method according to an exemplary aspect of the present invention is used for a display device including first and second cases that are connected to each other so as to be capable of moving relatively, a first image-capture unit and a first display unit that are provided in the first case, and a second image-capture unit and a second display unit that are provided in the second case. The display method includes: imaging a first image by the first image-capture unit; imaging a second image by the second image-capture unit; determining whether the first image and the second image include a face seen from front; causing the first display unit to display the first image and the second image when it is determined that the first image includes a face seen from front; and causing the second display unit to display the first image and the second image when it is determined that the second image includes a face seen from front.

A program according to an exemplary aspect of the present invention causes a display device including first and second cases that are connected to each other so as to be capable of moving relatively, a first image-capture unit and a first display unit that are provided in the first case, and a second image-capture unit and a second display unit that are provided in the second case, to execute: imaging a first image by the first image-capture unit; imaging a second image by the second image-capture unit; determining whether the first image and the second image include a face seen from front; causing the first display unit to display the first image and the second image when it is determined that the first image includes a face seen from front; and causing the second display unit to display the first image and the second image when it is determined that the second image includes a face seen from front.

Effect of the Invention

According to an exemplary embodiment of the present invention, it is possible to display in one screen the figure of the user seen from multiple different directions.

EMBODIMENTS FOR CARRYING OUT THE INVENTION

Hereinbelow, an exemplary embodiment of the present invention shall be described referring to the figures.FIG. 1is a block diagram that shows a display device1according to the exemplary embodiment of the present invention.FIG. 2andFIG. 3are perspective views that schematically show the outward appearance of the display device1. In the figures, the same constitutions are denoted by the same reference symbols.

The display device1shown inFIG. 1includes a first image-capture unit11, a first display unit21, a second image-capture unit12, a second display unit22, a face recognition unit30, and a display control unit40.

The display device1also internally includes one or a plurality of central processing units (CPUs), memory, and an input/output interface circuit and the like that are not illustrated. The face recognition unit30and the display control unit40are constituted by the CPU executing predetermined programs.

Also, the display device1is provided with an input unit such as a touch panel that is integrally constituted with for example each of the first display unit21and the second display unit22.

The first image-capture unit11has inside therein an optical system, an image-capture element, and a control circuit that performs driving of the image-capture element and signal conversion. The first image-capture unit11outputs a moving image or still image that has been captured (hereinbelow called a first image) as a predetermined image signal.

The first display unit21may for example be a liquid crystal display panel. The first display unit21displays a moving image or a still image based on the signal that the display control unit40has output.

The first image-capture unit11and the first display unit21may for example be provided in a first case61as shown inFIG. 2. A display surface21aof the first display unit21is parallel with a surface that is perpendicular to the image-capture direction (that is, the optical axis direction) of the first image-capture unit11. The first display unit21stops the display operation in the case of a predetermined display stop signal being input from the display control unit40.

The second image-capture unit12has the same constitution as the first image-capture unit11. That is, the second image-capture unit12has inside therein an optical system, an image-capture element, and a control circuit that performs driving of the image-capture element and signal conversion. The second image-capture unit12outputs a moving image or still image that has been captured (hereinbelow called a second image) as a predetermined image signal.

The second display unit22may for example be a liquid crystal display panel. The second display unit22displays a moving image or a still image based on the signal that the display control unit40has output.

The second image-capture unit12and the second display unit22may for example be provided in a second case62as shown inFIG. 2. A display surface22aof the second display unit22is parallel with a surface that is perpendicular to the image-capture direction of the second image-capture unit12. The second display unit22stops the display operation in the case of a predetermined display stop signal being input from the display control unit40.

The face recognition unit30performs a predetermined face image recognition process on the first image based on the image signal that the first image-capture unit11has output. Also, the face recognition unit30performs a predetermined face image recognition process on the second image based on the image signal that the second image-capture unit12has output. This face recognition unit30determines whether or not a face seen from the front can be recognized in the first image or second image, that is, whether or not the first image or the second image includes a face seen from the front.

The methods of the face image recognition process and the face direction determination process are not particularly limited. As the method of the determination process, it can be performed using a generally known method. For example, the facial contour, eyes, nose, mouth or the like are recognized by comparing a plurality of patterns prepared in advance, and based on the relative position of the eyes, nose, mouth or the like in the contour, the direction of the face is recognized.

The face recognition unit30outputs an image signal that represents the first image and an image signal that represents the second image to the display control unit40. Also, the face recognition unit30outputs the aforementioned determination result to the display control unit40. The image signal that represents the first image and the image signal that represents the second image may also be input from the first image-capture unit11and the second image-capture unit12directly to the display control unit40.

The display control unit40, based on the first image and the second image that the first image-capture unit11and the second image-capture unit12have respectively picked up, controls the images displayed on the first display unit21and the second display unit22.

The display control unit40, in the case of the face recognition unit30having determined that the first image includes a face seen from the front, displays the first image and the second image on the first display unit21. The display control unit40, in the case of the face recognition unit30having determined that the second image includes a face seen from the front, displays the first image and the second image in the second display unit22.

The case shall be described of the face recognition unit30having determined that the first image includes a face seen from the front. In this case, the display control unit40may generate an image signal that is input to the first display unit21such that the first image is arranged in the upper portion of the display region of the first display unit21(display surface21a), and the second image is arranged in the lower portion of the display region of the first display unit21.

The case shall be described of the face recognition unit30having determined that the second image includes a face seen from the front. In this case, the display control unit40may generate an image signal that is input to the second display unit22such that the second image is arranged in the upper portion of the display region of the second display unit22(display surface22a), and the first image is arranged in the lower portion of the display region of the second display unit22.

The display control unit40, in the case of the face recognition unit30having determined that the first image includes a face seen from the front, stops the display on the second display unit22.

The display control unit40, in the case of the face recognition unit30having determined that the second image includes a face seen from the front, stops the display on the second display unit22.

In stopping the display, the display control unit40may turn off the power of the first display unit21or the second display unit22, or may display a completely black or completely white image on the first display unit21or the second display unit22.

As shown inFIG. 2, the display device1has the first case61, the second case62, and a hinge70. The first case61has the first image-capture unit11and the first display unit21. The second case62has the second image-capture unit12and the second display unit22. The hinge70connects in a freely turnable manner the first case61and the second case62. That is, the first case61and the second case62are connected in a mutually movable manner.

As shown inFIG. 3, the rotation range of the hinge70may be set so as to be able to fold the first case61and the second case62such that the first display unit21and the second display unit22face each other. In the case of the first case61and the second case62being positioned as shown inFIG. 2, the optical axis of the first image-capture unit11and the optical axis of the second image-capture unit are not mutually parallel but intersect. That is, in the positional relation shown inFIG. 2, the optical axes of the first image-capture unit11and the second image-capture unit12can image the user seen from respectively different directions.

Referring toFIG. 4, an operation example of the display device1shown inFIG. 1shall be described. By executing a predetermined program by the internal CPU not shown in the display device1, the units shown inFIG. 1are controlled, whereby the processes shown inFIG. 4are executed. The determination process shown inFIG. 4may be executed in one-frame units, or may be executed in units of a predetermined plurality of frames (or predetermined time units).

The display device1executes the processes of steps S101, S102, S105and the process of steps S103to S105described below in parallel.

The first image-capture unit11is activated under CPU control. The first image-capture unit11captures a first image and outputs an image signal.

The first display unit21displays the first image based on the image signal that is output from the first image-capture unit11.

Meanwhile, the second image-capture unit12is activated under CPU control. The second image-capture unit12captures a second image and outputs an image signal.

The second display unit22displays the second image based on the image signal that is output from the second image-capture unit12.

The face recognition unit30determines whether or not the first image and the second image include a face seen from the front. In the case of the face recognition unit30having determined that the first image does not include a face seen from the front, the display control unit40returns to Step S102and displays the first image in the first display unit21. In the case of the face recognition unit30having determined that the first image does not include a face seen from the front, the display control unit40returns to Step S104and displays the second image in the second display unit22.

The face recognition unit30, in the case of having determined that the first image or the second image includes a face seen from the front, determines whether the image in which a face seen from the front is included is either of the first image and the second image.

In the case of the face recognition unit30having determined that the first image includes a face seen from the front, the display control unit40displays the first image and the second image on the first display unit21. For example, the display control unit40may perform an image process for displaying the captured image of the first image-capture unit11(first image) in the first display region of the first display unit21, and for displaying the captured image of the second image-capture unit12(second image) in the second display region of the first display unit21. The first display region of the first display unit21is for example a region211positioned in the upper-half portion of the first display unit21shown inFIG. 5. The second display region of the first display unit21is for example a region212positioned in the lower-half portion of the first display unit21shown inFIG. 5.

The display control unit40stops the display on the second display unit22.

In the case of the face recognition unit30having determined that the second image includes a face seen from the front, the display control unit40displays the first image and the second image on the second display unit22. For example, the display control unit40may perform an image process for displaying the captured image of the second image-capture unit12(second image) in the first display region of the second display unit22(for example, the display region in the upper portion), and for displaying the captured image of the first image-capture unit11(first image) in the second display region of the second display unit22(for example, the display region in the lower portion). The first display region of the second display unit22is for example a region221positioned in the upper-half portion of the second display unit22shown inFIG. 7. The second display region of the second display unit22is for example a region222positioned in the lower-half portion of the second display unit22shown inFIG. 7.

The display control unit40stops the display on the second display unit22.

By the above processes, the display device1can display the captured image of the first image-capture unit11(first image) and the captured image of the second image-capture unit12(second image) in the display screen of the first display unit21or the second display unit22. That is, the display device1can display images of the user's face seen from different angles in a screen at the position the user is looking (field of view). Thereby, the user, by looking at one display screen, can confirm both the face seen from the front looking at that display screen and the face seen from a different angle. Even in the case of the constitution of the display device1according to the present exemplary embodiment being a tablet terminal or mobile terminal, it is possible to easily display the figure of the user seen from different angles in one display unit simultaneously.

Also, according to the aforementioned constitution, the user can see the display images of the first display unit21or the second display unit22without interposing a half mirror or reflecting them with a mirror. By performing viewing with images displayed in a display unit, it is possible to reduce the difference between the image quality of the face seen from the front and the image quality of the face seen from the side, and so they become easier to see.

A first operation example of the display device1that has been described referring toFIG. 1toFIG. 3shall be described referring toFIG. 5andFIG. 6.FIG. 5is a view for describing the first operation example of the display device1.FIG. 6is a schematic plan view for describing an example of the progress of light in the first operation example.

In the first operation example shown inFIG. 5andFIG. 6, the display device1directly images the front of the face of a user100with the first image-capture unit11(that is, images the actual image), and images by the second image-capture unit12a mirror image91of a side of the face of the user100reflected onto a reflecting surface201of a mirror200. In the first operation example, when the user starts this function, imaging is started by two of the image-capture unit11and the image-capture unit12, and both captured images are displayed in the two display units21and22.

The user100adjusts the angle of the hinge70while viewing the display of the display unit21or22so that the figure of himself seen from the front can be imaged by one image-capture unit (in this case, the first image-capture unit11) and the profile or figure seen from the rear of himself reflected in the mirror200can be imaged by the other image-capture unit (in this case, the second image-capture unit12).

Next, the display device1performs a face recognition process on the images that the two image-capture units11and12have imaged.

The display device1continues the display of the display unit (in this case, the first display unit21) that is arranged in the same case (in this case, the first case61) as the image-capture unit (in this case, the first image-capture unit11) that has imaged the image in which a face seen from the front of the user100can be recognized (in this case, the first image).

Also, the display device1stops the display of the other display unit (in this case, the second display unit22).

In this case, in the first operation example, the first image-capture unit11images the first image by receiving light L1reflected by the front of the face of the user100.

The second image-capture unit12images the second image by receiving light L3, which is light L2reflected by the side of the face of the user100that is reflected by the reflecting surface201.

In this case, since the face recognizing unit30recognizes a facial front image in the first image, a front image81of the face (that is, the first image) is displayed in the first display region211of the first display unit21, and a side image83of the face (that is, the second image) is displayed in the first display region212.

Also, the display operation of the second display unit22is stopped.

In the first operation example, the mirror image91of the side of the face of the user100that is reflected by the reflecting surface201is imaged by the second display unit21. In this case, since it is also possible to adjust the angle of the mirror200in addition to adjustment of the angle of the case61and the case62, it is possible to increase the degree of freedom of adjustment.

Next, a second operation example of the display device1that has been described referring toFIG. 1toFIG. 3shall be described referring toFIG. 7andFIG. 8.FIG. 7is a view for describing the second operation example of the display device1.FIG. 8is a schematic plan view for describing an example of the progress of light in the second operation example.

In the second operation example shown inFIG. 7andFIG. 8, the display device1directly images with the second image-capture unit12the front of the face of the user100, and images with the first image-capture unit11the mirror image91of the side of the face of the user100that is reflected in the reflecting surface201of the mirror200.

In the second operation example, the second image-capture unit12images the second image by receiving light L1reflected by the front of the face of the user100.

The first image-capture unit11images the first image by receiving light L3, which is light L2reflected by the side of the face of the user100that is reflected by the reflecting surface201.

In this case, since the face recognition unit30recognizes a facial front image in the second image, a front image81of the face (that is, the second image) is displayed in the first display region221of the second display unit22, and a side image83of the face (that is, the first image) is displayed in the second display region222. Also, the display operation of the first display unit21is stopped.

While the first case61is made to face the front of the user100in the first operation example, the second case62is made to face the front of the user100in the second operation example. Even in the second operation example, it is possible to display two captured images in a display unit facing the front of the user100, in the same manner as the first operation example.

Next, a third operation example of the display device1that has been described referring toFIG. 1toFIG. 3shall be described referring toFIG. 9andFIG. 10.FIG. 9is a view for describing the third operation example of the display device1.FIG. 10is a schematic plan view for describing an example of the progress of light in the third operation example.

In the third operation example shown inFIG. 9andFIG. 10, the display device1directly images the front of the face of the user100with the first image-capture unit11, and directly images a side of the face of the user100with the second image-capture unit12. In the third operation example, the first-capture unit11images the first image by receiving light L1reflected by the front of the face of the user100. The second image-capture unit12images a second image by receiving light L2reflected by the side of the face of the user100. In this case, since the face recognition unit30recognizes a facial front image in the first image, a front image81of the face (that is, the first image) is displayed in the first display region221of the first display unit12, and a side image82of the face (that is, the second image) is displayed in the second display region222. Also, the display operation of the second display unit22is stopped.

In the third operation example, the image of the front of the user100and an image other than the front are imaged without using a mirror200. In this case, the image other than the front of the user100cannot serve as the image of the figure of the complete side surface or close to the back surface, but it is possible to simultaneously display images of the front surface and other than the front surface without using the mirror200.

As shown above, according to the present exemplary embodiment, it is possible to achieve the same functionality as a two-sided mirror or combination mirror or the like using the display device including a plurality of image-capture units and a plurality of display units. Also, it is possible to view the left and right sides of the face in a similar manner by a method of use that switches between the left and right. Also, by automatically stopping display of the display device not in use, it is possible to achieve a reduction in power consumption.

The exemplary embodiment of the present invention is not limited to that described above. For example, the positional relation of the image-capture unit and the display unit within the same case may be changed. Also, a change may be made so that, in the event of stopping the display operation, control is performed that stops the display in the case of a condition for stopping the display operation having continued for a specific time. The display device according to the exemplary embodiment of the present invention may also be constituted using a CPU and a program that the CPU executes. A portion or all of that program may be distributed via a computer-readable recording medium or communication lines.

According to the exemplary embodiment of the present invention, for example it is possible to display the figure of the user seen from two different directions by the first image-capture unit11and the second image-capture unit12on either one of the first display unit21and the second display unit22. In doing so, in the case of the face of the user being recognizable, display is performed in either one of the first display unit21and the second display unit22that is in the front direction of the user, with the other display being stopped.

In that case, it is possible for the user to directly view the display images of the first display unit21and the second display unit22without using a mirror or the like. Thereby, it is possible to easily achieve a reduction in power consumption.

The display device according to the present exemplary embodiment may internally have a computer system. The process of operation may be stored in a computer-readable recording medium in the form of a program, and by a computer system reading this program and executing it, the aforementioned processes may be performed. The “computer system” here includes a CPU, various types of memory, an OS and hardware such as peripheral devices.

The “computer system” in the case of using a WWW system also includes a homepage providing environment (or display environment).

By recording a program for realizing each step on a computer-readable recording medium, or by recording a program for realizing this function in computer-readable recording medium, the program that is stored in this recording medium may be read into a computer system and executed.

The “computer-readable recording medium” includes writable non-volatile memory such as a magnetic disk, ROM and flash memory, portable media such as a CD-ROM, and a storage device such as a hard disk that is housed in a computer system.

The “computer-readable recording medium” also includes one that retains the program for a given period of time, such as volatile memory (for example DRAM (Dynamic Random Access Memory)) in a computer system that functions as a server or client in the case of the program being transmitted via a network such as the Internet or a communication line such as a telephone line.

The aforementioned program may be transmitted from a computer system having this program stored in a storage device thereof to another computer system via a transmission media or by transmission waves in the transmission media. The term “transmission media” that transmits the program includes a media having a function for transferring information, such as a network (communication network) such as the Internet, or a communication line (communication cable) such as a telephone line.

Moreover, the program may be for realizing a part of the aforementioned functions.

Furthermore, it may be a so-called differential file (differential program), whereby the functions described above can be realized by a combination with programs that are already recorded in the computer system.

The present invention has been described above referring to the exemplary embodiment, but the present invention is not limited to this exemplary embodiment. Various changes that could be understood by a person skilled in the art can be made to the structures and details of the present invention within the scope of the present invention.

This application is based upon and claims the benefit of priority from Japanese patent application No. 2013-066752, filed on Mar. 27, 2013, the disclosure of which is incorporated herein in its entirety by reference.

INDUSTRIAL APPLICABILITY

The present invention may be applied to a display device, a display method, and a display program.

REFERENCE SYMBOLS