Abstract:
Provided are a user adaptive display device and method thereof. The user adaptive display device includes a plurality of display modules that are jointly or individually controllable and adjacent to each other. The user adaptive display device includes a communication unit, a control unit, and a display unit. The communication unit receives data on user information. The control unit analyzes the user information and changes an image configuration according to the user information. The display unit displays an image with the image configuration changed by the control unit.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    The present application claims priority under 35 U.S.C. 119 and 35 U.S.C. 365 to Korean Patent Application No. 10-2009-0114546 (filed on 25 Nov. 2009), which is hereby incorporated by reference in its entirety. 
       BACKGROUND 
       [0002]    The present disclosure relates to a user adaptive display device and method thereof, and more particularly, to a user adaptive display device and method thereof, in which the image quality is adjusted according to the location of a user. 
         [0003]    When a user feels inconvenience in watching TV or viewing a PC monitor due to an excessively large or small size of images or texts on its screen, the user directly has to adjust the size of images or the font of texts. 
       SUMMARY 
       [0004]    Embodiments provide a user adaptive display device and method thereof, in which the display image quality can be automatically adjusted according to corresponding user information that include the location, voice, and gesture of a user. 
         [0005]    In one embodiment, a user adaptive display device including a plurality of display modules that are jointly or individually controllable and adjacent to each other includes: a communication unit receiving data on user information; a control unit analyzing the user information and changing an image configuration according to the user information; and a display unit displaying an image with the image configuration changed by the control unit. 
         [0006]    The user information may include information on a distance from a user, and the control unit may changes the image configuration according to the distance from the user. 
         [0007]    The control unit may change the size of the&#39;image or the size of texts included in the image, or may perform conversion between a three-dimensional image and a two-dimensional image, according to the distance from the user. 
         [0008]    The details of one or more embodiments are set forth in the accompanying drawings and the description below. Other features will be apparent from the description and drawings, and from the claims. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0009]      FIG. 1  is a schematic view illustrating the configuration of a user adaptive display device according to an embodiment. 
           [0010]      FIG. 2  is a view illustrating a display unit of a user adaptive display device according to an embodiment. 
           [0011]      FIG. 3  is a view illustrating an exemplary display unit according to an embodiment. 
           [0012]      FIGS. 4 and 5  are views illustrating an example of changing an image configuration according to the age of a user. 
           [0013]      FIG. 6  is a view illustrating an example of changing an image configuration according to the location of a user among user information. 
           [0014]      FIGS. 7 and 8  are views illustrating an example of changing an image configuration according to the distance from a user among user information. 
           [0015]      FIGS. 9 and 10  are views illustrating another example of changing an image configuration according to the distance from a user among user information. 
           [0016]      FIG. 11  is a schematic view illustrating the configuration of a user adaptive display unit according to another embodiment. 
           [0017]      FIG. 12  is a flowchart illustrating a method of displaying a display device according to an embodiment. 
       
    
    
     DETAILED DESCRIPTION OF THE EMBODIMENTS 
       [0018]    Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. 
         [0019]    Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings. 
         [0020]      FIG. 1  is a schematic view illustrating the configuration of a user adaptive display device according to an embodiment. 
         [0021]    Referring to  FIG. 1 , a display device  100  may adjust the configuration of a displayed image using the distance from a user and the age of the user. That is, the image configuration may be adjusted by changing the size of a displayed text, changing the size of a display screen, and performing conversion between two-dimensional and three-dimensional images. 
         [0022]    The display device  100  may include a display unit  110  on which an image is displayed, a user input unit  120  receiving commands for operating the display device  100  or configuring the image, a control unit  130 , and a communication unit  140  receiving user information. 
         [0023]    Since the display unit  110  can be installed on the surface of a wall in an installation space of the display device  100 , the display unit  110  may occupy all or a portion of the surface of the wall. 
         [0024]    For example, the display device  100  may be installed on one or more side walls of a living room or family room, and the display unit  110  may be installed on all or a portion of the side walls of the living room or family room. 
         [0025]    Accordingly, the display device  100  may also be called a display wall or a video wall, but will be described herein as the display device  100 . 
         [0026]    The display unit  110  may be one large-scale screen that is constituted by a plurality of sub display modules having a tile shape. 
         [0027]    For example, as shown in  FIG. 2 , a plurality of sub display modules  111  to  125  may be connected to form one large-scale display unit  110  and output a single image. That is, the plurality of sub display modules  111  to  125  constituting the display unit  110  may be jointly or individually controlled. 
         [0028]    In one embodiment, the plurality of sub display modules  111  to  125  of the display unit  110  may operate as individual display modules, respectively. Accordingly, the plurality of sub display modules  111  to  125  may output individual images, respectively. 
         [0029]    In one embodiment, the display unit  110  of the display device  110  may be configured with a projector for projecting images on a wall surface. In this case, light including image information from the projector may be projected on the wall surface. 
         [0030]    Thus, the display device  100  may occupy all or a portion of the wall surface, and may provide single or multiple images to a user. 
         [0031]    The display unit  110  may display a certain image or video, for example, certain contents received through the communication unit  140 . Such contents may include still images or videos that include two-dimensional or three-dimensional images. 
         [0032]    The communication unit  140  of the display device  100  may receive contents from an external server or other display devices through wired or wireless networks, and may display the received contents on the display unit  110 . Here, the contents may include various applications, as well as broadcasting signals. 
         [0033]    The display device  100  may store contents in a memory unit  150 . The control unit  130  may read the contents stored in the memory unit  150 , and may display the read contents on the display unit  110 . 
         [0034]    Also, various contents including audiovisual materials to be displayed and various user information may be received through the communication unit  140 . Here, the user information may refer to the face, age, gesture and voice of a user, the distance from the user, and the location of the user, which can be construed as information on the user near the display unit  110 . 
         [0035]    In order to obtain the user information, the display unit  110  may be provided with a camera that can photograph a user, and a microphone that can receive a voice of the user. Units for obtaining the user information may be called recognition devices. 
         [0036]      FIG. 3  illustrates the display unit  110  installed on a wall and a user viewing the display unit  110 . A recognition device  300  may be provided in the display unit  110  to obtain user recognition information from the user. 
         [0037]    The recognition device  300 , which is a unit for obtaining the user information, may include a camera for recognizing the face or gesture of a user, and a microphone for receiving the voice of the user. 
         [0038]    The user information such as image or sound that is obtained by the recognition device  300  may be delivered to the communication unit  140 . To this end the recognition device  300  may be wired or wirelessly connected to the communication unit  140 . In another embodiment, the user information that is obtained by the recognition device  300  may be delivered to an external server, and the corresponding user information from the external server may be redelivered to the communication unit  140 . 
         [0039]    By using the information obtained by the recognition device  300 , the display device  100  may configure images (including still images or videos and menu screen or texts) that are displayed. The configuration of the images may include various settings such as changing the size of the images, changing the size of the texts, or determining a sub display module on which the images are to be displayed, according to the user information. 
         [0040]    The user information may include the present or absence of a user, the face, location, gesture and voice of the user, and the distance from the user. The control unit  130  may recognize and analyze the user information, and may configure the images according to the analyzed user information. To this end, the control unit  130  may include or use various modules or applications for data-processing such as the recognition of the user information and the analysis of the user information. 
         [0041]    The recognition and analysis of the user information performed by the control unit  130  are briefly described in the flowchart of  FIG. 12 . 
         [0042]    Hereinafter, the recognition and analysis of the user information by control unit  130 , and the configuration of the images using the recognition and analysis of the user information will be described in detail. 
         [0043]    In operation  5100 , the control unit  130  may receive data such as user images or user voices through the communication unit  140 . In operation  5200 , the recognition of the user information may be performed using the received data. 
         [0044]    That is, the control unit  130  may receive data including the user image (still images or videos) and the user voices that are received from the communication unit  140 , and may perform the recognition of the face, voice and gesture of a user using the received data. 
         [0045]    The user&#39;s face recognition may include extracting a face region of a user from image data obtained by a camera  310  of the recognition device  300 , and utilizing the data of the extracted face region as user information. 
         [0046]    The user&#39;s voice recognition may include removing ambient noises from voice data obtained by a microphone of the recognition device  300 , extracting voice data of about 87 Hz to about 1.2 KHz corresponding to the voice frequency band of a user, and utilizing the extracted voice data as user information. 
         [0047]    The user&#39;s gesture recognition may include extracting motions or gestures of a user from video data obtained by the camera  310  of the recognition device  300 , and utilizing the extracted user&#39;s gestures as user information. 
         [0048]    The control unit  130  may utilize a distance between a user and the display unit  110  among data delivered from the recognition device  300  as user information. That is, the display device may further include a unit for estimating the location of a user through the camera  310 . 
         [0049]    In this case, the control unit  130  may require a reference distance for comparison or reference in order to calculate a distance from a user, recognized by the camera  310 . For example, a reference image obtained by photographing a user spaced by about 1 meter may be stored in advance, and then the appearance of a user may be recognized from an image photographed by the camera  300 . In this case, the control unit  130  may compare the sizes of the user with each other to calculate the distance from the user using a ratio of the sizes of the user. The distance from the user may be calculated by comparing distances between about three or four feature points with each other, instead of the entire sizes of the user. When using the above method, it is possible to calculate the distance from the user (particularly, the face of the user) even when a portion of the body of the user is covered. 
         [0050]    To this end, the control unit  130  may calculate the distance from a user, using the face region or size of the user. 
         [0051]    On the other hand, instead of calculating the distance from a user using the image of the user photographed by the camera, an infrared light-emitting/receiving device may be further included as a recognition device. In this case, infrared rays emitting from the infrared light-emitting/receiving device may be reflected by an object at the front of the display unit  110 , and may return to the infrared light-emitting/receiving device. For example, the distance from the object may be measured according to a method that is called a Time of Flight (TOF) distance measurement method, using the reflection light. The above measurement may be performed on the front side of the display unit  110  to verify the state of the front side of the display unit  110 . For example, when a wall is placed at the front side of the display unit  110 , the time from the emission of the infrared rays to the reflection of the infrared rays may be uniform. Accordingly, it can be estimated that a user is not located at the front side of the display unit  110 . On the other hand, when the time from the emission of the infrared rays to the reflection of the infrared rays may be nonuniform, it can be estimated that a user is located at the front side of the display unit  110 . In this case, the monitoring of the presence or absence of a user by the infrared light-emitting/receiving device may be performed at certain intervals of time. 
         [0052]    Also, when the camera  310  is an infrared camera, a thermograph method using the infrared camera may be used to determine whether an object is a user. In this case, the temperature distribution may be measured using infrared energy emitting from a user, and then the measurement result may be compared with the distance measurement result measured by the infrared light-emitting/receiving device described above. Thus, it is determined whether the object is a user, by determining the size, shape and temperature of the object. 
         [0053]    In operation  5300 , the control unit  130  may perform an analysis of the recognized user information. In operation S 400 , the configuration of the image may be performed according to the analyzed user information. 
         [0054]    The control unit  130  may performed operations such as estimating the age of a user using the face of the recognized user, indentifying a user using the voice of the user, performing user commands using the gestures of a user, estimating a current posture of a user, and analyzing the distance from a user and the location of the user. However, the term, the user gesture, is not necessarily limited to the motion of the user, and it can also be construed as including the postures (e.g., lying, sitting, and standing postures) of the user who is watching TV 
         [0055]    For example, when the current posture of a user is estimated from an inputted image of the user, information on the user&#39;s posture according to the contour and eye&#39;s location of the user&#39;s face may be stored in memory unit  150 . In this case, the control unit  130  may rotate an image displayed on the display unit  110  in the clockwise or counterclockwise direction by about 90 degrees to allow a user to more comfortably look at the image even when the user is lying. 
         [0056]    The control unit  130  may estimate the age of a user from the recognized face of the user. In this case, since statistic data on the user&#39;s faces according to the age of the users or settings for each user may be stored in the memory unit  150  in advance, the control unit  130  may estimate the age of the user from the recognized face of the user. The estimation of the user&#39;s age may be achieved by the voice of the user that is obtained by the microphone of the recognition device. That is, the control unit  130  may estimate the age of a user using voice data of the user that is received. To this end, the memory unit  150  may include a database such as a statistic voice frequency table according to the ages of users. 
         [0057]    The control unit  130  may identify user commands according to the user gestures that are recognized. That is, the control unit  130  may analyze whether a user gesture matches an already-stored gesture, and if so, may operate the display unit according to a command preset as a user command. For example, when a user makes a gesture of making a circle by raising his hands over his head, and this gesture of the user matches an already-stored gesture, a display unit power-off signal may be generated as data corresponding thereto. 
         [0058]    Thus, data signals corresponding to various user gestures may be stored in the memory unit  150  in advance. Data corresponding to the user gestures may be directly designated by a user. For example, when a lying posture of a user lasts for about 1 hour, this may be set as the display unit power-off signal. In this case, when the control unit  130  determines that the user lies, a timer may be set, and then the control unit  130  may power off the display unit  110  when about one hour passes. 
         [0059]    The control unit  130  may performed an analysis of the user situation, and may analyze a method of determining the distance from a user as user information when there are a plurality of users at the front of the display unit  110  and a method of determining the output of images and sounds according to information on noise around a user. For example, when there are a plurality of users in a user image, the control unit  130  may calculate the size of the displayed image using the distances from the respective users, and may allow the image to be displayed in an average size using the calculated result. The control unit  130  may automatically adjust the volume according to the magnitude of the noise around the user. 
         [0060]    Also, the control unit  130  may manage a user profile or a user preference, using the user information. For this, the control unit  130  may continuously manage users using the memory unit  150 , and the memory unit  150  may include a database in which users are classified according to their faces or voices. That is, a user database may be built and may be continuously managed or updated as the user information including the facial contour, expression, posture, and motion for each user. 
         [0061]    The control unit  130  may manage whether there is a modification history in the size of images or texts according to the facial expression, posture, and the ambient environment of a user. For example, when ambient noise is greater than about several tens of decibels (dB), and there is a history in which a user has set the volume of the display unit  110  to level  20 , the history may be stored in the user database of the memory unit  150  and may be managed. For example, it may be stored and managed that a user A has watched TV while sitting at a distance of about 1 m from the display unit  110 . That is, the control unit  130  may also establish a database including the distances from recognized users and the postures of the recognized users. Such a database may enable the management of TV-watching pattern, i.e., preference of users. For example, when the user A prefers watching television sitting on a sofa spaced from the display unit  110  by about 1 m, the size of image may be displayed in an appropriate size when the user A approaches the display unit. 
         [0062]    The TV-watching pattern of a user may be managed by the control unit  130  and the memory unit  150 . According to the TV-watching pattern, the size of an image or the size of texts in the image may be automatically adjusted. 
         [0063]    The control unit  130  may control images or voices outputted through the display unit  110 , using the user information that is analyzed. In operation S 500 , as described above, the configuration may be performed according to the user information, and the image may be displayed according to the configuration. 
         [0064]      FIGS. 4 and 5  are views illustrating an example of changing an image configuration according to the age of a user 
         [0065]    When the age of a user is estimated among the user information recognized by the control unit  130 , the control unit  130  may perform an image configuration and an image display according to the age of a user. 
         [0066]    For example, as described in  FIG. 4 , when a user that is identified from the face information of the user is of an advanced age, the control unit  130  may operate all of the plurality of sub display modules constituting the display unit  110  to display an image on the whole region of the display. However, when there is another image configuration that is preset by the recognized user, the image may be displayed according to the preset image configuration. 
         [0067]    As described in  FIG. 5 , when a user that is identified from the face information of the user is of a young age, the control unit  130  may operate a portion of the plurality of sub display modules constituting the display unit  110  to display the image in a smaller size. When a portion of the plurality of sub display modules of the display unit  110  operates, only sub display modules corresponding to the location of the user may operate. Thus, the location of user may also be used as the user information. With reference to  FIG. 6 , the sub display modules that operate may be selected according to the location of a user at the front of the display unit  110 . Even in this case, the image may be displayed according to an image configuration if there is a different image configuration from the image configuration that is preset by the recognized user. 
         [0068]      FIG. 6  is a view illustrating an example of changing an image configuration according to the location of a user among user information. 
         [0069]    As described above, the control unit  130  may extract the user location information from the user image obtained by the recognition device  300  that is provided outside or inside the display device, and may allow the selective operation of the sub display module of the display unit  110  to be performed according to the location of a user. 
         [0070]    As described in  FIG. 6B , when the control unit  130  determines that a user is located at the right side of the display unit  110 , only the sub display located at the front of the user modules may operate among the sub display modules of the display unit  110 . However, when the location of a user is frequently changed, the sub display module may also be frequently changed to the degree of making viewing-video to be difficult. Accordingly, when the location of the user is not changed for a certain time, the operation of the sub display modules may also be fixed. 
         [0071]    When there is an image configuration that is preset by a recognized user, the control unit  130  may allow an image to be displayed according to the preset image configuration. 
         [0072]      FIGS. 7 and 8  are views illustrating an example of changing an image configuration according to the distance from a user among user information. 
         [0073]    The control unit  130  may change the size of an image using a distance from the display unit  110  to a user. As described in  FIG. 7 , when the control unit  130  determines that the distance from the user is relatively far from the user, for example, about 3 m, the control unit  130  may operate all of the sub display module to display an image on the whole of the display unit  110  for more comfortable viewing. 
         [0074]    As described in  FIG. 8 , when the control unit  130  determines that the distance from the user is within about 3 m, the control unit  130  may control a smaller number of sub display modules to display the image in a smaller size. 
         [0075]    In the adjustment of the image size according to the distance from a user, sub display modules to be selected may be determined according to the location of the user, using the user location information. 
         [0076]    The adjustment of the image size has been described as part of the image configuration using the user information. In addition to the adjustment of the image size, the image configuration may include increasing or reducing the sharpness of objects in the displayed image. When a user is relatively close to the front side of the display unit, the sharpness may be reduced to mitigate the eyestrain. In addition to the sharpness, the brightness of the image may be adjusted, and the volume may be adjusted according to ambient noise. Also, the image may be rotated in a clockwise or counterclockwise direction by 90 degrees according to the posture of the user. 
         [0077]      FIGS. 9 and 10  are views illustrating another example of changing an image configuration according to the distance from a user among user information. 
         [0078]    During the image configuration, the control unit  130  may change the size of texts in an image, using a distance from the display unit  110  to a user. For example, as described in  FIG. 9 , when it is determined that the distance from a user is greater than about 3 m, in order for the user to easily read texts, the control unit  130  may operate all of the sub display modules to display the texts or an image including the texts on the whole of the display unit  110 . 
         [0079]    As a similar example shown in  FIG. 10 , when it is determined that the distance from a user falls within about 3 m, the control unit  130  may select a smaller number of sub display modules to display texts in a smaller size. 
         [0080]    In the adjustment of the text size according to the distance from a user, sub display modules to be selected may be determined according to the location of the user, using the user location information. 
         [0081]      FIG. 11  is a schematic view illustrating the configuration of a user adaptive display unit according to another embodiment. 
         [0082]    A display device  100  according to another embodiment may output a three-dimensional image. That is, the display device  100  may provide a three-dimensional image or menu screen. When a contents provider provides three-dimensional contents, the display unit  100  may output the three-dimensional contents through the communication unit  140 . 
         [0083]    An additional component may be required to output three-dimensional images.  FIG. 11  illustrates the configuration of a display device that can process three-dimensional images, according to another embodiment. The functions of all components of  FIG. 11  except a 3D formatter may be similar to those of  FIG. 1 . 
         [0084]    As shown in  FIG. 11 , the 3D formatter  160  may be disposed at an output terminal of an image signal processing unit (not shown). That is, the 3D formatter  160  may be disposed at an input terminal of the display unit  110 . The 3D formatter  160  may convert an image processed by the control unit  130  into a three-dimensional image, and may deliver the three-dimensional image to the display unit  110 . According to embodiments, a separate 3D formatter may be provided to convert an OSD output of an OSD generation unit into a three-dimensional output. 
         [0085]    The configuration shown in  FIG. 11  is merely an example according to one embodiment, and therefore various known technologies may be employed for the 3D image processing. 
         [0086]    The adjustment of the image configuration according to the user information as described above may also be performed on such a three-dimensional image. That is, the size of the three-dimensional image, the size of texts included in the three-dimensional image, and the depth of the three-dimensional image may be adjusted according to the user information. 
         [0087]    For example, the control unit  130  may control the depth of the three-dimensional image to vary according to the distance from a user. In this case, the control unit may control the degree of projection feeling of a portion of the three-dimensional image, or may control an image region where the projection feeling is emphasized, to vary according to the location of the user. 
         [0088]    When a user adaptive display device according to an embodiment of the present invention is used as a home display environment, a living room may be a common place shared by all family members, in which a user may be frequently changed. However, since the user profile and the user preference are continuously managed, various applications fit for users can be executed. 
         [0089]    According to the embodiments of the present invention, the image quality can be automatically adjusted according to a user or a current state of the user without directly setting the size of an image and so forth by the user. 
         [0090]    Any reference in this specification to “one embodiment,” “an embodiment,” “example embodiment,” etc., means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with any embodiment, it is submitted that it is within the purview of one skilled in the art to effect such feature, structure, or characteristic in connection with other ones of the embodiments. 
         [0091]    Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure. More particularly, various variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.