Abstract:
Provided is an image projection device that carries out high precision gesture detection. An image projection device has a projection unit that optically projects image and a gesture detection unit that detects human gestures and generates a signal for operating the projected image on the basis of the detection results. The gesture detection unit controls a range for detecting gesture according to the direction that the projection unit projects light and/or the placement state of the image projection device. The device has a laser light source and photodiode for detecting gestures, or has a pyroelectric sensor for detecting infrared rays.

Description:
TECHNICAL FIELD 
       [0001]    The present invention relates to an image projection device. 
       BACKGROUND ART 
       [0002]    Patent Literature 1 below is raised as background art of the present technical field. In an abstract of this publication, “to provide a projection-type image display device that does not make a person in a projection image feel uncomfortable and that does not make a person looking at the image feel uncomfortable” is described as an object, and the projection-type image display device “including a driving mechanism driving a person detection means to be movable in a specific direction to adjust a detection range of the person detection means and a control means changing a state of an image that is being projected when the person detection means detects existence of a person” is described as a means to achieve the object. 
       CITATION LIST 
     Patent Literature 
       [0003]    Patent Literature 1: JP-A-2011-043834 
       SUMMARY OF INVENTION 
     Technical Problem 
       [0004]    In Patent Literature 1, the person detection means is controlled so that, even in a case in which a projection range of a projector is changed, the projection range and the detection range of a sensor which detects a person may be equal ranges, and detection of a person is performed by detecting large movement of the person. However, since the detection range is broad, and sensitivity is low, it is difficult to detect fine movement of the person (hereinafter, referred to as a gesture) such as body and hand motions. 
         [0005]    Currently, in an image projection device (hereinafter, it may be abbreviated as a projection device), for example, a function of detecting a gesture of an operator of the projection device and controlling the projection device itself or a display image in response to the gesture is being developed. In an example of such control, when a certain gesture is detected, the projection device is turned off, or the display image is scrolled or replayed frame by frame. 
         [0006]    However, since the gesture is performed only in a limited and small space, it is an object to detect a gesture with high accuracy by optimizing a gesture detection range. 
       Solution to Problem 
       [0007]    To solve the above problems, the present invention employs a configuration described in the claims, for example. 
         [0008]    The present application includes a plurality of components to solve the above problems, and examples thereof include an image projection device which projects light having image information and displays an image, the image projection device including: a projection unit including: a light source unit which generates light; a light control unit which generates an optical image based on the image information using the light generated by the light source unit; and a projection optical unit which projects the light generated by the light control unit; and a gesture detection unit including: a detection element which includes a sensor that detects a gesture of an operator of the image projection device; and an operating signal generating unit which generates an operating signal for operating an image signal associated with the image information based on the gesture detected by the detection element. 
       Advantageous Effects of Invention 
       [0009]    The present invention exerts an effect of enabling an image projection device improving accuracy of gesture detection to be achieved. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0010]      FIG. 1  is a schematic view of a projection device according to Embodiment 1; 
           [0011]      FIG. 2A  is a first schematic view illustrating a projecting state of the projection device; 
           [0012]      FIG. 2B  is a second schematic view illustrating a projecting state of the projection device; 
           [0013]      FIG. 3  is a block diagram illustrating an internal configuration of the projection device; 
           [0014]      FIG. 4  illustrates a mechanism for adjusting inclination of a detection element; 
           [0015]      FIG. 5  illustrates a detection range adjusting method using laser scanning; 
           [0016]      FIG. 6  illustrates an example of detection range setting in a tabletop projection case; 
           [0017]      FIG. 7A  is a first view illustrating a detection method in a case of using a passive sensor; 
           [0018]      FIG. 7B  is a second view illustrating a detection method in a case of using the passive sensor; 
           [0019]      FIG. 8  illustrates a case in which an image of the projection device contains multiple screens; 
           [0020]      FIG. 9  illustrates a principle of a TOF scheme; 
           [0021]      FIG. 10  is a schematic view illustrating a configuration for achieving line scanning with use of a laser light source; 
           [0022]      FIG. 11A  is a first view illustrating a laser irradiation range of the detection element viewed from a direction of a +y axis; and 
           [0023]      FIG. 11B  is a second view illustrating a laser irradiation range of the detection element viewed from the direction of the +y axis. 
       
    
    
     DESCRIPTION OF EMBODIMENTS 
       [0024]    Hereinafter, embodiments of the present invention will be described with reference to the drawings. 
       Embodiment 1 
       [0025]    In the present embodiment, a configuration of a projection device and a detection unit detecting a person, an optimal detection range which differs depending on a projection direction, and a detection range control unit setting the optimal detection range will be described. 
         [0026]    First, the configuration of the projection device and the detection unit will be described. 
         [0027]      FIG. 1  is a schematic view of the projection device according to Embodiment 1. 
         [0028]    The configuration of the present embodiment includes a projection unit  1 , a detection element  2 , a screen  10 , and a projection device arranging table  11 . The projection device  1  is arranged on the projection device arranging table  11  and projects an image on the screen  10 . The detection element  2  detects a gesture in a detection range  2   a.  The detection element  2  may have a light source for detecting the gesture or may be a passive sensor having no light source. 
         [0029]    Next, optimization of the detection range in accordance with the projection direction will be described. 
         [0030]      FIGS. 2A and 2B  are first and second schematic views illustrating projecting states of the projection device  1 .  FIG. 2A  illustrates a case in which the image is projected on the screen  10  (hereinafter, a wall surface projection case), and  FIG. 2B  illustrates a case in which the image is projected on the projection device arranging table  11  (hereinafter, a tabletop projection case). 
         [0031]    First,  FIG. 2A  will be described. In  FIG. 2A , an operator performing a gesture (hereinafter, an operator) is located close to the screen  10  while an observer looking at the image projected on the screen  10  observes the image at a position away from the screen  10 . The operator generally stands to keep away from a projection screen of the projection unit  1  to prevent the projection screen from being blocked. Accordingly, the distance between the operator and the detection element  2  tends to be long. Also, the screen  10  changes depending on the use environment of a user, and it is assumed that a certain object such as a wall is used as the screen  10 . Accordingly, the operator psychologically tends to be located away from the screen  10 , and it is assumed that the operator performs the gesture at a position away from the detection element  2 . 
         [0032]    Next,  FIG. 2B  will be described. In  FIG. 2B , since the tabletop projection is performed, the operator has little chances to block the image, and it is assumed that the operator performs the gesture at a position close to the screen. 
         [0033]    Since a required operation range differs in the wall surface projection case and in the tabletop projection case from the above reasons, the detection range of the detection element  2  needs to be specified on the premise of both the operation ranges. 
         [0034]    However, in a case in which a detection range containing both the operation ranges is specified, sensitivity is lowered as much as the increase of the detection range. Also, since detection is performed in the range containing an unnecessary range for the other projection state, erroneous detection such as detection of a gesture performed by a person other than the operator may be carried out. Based on the above, in order to satisfy both the sensitivity and the detection in the necessary operation range, it is clear that the detection range needs to be switched depending on the projection state. 
         [0035]    Although only the wall surface and the tabletop have been raised as examples of the projection states here, there is a wide variety in the projection direction, the arranging place, and the distance between the projection device  1  and the screen  10 . For example, as for the projection direction, a ceiling is assumed, as well as the tabletop and the wall surface. As for the arranging place, a wall surface and a ceiling are assumed. Accordingly, it is necessary to set an optimal detection range  2   a  depending on the arrangement and the projection state. 
         [0036]    Next, the detection range control unit setting the optimal detection range will be described. 
         [0037]      FIG. 3  is a block diagram illustrating an internal configuration of the projection device  1 . 
         [0038]    The projection device  1  includes a gesture detection unit  14  and a projection unit  4 . 
         [0039]    First, the gesture detection unit  14  will be described. The gesture detection unit  14  includes a detection signal calculation unit  3  and a detection range switching unit  5 . The detection signal calculation unit  3  includes a signal detection unit  3   a,  a gesture determination unit  3   b,  and an operating signal generating unit  3   c.  In the detection signal calculation unit  3 , the signal detection unit  3   a  detects a signal containing gesture information of the operator supplied from the detection element  2  and supplies the signal to the gesture determination unit  3   b.  Subsequently, based on the signal supplied, the gesture determination unit  3   b  performs signal processing for determining various gesture motions. In addition, the operating signal generating unit  3   c  outputs an operation command signal in accordance with an output signal of the gesture determination unit  3   b  to an external device  6  such as a personal computer (PC) and a smartphone. The external device  6  controls an image signal to be supplied to the projection device  1  in accordance with the operating signal of the operating signal generating unit  3   c.    
         [0040]    By doing so, the image to be projected from the projection device  1  to the screen  10  is controlled in accordance with the operation command signal generated based on the gesture performed by the operator. For example, in accordance with a direction in which the operator moves his/her hand, the display image is scrolled or replayed frame by frame. It is to be noted that the external device  6  may be anything as long as it supplies the image signal to the projection device  1 . For example, the external device  6  may be a card-like recording medium to be inserted in a card interface provided in the projection device  1 . 
         [0041]    Next, the projection unit  4  will be described. The projection unit  4  includes an image control unit  4   a,  a light source unit  4   b,  a light control unit  4   c,  a projection lens  4   d  and a projection minor  4   e.  The image control unit  4   a  outputs control signals to the light source unit  4   b  and the light control unit  4   c  in accordance with the image signal supplied from the external device  6 . The light source unit  4   b  includes a light source emitting light such as a halogen lamp, an LED, and a laser and adjusts a light volume in accordance with the output signal of the image control unit  4   a . In a case in which the light source unit  4   b  includes three colors of R, G, and B, the light volumes of the three colors may be controlled independently in accordance with the image signal. The light control unit  4   c  includes an optical system component such as a mirror, a lens, a prism, and an imager (e.g., a display device such as a liquid crystal display panel) and generates an optical image based on the image signal supplied from the external device  6  with use of light emitted from the light source unit  4   b.  The projection lens  4   d  enlarges the image output from the light control unit  4   c . The projection mirror  4   e  reflects light emitted from the projection lens  4   d  and projects the image on the aforementioned screen  10 . As the projection mirror  4   e,  an aspheric minor is used. In a case in which an image of the same size is projected, a projection distance can be shortened further than that in a general projection device. Although an example of the projection unit  4  using the projection mirror  4   e  has been raised in the present embodiment, another configuration may be available instead of this configuration as long as it can carry out image projection. Meanwhile, combination of the projection lens  4   d  and the projection mirror  4   e  is hereinafter, sometimes referred to as a projection optical unit. 
         [0042]    Next, the detection range switching unit  5  will be described. 
         [0043]    Here, a configuration of the detection range switching unit  5 , and especially, a switching portion of the detection range and setting of detection sensitivity, will be described. 
         [0044]    First, the configuration of the detection range switching unit  5  will be described. 
         [0045]    The detection range switching unit  5  includes a detection range switching signal generating unit  5   a  and a detection element control unit  5   b.  The detection range switching signal generating unit  5   a  detects a state of the projection device  1  and outputs a signal in accordance with the state. The detection range switching signal generating unit  5   a  includes a sensor detecting a projection state (the tabletop projection, the wall surface projection, and the like) based on the arranging place, the projection distance to the screen  10 , and the like. As the sensor, a mechanical switch switched by the operator, a gyro sensor detecting inclination of the projection device  1 , or a pressure sensor detecting contact with the projection device arranging table  11  may be used. Alternatively, an illuminance sensor may be used. By arranging the illuminance sensor on a side of the projection device arranging table  11  in the wall surface projection case or the tabletop projection case, the state detection can be carried out based on illuminance of detected light. Also, the operator may electrically transmit a signal to the detection range switching signal generating unit  5   a  using a remote control or the like to input the state of the projection device  1 . 
         [0046]    Meanwhile, the projection state can be detected by using the aforementioned sensor not only in the wall surface projection case or the tabletop projection case but also in a case in which the projection device  1  is arranged to be inclined. Also, in a case in which the detection element  2  includes a laser light source as the light source for gesture detection, by emitting light to the screen  10 , the projection distance to the screen  10  can be measured based on a temporal difference between the emitted light and the reflected light. A signal based on distance information detected in the detection element  2  is output via the signal detection unit  3   a  to the detection range switching signal generating unit  5   a.    
         [0047]    As the detection element  2  serving as an element for detection, a photodiode detecting laser light or a pyroelectric sensor detecting infrared light generated from a human body is used, for example. Depending on which electromagnetic wave for detection is used, a sensor to be used changes, and whether or not the detection element  2  includes a light source also changes. 
         [0048]    The detection element control unit  5   b  controls the detection range  2   a  of the detection element  2  in accordance with the signal supplied from the detection range switching signal generating unit  5   a.    
         [0049]    Next, the switching portion of the detection range will be described. 
         [0050]      FIG. 4  illustrates a mechanism adjusting inclination of the detection element  2 . The detection element  2  is arranged on a rotating table  12  included in the projection device  1 . The rotating table  12  controls a setting angle of the detection element  2  in accordance with the signal of the detection element control unit  5   b.  In this manner, a position of the detection range  2   a  can be switched. 
         [0051]    To scale an area of the detection range  2   a,  a movable lens may be provided on the detection element  2 . The movable lens changes a distance to the detection element  2  in accordance with the projection direction of the projection device  1  to adjust the detection range  2   a.  In a case in which the detection element  2  is the pyroelectric sensor detecting changes of intensity of an electromagnetic wave such as infrared light, for example, the detection area can be scaled by moving positions of a hole and a Fresnel lens at an upper part of the pyroelectric sensor. 
         [0052]      FIG. 5  illustrates a detection range adjusting method using laser scanning. The detection element  2  includes a laser light source  7 , an angle adjustable mirror  8 , and a light reception element  9 . The detection element control unit  5   b  outputs control signals to the laser light source  7  and the angle adjustable mirror  8 . The angle adjustable mirror  8  receives the signal from the detection element control unit  5   b  to cause an angle thereof to be adjusted to a setting angle. Also, it is to be understood that the detection range  2   a  can be controlled by providing the laser light source  7  on the rotating table  12  as illustrated in  FIG. 4 . 
         [0053]    Next, setting of the detection range when a gesture is performed will be described. 
         [0054]      FIG. 6  illustrates an example of detection range setting in the tabletop projection case and illustrates relationship among a detection range (angle) 2θ of the detection element  2 , an angle φ between a normal direction of the projection device  1  and a detection center line of the detection element  2  (hereinafter, a detection center angle), a distance Lg from the detection element  2  to a gesture position, a distance hs in a vertical direction from the projection device arranging table  11  to the detection element  2 , and an operation area H. Relationship among the detection range 2θ and the respective parameters and relationship among the detection center angleφ and the respective parameters are expressed as Equation 1 and Equation 2 shown below: 
         [0000]      2θ =a  tan(( H−hs )/ Lg )+ a  tan( hs/Lg )   (Equation 1),
 
         [0000]      φ=(1/2)( a  tan(( H−hs )/ Lg )− a  tan( hs/Lg ))   (Equation 2).
 
         [0055]    As shown in the above equations, the detection range 2θ and the detection center angle φ are determined by the gesture position Lg, the height hs of the detection element  2 , and the operation area H. The operation area H differs depending on the projection state of the projection unit  1 . As described above, the operation area H is large in the wall surface projection case and is small in the tabletop projection case. When an actual use environment is assumed, the operation area H in the tabletop projection case is about several cm to 10 cm, and the operation area H in the wall surface projection case is about several cm to tens of cm. The gesture position Lg may be a distance to an end portion of a screen size farthest from the projection device  1 , for example. Also, in a case in which a laser light source is used in the detection element  2 , the operation range H may be provided in an area preventing eyes of a person from being irradiated in consideration of safety. In the tabletop projection case, the detection range 2θ and the detection center angle φ may be set to prevent eyes from being irradiated when a person sits in front of the front surface of the projection device  1 . 
         [0056]    Next, the setting of detection sensitivity will be described. 
         [0057]    In a case in which a passive sensor (e.g., a pyroelectric sensor) including no light source for gesture detection is used in the detection element  2 , an effective way to achieve high-accuracy gesture detection is to set the detection range not to overlap with the tabletop or the wall surface as described below. 
         [0058]      FIGS. 7A and 7B  are first and second views illustrating detection methods in a case of using the passive sensor (e.g., the pyroelectric sensor). 
         [0059]    When the pyroelectric sensor is raised as an example of the passive sensor, the detection amount of the pyroelectric sensor is determined by a percentage of a heat source in the detection range and a heat quantity. That is, the larger the percentage of a gesture in the detection range is, the larger the detection amount becomes. On the other hand, when the detection range overlaps with the projection device arranging table  11  as illustrated in  FIG. 7A , an area in which no gesture can be performed will exist. Thus, it is difficult to obtain a large detection amount. To increase the detection amount, a dead zone hg is provided on a lower side of the detection range as illustrated in  FIG. 7B  to narrow and optimize the detection range so as to eliminate the area in which no gesture can be performed. Accordingly, the large detection amount can be obtained. 
         [0060]    The sensitivity may be adjusted depending on the user and the environment. In a case in which the detection amount of the pyroelectric sensor is considered, even when the gesture is performed under the same conditions, the detection amount differs since the hand temperature differs depending on the user. Even when the gesture is performed by the same person, the detection amount differs depending on the environmental temperature. Also, in a case in which the gesture is detected by a laser, the detection amount differs depending on the reflectance of the user&#39;s hand. Thus, the detection area may be adjusted in accordance with the user and the environment to improve the sensitivity. When the laser is used, intensity of the laser may be heightened, or the scanning range may be limited to improve the sensitivity. 
         [0061]      FIG. 8  illustrates a case in which the image of the projection device  1  contains multiple screens. In  FIG. 8 , three screens are projected, and one is a main screen while the other two are sub screens. In a case in which the operation is carried out by performing a gesture to, e.g., icons, displayed on the sub screens while looking at the main screen, the main screen does not need to be set in the detection range, and the detection range is thus limited to the two sub screens. Since the detection range can be limited, the detection amount of the detection element  2  increases, and the detection sensitivity is improved. The laser intensity and the detection range may be differentiated between the sub screens. 
         [0062]    Also, adjustment of the sensitivity may be done by the user side, or a test mode may be prepared on the side of the projection device  1 , and adjustment of the sensitivity may be done automatically based on reference measurement under certain conditions. For example, in a case in which the detection element  2  is a sensor including a light source, the detected amount of reflected light differs depending on the reflectance of the operator&#39;s hand, and the detection sensitivity differs. In the test mode, the light source may emit light having predetermined luminance to detect reflected light, and appropriate luminance of the light source to the operator may be determined in accordance with the amount of the reflected light. 
       Embodiment 2 
       [0063]    In the present embodiment, a detection method using line scanning with use of a laser light source in the detection element  2  will be described. In the present embodiment, a principle of a Time-Of-Flight scheme (hereinafter, a TOF scheme) to be used, a configuration for line scanning with use of the laser light source, and control of the detection element  2  will be described. 
         [0064]    First, the principle of the TOF scheme will be described. 
         [0065]      FIG. 9  illustrates the principle of the TOF scheme. The TOF scheme is a distance measurement method using a time period between a time point of emission of light from the laser light source  7  and a time point of reception of reflected light on the screen  10  by the light reception element  9 . When this time period is expressed as t [s], and light speed is 3.0×10 8  [m/s], a distance L [m] is expressed as Equation 3: 
         [0000]        L[m] =3.0×10 8 × t /2   (Equation 3).
 
         [0066]    Next, the configuration for line scanning with use of the laser will be described. 
         [0067]      FIG. 10  is a schematic view illustrating a configuration for achieving line scanning with use of the laser light source. The line scanning is achieved by using the laser light source  7 , the angle adjustable mirror  8 , the light reception element  9 , and a cylindrical lens  13 . 
         [0068]    First, light emitted from the laser light source  7  is reflected on the angle adjustable mirror  8  at an arbitrary angle. The light reflected on the angle adjustable mirror  8  is incident in the cylindrical lens  13  and becomes a line light source spreading in a Z direction. By scanning this line light source in an X direction, line scanning spreading in the Z direction and enabling motion detection in the X direction can be achieved. 
         [0069]    As the angle adjustable minor  8 , a mirror that scans only in the X direction illustrated in  FIGS. 10, 11A, and 11B  is used. In the detection element  2  using the laser in the Embodiment 1, since the mirror that scans two-dimensionally is used, the minor costs much but can detect information in directions of three axes. On the other hand, in comparison with the mirror in the Embodiment 1, the mirror that scans one-dimensionally in the present embodiment detects information only in directions of two axes but costs less. In the Embodiment 2, by using the mirror  8 , which scans one-dimensionally, and the cylindrical lens  13 , a method for obtaining a similar function to that in the case of using the minor that scans two-dimensionally while prioritizing the cost is shown. 
         [0070]    Next, the control of the detection element  2  will be described. 
         [0071]      FIGS. 11A and 11B  are first and second views illustrating laser irradiation ranges of the detection element  2  viewed from a direction of a +y axis. Meanwhile, the XYZ axes are ones illustrated in  FIG. 10 . 
         [0072]      FIG. 11A  illustrates differences in the laser irradiation range at a portion directly above the detection element  2  and end portions on a certain XZ plane. Respective x coordinates of the directly above portion and the end portions are x0(=0), x+n, and x−n. In each rectangle elongated in a horizontal direction in the figure, a length of a long side thereof represents an irradiation range while a length of a short side thereof represents light intensity. At x0, the laser irradiation range is narrow since a distance from the detection element  2  to the XZ plane is short. Conversely, at x+n and x−n, the laser irradiation range is broad since the distance from the detection element  2  to the XZ plane is long. Thus, since the intensity of the laser light differs at the portion directly above the detection element  2  and at the end portions, the detection sensitivity decreases from the directly above portion to the end portions. That is, when the gesture is performed at the end portion of the screen  10 , sufficient sensitivity may not be obtained. Under such circumstances, the laser intensity needs to be constant regardless of the place so that similar sensitivity can be obtained wherever in the screen  10  the gesture is performed. 
         [0073]      FIG. 11B  illustrates an example in which the laser irradiation ranges are set to be constant to keep the light intensities constant. To make the laser irradiation ranges constant, the curvature of the lens surface of the cylindrical lens is changed at the portion directly above the detection element  2  and at the end portions. The curvature at the portion directly above the detection element  2  is set to be small, and the curvature is gradually increased toward the end portions. Also, to keep the light intensities further constant, it is effective to set the laser irradiation range at each of the end portions to be smaller than that at the portion directly above the detection element  2 . At each of the end portions, the laser is emitted in an inclined manner, and a view angle seen from the light reception element  9  is smaller than that at the portion directly above the detection element  2  even when the intensity is constant. Thus, the light reception intensity relatively decreases, and the sensitivity is lowered. By setting the irradiation range at each of the end portions to be smaller, similar sensitivity can be obtained wherever in the screen  10  the gesture is performed. 
         [0074]    It is to be noted that, although the description in which the intensity is adjusted by the laser irradiation range has been provided here, the intensity of the light generated in the laser light source  7  may be adjusted depending on whether the portion directly above the detection element  2  or the end portion is irradiated. Another method may be employed as long as it can achieve a similar function. 
         [0075]    Also, to prevent the emitting light of the projection device  1  from influencing detection of the gesture, the laser light source  7  and the light reception element  9  preferably use an infrared wavelength region. By using the infrared wavelength region, highly sensitive detection can be carried out even under outside light. 
       REFERENCE SIGNS LIST 
       [0000]    
       
           1 : projection device 
           2 : detection element 
           2   a : detection range 
           3 : detection signal calculation unit 
           3   a : signal detection unit 
           3   b : gesture determination unit 
           3   c : operating signal generating unit 
           4 : projection unit 
           4   a : image control unit 
           4   b : light source unit 
           4   c : light control unit 
           4   d : projection lens 
           4   e : projection mirror 
           5 : detection range switching unit 
           5   a : detection range switching signal generating unit 
           5   b : detection element control unit 
           6 : external device 
           7 : laser light source 
           8 : angle adjustable mirror 
           9 : light reception element 
           10 : screen 
           11 : projection device arranging table 
           12 : rotating table 
           13 : cylindrical lens 
           14 : gesture detection unit