Source: https://patents.google.com/patent/JP5237268B2/en
Timestamp: 2019-12-10 02:22:19
Document Index: 256553525

Matched Legal Cases: ['art 105', 'art 106', 'art 16', 'art 16', 'art 17', 'art 18']

JP5237268B2 - Display device - Google Patents
JP5237268B2
JP5237268B2 JP2009514297A JP2009514297A JP5237268B2 JP 5237268 B2 JP5237268 B2 JP 5237268B2 JP 2009514297 A JP2009514297 A JP 2009514297A JP 2009514297 A JP2009514297 A JP 2009514297A JP 5237268 B2 JP5237268 B2 JP 5237268B2
JP2009514297A
JPWO2009066475A1 (en
2007-11-21 Priority to JP2007301487 priority Critical
2007-11-21 Priority to JP2007301487 priority
2007-12-03 Priority to JP2007312101 priority
2008-01-23 Priority to JP2008012265 priority
2008-04-23 Priority to JP2008112341 priority
2008-11-21 Priority to JP2009514297A priority patent/JP5237268B2/en
2008-11-21 Priority to PCT/JP2008/003445 priority patent/WO2009066475A1/en
2008-11-21 Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
2011-04-07 Publication of JPWO2009066475A1 publication Critical patent/JPWO2009066475A1/en
2013-07-17 Publication of JP5237268B2 publication Critical patent/JP5237268B2/en
The present invention relates to a display device such as an HMD (head mounted display).
Conventionally, in a display device such as an HMD (head mounted display), there is a method (hereinafter referred to as a laser scanning method) in which laser light is two-dimensionally scanned and directly drawn on the retina of the eye (for example, refer to Patent Document 1). ). Laser scanning display devices include a retinal scanning display, a retinal irradiation display, a retina direct display, a laser scanning display (RSD), a direct viewing display device, and a virtual retina display (VRD). being called.
In a laser scanning type HMD, a laser beam from a laser light source is generally two-dimensionally scanned by a scanning unit, and the beam is passed through the pupil by deflecting the beam in the direction of the pupil with a lens or mirror deflecting mirror disposed in front of the eyes. The drawn beam draws an image on the retina. Here, the point where the beam from the deflection mirror is collected in the vicinity of the pupil will be described as a “deflection focus”. In addition, the terms “focus” and “focus position” are also explained as the same meaning as the deflection focus.
When the user rotates the eyeball without moving the head, for example, looking sideways, the positional relationship between the HMD attached to the head and the pupil changes. If the deflection focus and the pupil position are shifted by this, the beam from the deflection mirror cannot pass through the pupil, and a situation in which an image cannot be drawn on the retina may occur (hereinafter, this situation is referred to as “pupil misalignment” or “eyeball”). "Rotating pupil misalignment"). Whether or not pupil misalignment occurs depends on whether or not the beam can pass through a pupil having a diameter of usually about 2 to 3 millimeters.
23 and 24 are explanatory diagrams of pupil misalignment. When the deflection focus is in the pupil as shown in FIG. 23, the beam deflected by the deflection mirror can pass through the pupil, so that no pupil shift occurs and an image can be drawn on the retina. However, when the eyeball rotates to the left as shown in FIG. 24, the deflection focus is out of the pupil, so that pupil misalignment occurs and an image cannot be drawn on the retina.
For example, when the pupil diameter is 3 millimeters, pupil displacement occurs when the pupil moves 1.5 millimeters or more, and the user cannot see the video. When the viewing angle of the screen in which the pupil moves 1.5 mm is calculated, the viewing angle of the display screen when the distance from the pupil to the deflecting mirror is 15 mm and the distance from the pupil to the center of eyeball rotation is 10.5 mm is about 14 on one side. When the line of sight moves outward from it, pupil misalignment occurs.
Note that FIG. 23 and FIG. 24 are simplified diagrams. Actually, the beam incident on the eye is refracted by the influence of the cornea, the crystalline lens, etc., but in this description, it is important whether the beam can pass through the pupil. The influence of refraction is shown in a simplified manner.
As a countermeasure against pupil misalignment, there is a method in which a deflection mirror has a plurality of deflection focal points (see, for example, Patent Document 2). As shown in FIG. 25, when the deflection mirror has two deflection focal points, even if the pupil moves to the left, another deflection focal point is in the pupil, and thus pupil misalignment may be avoided.
An image display device used for a head-mounted display or the like is one image display device among personal portable display terminals, and a structure based on a spectacle form or a monocular form is generally applied from the viewpoint of wearability. . In such a glasses-type head-mounted display, the output image of the image display device and the background image that is seen through the portion corresponding to the glasses lens are often visually recognized simultaneously. In the case where the output image and background image of such an image display device are merged and viewed at the same time, the following problems are expected to be solved.
As such an image display device, a lens for forming one or more half mirrors and a virtual image in an optical system in order to fuse a background image and a virtual image of an output image while providing a function as glasses. It is necessary to add a concave mirror. Therefore, the size and weight of the image display device are a burden on the user, and there is a problem that it is difficult to withstand long-time use. Further, when trying to increase the definition of an output image, the size of the image display device is further increased and the burden is increased. Therefore, in order to solve such a problem, an image display device used for a head-mounted display or the like is required to be small and light and display a high-definition image.
As such an eyeglass-type image display device, a laser diode array of a small size, light weight and low power consumption is used as a light source, and a Lippmann Bragg volume hologram sheet capable of adding a multifunctional optical function to an optical system is provided. Retina scanning type or laser scanning type image display devices have been proposed (see, for example, Patent Document 3). The optical system such as the light source and the galvano mirror and the drive circuit are miniaturized and stored in the left and right handles (temples) of the glasses to reduce the size and weight.
By the way, when an output image is viewed with such a glasses-type image display device, the light beam applied to the human pupil is blocked by the iris, so that the field of view is narrowed and a part or the whole of the output image cannot be seen. Or, uneven brightness may occur in the image.
Thus, by using a high-intensity white LED as a point light source and disposing a scattering plate in the optical system, the spread of the light beam from the spatial light modulation unit of the image display device increases, so that the light beam has a large range in the vicinity of the pupil. To spread. As a result, even when the eyeball is deviated from a predetermined position to some extent, an image display device that can reliably guide the light beam from the spatial light modulation unit into the pupil, does not narrow the field of view, and does not cause uneven brightness is proposed. (For example, see Patent Document 4).
Whether or not pupil misalignment occurs is determined by whether or not the beam can pass through a pupil having a diameter of typically about 2 to 3 millimeters. Therefore, the larger the angle of view (viewing angle) of the video displayed by the HMD, the larger the rotation angle of the eyeball, and the easier the pupil shift. Conversely, when the screen displayed by the HMD is small and the angle of view is small, the eyeball rotation angle for viewing the edge of the screen is also relatively small, and thus pupil misalignment is unlikely to occur.
FIG. 26 is an explanatory diagram of pupil misalignment. When the position of the pupil is the pupil position A, if the beam from the deflection mirror (deflection unit) passes through the focal point A, no pupil shift occurs. In this case, the user can see the video. However, when the eyeball rotates and the pupil moves to the pupil position B, the beam collected at the focal point A cannot pass through the pupil and a pupil shift occurs. In this case, the user cannot see the video.
As a countermeasure against pupil misalignment, there is a method in which a deflection unit has a plurality of focal points (see, for example, Patent Document 2). In FIG. 26, when the deflecting mirror has two focal points B in addition to the focal point A, the beam gathered at the focal point A when the pupil is at the pupil position A, and gathers at the focal point B when the pupil position is B. Since each beam reaches the retina, there is no pupil shift.
Also, as a line-of-sight detection method, a method of irradiating the eye with infrared light and detecting the line of sight using the reflected light (for example, Patent Document 5), or line-of-sight detection using reflected light from the eye of the scanned laser light. There is a method (for example, Patent Document 6).
Japanese Patent No. 2932636 US Pat. No. 6,043,799 JP 10-301055 A JP 2000-249971 A Japanese Patent No. 2995876 Japanese Patent No. 3425818
As measures against pupil misalignment, there are many problems in the method of providing a plurality of deflection focal points as in Patent Document 2 and FIG. For example, if the pupil size increases due to the darkness of the user's surroundings, two or more deflection focal points may be in the pupil at the same time. There are challenges to make it worse. Conversely, when the size of the pupil is reduced, there is a problem that any deflection focus is out of the pupil and pupil deviation occurs.
Furthermore, even if the eyeball is rotated in different directions such as up, down, left, and right, if it is attempted to avoid pupil misalignment, it is necessary to provide separate deflection focal points on the top, bottom, left, and right, and it is necessary to provide five deflection focal points. In consideration of other directions such as upper left and lower right, it may be necessary to provide nine or more deflection focal points.
When a plurality of deflection focal points are provided, one beam is branched into a plurality of beams by a deflecting mirror or the like, and only one of them is allowed to pass through the pupil. In order to compensate for the efficiency, a high-power laser light source is required, which may lead to a problem of consuming more power. In addition, when a plurality of deflection focal points are provided, there are problems that the manufacturing method of the deflection mirror is complicated, and that various characteristics such as deflection efficiency, transmittance, thickness, and temperature characteristics of the deflection mirror are lowered. In order to reduce the deterioration of the characteristics, a plurality of scanning mirrors may be provided, leading to a problem that the entire display device becomes complicated.
In the conventional technology such as Patent Document 4 described above, an observer who observes an image with an image display device observes the central portion of the fusion image of the background image and the output image with the eyeball facing the front. When you try to observe the peripheral part of the fused image by rotating the eyeball from the state of being in a state, some rays on the opposite side of the fused image to be observed are missing or disappear without entering the pupil Occurs.
In the prior art, a configuration is disclosed in which the position of an image is adjusted to a position facing the user's eyes on the assumption that the user is facing the front. However, no solution is shown for a problem such as missing images when the pupil moves up, down, left, or right, and no problem is suggested.
In addition, as a countermeasure against pupil misalignment, when the deflection mirror has a plurality of focal points near the pupil, if the eyeball rotates so that the beam from another focal point passes through the pupil, There arises a problem that the display size changes.
FIG. 27 is an explanatory diagram of this problem. When the deflecting mirror has two focal points A and B, the beam from the deflection position A reaches both the focal point A and the focal point B. As a result, when the pupil is at the pupil position A, the image can be seen by the beam gathered at the focal point A, and when the pupil is at the pupil position B, the image can be seen by the beam gathered at the focal point B.
However, since the direction from the deflection position A to the focal point A and the direction from the deflection position A to the focal point B are different, there arises a problem that the direction of the displayed image changes. When the pupil is at the pupil position A, the image perceived by the beam from the deflection position A is perceived by the user as an image from the direction of “direction A1” in FIG. Here, if the user moves his / her eyes to move the pupil to the pupil position B, the user expects to see the same image in the direction of “direction A2” which is the same direction as “direction A1”. The image is seen in the direction of “direction B”, which is a different direction, and there is a sense of incongruity that the display position has changed.
The reason why the user expects the video to be seen in the same direction as the direction A1 is the distance to the virtual screen (the distance to the virtual position of the display object). In the HMD, the distance from the eye to the deflection mirror is usually about 1 to 5 centimeters, whereas the distance to the virtual screen is often optically designed to be several meters to infinity, The distance between them is different. This is due to the restriction of the focus adjustment function of the eye. Generally, when the distance to the virtual screen is set to infinity, eye strain tends to be reduced. Assuming that the virtual screen is at infinity, the direction from infinity to the focus A and the direction to the focus B are parallel, so the user moves the eye to move the pupil from the pupil position A to the pupil position B. In this case, the user expects to see the same video in the direction of “direction A2”, which is the same direction as “direction A1”.
Furthermore, there is a problem that not only the display position but also the display size changes as the focus changes. When the eyeball rotates and switches from the focal point A to the focal point B, the distance from the deflection position A to the focal point A is different from the distance to the focal point B, so that the display size appears to change. When the distance from the focal point to the deflecting mirror is increased, there is a problem that the display size is small, and when the distance is close, the display size is increased.
These changes in the display position and size are serious problems in the HMD because the change in the display position and size appears to be larger as the deflection mirror is closer to the eye.
Further, when the HMD is a glasses type, the problem of “glasses misalignment” may occur as in the case of glasses. `` Glasses shift '' is a phenomenon in which the lens part of the glasses gradually shifts downward while wearing the glasses supported by the user's nose and ears. There is a problem that an unpleasant wearing feeling is given to the user and the impression of the user's face is changed.
In the case of a glasses-type HMD, the positional relationship between the lens unit (deflection mirror) and the pupil changes due to the glasses shift, so that the positional relationship between the focal position and the pupil also changes. As a result, the beam cannot pass through the pupil, and a situation in which an image cannot be drawn on the retina may occur (hereinafter, this situation is referred to as “wearing pupil misalignment”).
The problem of this “wearing pupil misalignment” is different from the pupil misalignment caused by eyeball rotation because the amount of change and the direction of change are different, and measures against eyeball rotation pupil misalignment as in Patent Document 2 are insufficient.
Therefore, an object of the present invention is to realize a display device capable of reducing the problem of pupil misalignment without providing a plurality of deflection focal points in a beam scanning display device such as an HMD.
In addition, the present invention solves the above-described conventional problem, and when an observer who has looked at the center of an image tries to view the periphery of the image only by rotating the eyeball up and down and left and right without moving the face. An object of the present invention is to provide an image display device in which the pupil moves but the image observed by the observer is less likely to be chipped even if the pupil position changes.
In addition, the present invention provides a display image position and a display image that change in accordance with the switching of the focus position corresponding to the pupil position when the deflection mirror deflects the display light to a plurality of focus positions corresponding to the pupil position change accompanying the eyeball rotation. An object of the present invention is to realize a display device that solves the problem of changing the size.
Furthermore, an object of the present invention is to realize a display device that solves the problem that an image cannot be seen due to wearing pupil misalignment when glasses misalignment occurs in a glasses-type HMD.
A display device according to the present invention is a display device that displays an image on a user's retina, and outputs an image output unit that outputs display light of the image, and the display light output from the image output unit is directed to the user's eyes. And a deflecting portion that deflects in the direction. The deflection unit has a deflection characteristic that suppresses image disturbance caused by a change in the relative position of the user with respect to the pupil. With this configuration, it is possible to change and adjust the pupil shift occurrence condition by appropriately setting a partial area, and the HMD can reduce the pupil shift problem.
Further, the image output unit includes a light source that outputs a beam for drawing each pixel constituting the image, and a scanning unit that scans the beam output from the light source in a two-dimensional direction. The deflecting unit may have a deflection characteristic in which at least a part of the beam scanned by the scanning unit deflects so that the beam passes through the pupil at a position different from the center of the user's pupil.
The deflection unit may have a deflection characteristic that deflects the beam scanned by the scanning unit so as to pass through different positions of the pupil in accordance with an incident angle to the pupil of the user.
With this configuration, there is an effect that the problem of pupil misalignment can be reduced in a beam scanning display device such as an HMD without having a plurality of deflection focal points. Since there is no need to provide a plurality of deflection focal points, there are problems associated with the above-mentioned plural deflection focal points, such as a case where images are drawn twice on the retina, a problem that the light utilization efficiency of the beam is reduced, and a high output The problem of requiring a light source, increasing power consumption, complicating the manufacturing method of the deflecting means, reducing the characteristics of the deflecting means, and complicating the entire display device can be avoided. There is also an effect.
Further, the deflection unit passes through the pupil center, and the beam scanned in the left deflection region on the left side of the virtual line perpendicular to the deflection unit passes through the user's pupil in the region on the left side of the pupil center. It may have a deflection characteristic that deflects the beam so that the beam scanned in the right deflection region on the right side passes through the pupil of the user in the region on the right side of the pupil center.
Compared with the conventional method in which the deflection focal point is the center of the pupil, this configuration has an effect of increasing the rotation angle at which the pupil does not shift even if the eyeball is rotated to the left toward the left side of the screen. In the example shown in the background art, there is an effect that the rotation angle at which the pupil shift does not occur can be expanded from about 14 degrees to about 26 degrees. Similarly, the right side of the screen has an effect of increasing the rotation angle at which no pupil shift occurs even if the eyeball is rotated to the right.
Further, the deflection unit includes an incident angle of the beam to the pupil, an incident position of the beam to the pupil, and a pupil center between the beam scanned in the left deflection region and the beam scanned in the right deflection region. May have a deflection characteristic of deflecting the beam so that the distance is asymmetrical with respect to the virtual line. This configuration makes it possible to make a difference in the rotation angle of the eyeball that can be continuously viewed on the left and right sides of the screen, so if different deflection units are used for the left eye and the right eye, the range that can be continuously viewed with either eye is set. There is an effect that can be enlarged.
The deflection unit includes a left-eye deflection unit that deflects a beam scanned by the scanning unit in a direction toward the user's left eye, and a right-eye deflection unit that deflects the beam in the direction toward the user's right eye. including. The deflection unit for the left eye has a smaller incident angle to the pupil of the beam scanned in the left deflection region than the beam scanned in the right deflection region, and the beam to the pupil of the beam scanned in the left deflection region. A deflection characteristic for deflecting the beam so that a distance between the incident position and the center of the pupil is larger than a beam scanned in the right deflection region, and the right-eye deflection unit scans the beam in the right deflection region; The angle of incidence on the pupil is smaller than the beam scanned into the left deflection region, and the distance between the entrance position of the beam scanned into the right deflection region and the center of the pupil is scanned into the left deflection region. You may have the deflection | deviation characteristic which deflects a beam so that it may become larger than a beam.
With this configuration, when the line of sight moves to the left, there is an effect that the eyeball rotation angle that can be continuously viewed with the left eye can be expanded. Similarly, when the line of sight moves to the right, there is an effect that the eyeball rotation angle that can be continuously viewed with the right eye can be expanded.
Further, the deflection unit passes through the pupil center, and the beam scanned in the upper deflection region above the imaginary line perpendicular to the deflection unit passes through the region above the pupil center of the user's pupil. The beam may be deflected so that the beam scanned in the lower deflection region on the lower side passes through the region below the pupil center of the user's pupil.
Compared with the conventional method in which the deflection focus is the center of the pupil, this configuration has an effect of increasing the rotation angle at which the pupil is not shifted even when the eyeball is rotated upward as the screen is on the upper side. In the example shown in the background art, there is an effect that the rotation angle at which the pupil shift does not occur can be expanded from about 14 degrees to about 26 degrees. Similarly, the lower the screen, the larger the rotation angle at which no pupil shift occurs even when the eyeball is rotated downward.
The deflecting unit may be a hologram that deflects a beam by diffraction. With this configuration, there is an effect that the deflection means in front of the eyes can be made thin and transparent.
The deflection unit includes a left-eye deflection unit that deflects a beam scanned by the scanning unit in a direction toward the user's left eye, and a right-eye deflection unit that deflects the beam in the direction toward the user's right eye. including. The left-eye deflection unit and the right-eye deflection unit include an inter-pupil distance that is a distance between a pupil center of the left eye of the user and a pupil center of the right eye, a beam condensing position on the left eye, and a right side. You may arrange | position with the positional relationship from which the distance between condensing positions which is a distance with the condensing position of the beam in eyes differs from each other.
By adopting such a configuration, when the pupil moves due to the rotation of the eyeball, it is possible to make the image visible with at least one of the eyes, thereby realizing an image display device that does not lack image output. can do.
The display device further includes a deflection unit position adjustment unit that moves the left-eye deflection unit and the right-eye deflection unit so that the inter-pupil distance and the condensing position distance are different from each other. You may prepare.
By adopting such a configuration, even when observers with different inter-pupil distances use the same display device of the present invention, the left and right deflection units are easily opposed to both eyes using the deflection unit position adjustment unit. Can be moved to. Therefore, the deflection unit can be set at an appropriate position for each user who uses the display device, so that the user can observe an image with no missing image output.
The display device further calculates a distance between the pupils based on a light detection unit that detects reflected light from the pupils of the left and right eyes of the user, and a detection result of the light detection unit, and A deflection unit position control unit that controls the deflection unit position adjustment unit to move the left eye deflection unit and the right eye deflection unit, respectively, so that the inter-position distance is different from the calculated inter-pupil distance; May be provided.
Further, the display device may further prevent one of the beams deflected by the left-eye deflection unit and the right-eye deflection unit from entering the user's eyeball based on the detection result of the light detection unit. When it is determined that the light amount has been determined, the light source may include a light amount control unit that increases the light amount of the other beam.
By adopting such a configuration, the position of the pupil is detected from the intensity of reflected light from the surface of the eyeballs of both eyes, and it is observed with either eye or with both eyes. It is possible to make the observer observe an image with appropriate brightness by controlling increase / decrease in the amount of emitted light based on the information.
In addition, the light detection unit may detect the reflected light by spectroscopically analyzing the reflected light for each predetermined wavelength. By adopting such a configuration, it is possible to detect different iris colors depending on the observer, and it is possible to accurately detect whether or not the light beam is blocked by the iris.
Further, the image output unit includes a light source that outputs a beam for drawing each pixel constituting the image, and a scanning unit that scans the beam output from the light source in a two-dimensional direction. The deflection unit includes a left-eye deflection unit that deflects a beam scanned by the scanning unit in a direction toward the user's left eye, and a right-eye deflection unit that deflects the beam in the direction toward the user's right eye. . The left-eye deflection unit passes through the center of the pupil and is scanned in the left deflection region on the left side of the virtual line perpendicular to the left-eye deflection unit, and on the right deflection region on the right side of the virtual line. With the scanned beam, it has a deflection characteristic that deflects the beam so that the incident angle of the beam to the pupil is asymmetric with respect to the virtual line, and the right-eye deflection unit passes through the center of the pupil, The incident angle of the beam on the pupil of the beam scanned in the left deflection region to the left of the imaginary line perpendicular to the right eye deflection unit and the beam scanned in the right deflection region to the right of the imaginary line is You may have the deflection characteristic which deflects a beam so that it may become left-right asymmetric with respect to the said virtual line.
With such a configuration, when the pupil moves due to the rotation of the eyeball, the observer can make the image visible with at least one of the eyes. As a result, it is possible to realize a display device that does not lack image output, and the entire video output from the image output unit can be viewed.
Further, the image output unit includes a light source that outputs a beam for drawing each pixel constituting the image, and a scanning unit that scans the beam output from the light source in a two-dimensional direction. The deflection unit may have a deflection characteristic that deflects the beam scanned by the scanning unit so as to be condensed on a first focal point and a second focal point different from the first focal point. .
In addition, the display device further detects a change in the pupil position, which is the position of the user's pupil center, based on the light detection unit that detects reflected light from the user's pupil and the detection result of the light detection unit. According to the detection result of the pupil position detection unit and the pupil position detection unit, the change in the pupil position in response to the change in the pupil position from the position including the first focus to the position including the second focus And a control unit that controls the output of the image output unit so that the virtual image visually recognized by the user before and after is viewed in the same direction.
With this configuration, there is an effect that it is possible to reduce the change in the position and size of the display image accompanying the switching of the focus position corresponding to the pupil position. In addition, since the change becomes larger as the deflection unit is closer to the eye, this configuration has an effect that the deflection unit can be arranged closer to the eye. In addition, as a countermeasure against pupil misalignment, the problem of the method of providing the deflecting unit with a plurality of focal points is solved. As a result, an HMD having a wide field angle and a large screen that easily causes pupil misalignment can be realized.
Further, the control unit outputs the output of the image output unit so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change of the pupil position. May be controlled.
With this configuration, for example, there is an effect of reducing a change in the position of the display image to the right as the focus position corresponding to the pupil position is switched to the left. Further, there is an effect that a change in the position of the display image being shifted downward can be reduced as the focal position corresponding to the pupil position is switched upward.
Further, the control unit sets each pixel in the light source so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change of the pupil position. An output image control unit that outputs the beam to be drawn by shifting in the direction in which the pupil position of the user has changed may be included. With this configuration, there is an effect that the change in the position of the display image on the virtual screen displayed at infinity can be reduced as the focal position corresponding to the pupil position is switched.
The output image control unit may further control the output of the image output unit so that the size of the virtual image visually recognized by the user before and after the change of the pupil position is the same. With this configuration, for example, there is an effect that it is possible to reduce a change in which the size of the display image increases as the focal position corresponding to the pupil position approaches from the deflecting unit.
Further, the control unit may cause the scanning unit to set each pixel so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change in the pupil position. May include a scanning angle control unit that scans by shifting the beam for drawing in the direction in which the pupil position of the user has changed. With this configuration, there is an effect that the change in the position of the display image on the virtual screen displayed at infinity can be reduced as the focal position corresponding to the pupil position is switched.
In addition, the deflecting unit is configured to cause the beam scanned by the scanning unit to be higher than the first focus and to the user from the first focus, and the distance from the deflecting unit is longer than the first focus. You may have the deflection | deviation characteristic deflected so that it may condense to 2 focus.
According to the present configuration, even when glasses misalignment occurs in the glasses-type HMD, the problem of wearing pupil misalignment is solved, and as a result, it is difficult to generate a situation where an image becomes invisible. In addition, since the problem of glasses misalignment can be reduced, there is an effect that a heavy HMD with relatively easy eyeglass misalignment, an HMD with a weight balance in the front (lens portion), and an HMD with a small contact area around the nose and ears can be realized. . Further, as a result of reducing the problems when the HMD is made into a glasses, there is also an effect that the HMD can be made into a glasses.
The first and second focal points may be located on a virtual line substantially parallel to the ridgeline of the user's nose. According to this configuration, there is an effect that even when the glasses shift occurs and the glasses lens part moves away from the eyes, the pupil shift does not occur.
The vertical distance between the first and second focal points may be equal to or greater than the height of the user's pupil, and the horizontal distance may be equal to or less than the width of the user's pupil. With this configuration, when the glasses-type HMD is displaced downward with respect to the face, there is an effect of reducing the situation where the beam does not enter the pupil and the situation where a plurality of beams from a plurality of focal points enter the pupil.
The deflecting unit may simultaneously deflect the beam scanned by the scanning unit in a direction toward each of the first and second focal points. According to this configuration, there is an effect that it is possible to cope with the glasses shift without detecting the glasses shift.
Further, the display device further includes a relative position detection unit that detects a change in a relative position between a user's pupil center and the deflection unit, and a detection result of the relative position detection unit determines that the user's pupil center is the first The direction of the beam scanned from the scanning unit to the deflecting unit is different from the first direction to the first direction in response to the change from the position including the focal point to the position including the second focal point. A scanning unit position adjusting unit that moves the position of the scanning unit so as to change in the direction of 2, and the deflecting unit condenses the beam incident from the first direction on the first focal point. You may be comprised by the hologram which has a 1st interference fringe and the 2nd interference fringe which condenses the beam incident from the said 2nd direction to the said 2nd focus.
With this configuration, it is possible to follow the movement of the pupil, so that it is easier to make the focal point coincide with the pupil position, and there is an effect that the occurrence of pupil misalignment can be reduced. In addition, since only one focal point is required, there is no need to split the beam at the deflecting unit. With this configuration, it is easy to make the focal point coincide with the pupil position, and it is possible to reduce the occurrence of pupil misalignment.
In addition, the relative position detection unit is disposed at a position in contact with the user's nose, and rotates with the movement of the deflection unit in the vertical direction, the user's pupil center from the rotation angle of the rotation unit, and the A relative position calculation unit that detects a change in relative position with respect to the deflection unit.
According to the display device of the present invention, an effect of being able to be an HMD that can reduce the problem of pupil misalignment by providing the deflection unit with a deflection characteristic that suppresses image distortion caused by a change in the relative position between the deflection unit and the user's pupil. There is.
Further, in the display device of the present invention, the deflection unit deflects the beam to enter the pupil at different positions according to the beam incident angle to the pupil. As a result, the beam scanning display device such as an HMD has a plurality of deflection focal points. This has the effect of reducing the problem of pupil misalignment without having it. Since there is no need to provide a plurality of deflection focal points, there are problems associated with a plurality of deflection focal points, such as a case where a double image is drawn on the retina, a problem that the light utilization efficiency of the beam is reduced, and a high output light source. It also has the effect of avoiding problems that require power consumption, problems that increase power consumption, problems that complicate the manufacturing method of the deflecting unit, problems that reduce the characteristics of the deflecting unit, and problems that complicate the entire display device. is there.
In addition, the image display device of the present invention can display a high-definition image with high luminance and good color reproducibility, and even when the pupil moves due to the rotation of the eyeball, the image can be seen with at least one of the eyes. Therefore, it is possible to realize a small and low power consumption image display device that does not lack image output.
Further, in the display device of the present invention, when the deflecting unit deflects the display light to a plurality of focal positions corresponding to the pupil position change due to the eyeball rotation, the display image associated with the switching of the focal position corresponding to the pupil position is displayed. This has the effect of reducing changes in position and size. In addition, since the change becomes larger as the deflection unit is closer to the eye, this configuration has an effect that the deflection unit can be arranged closer to the eye. In addition, as a countermeasure against pupil misalignment, the problem of the method of providing the deflecting unit with a plurality of focal points is solved. As a result, an HMD having a wide field angle and a large screen that easily causes pupil misalignment can be realized.
In addition, the display device of the present invention has an effect of making it difficult to generate a situation in which an image cannot be seen as a result of solving the problem of wearing pupil misalignment even when glasses misalignment occurs in the glasses-type HMD. In addition, since the problem of glasses misalignment can be reduced, there is an effect that a heavy HMD with relatively easy eyeglass misalignment, an HMD with a weight balance in the front (lens portion), and an HMD with a small contact area around the nose and ears can be realized. . Further, as a result of reducing the problems when the HMD is made into a glasses, there is also an effect that the HMD can be made into a glasses.
Referring to FIGS. 1A, 1B, 2, and 3, a glasses-type HMD as a beam scanning display device (also referred to as “image display device” or “display device”) according to Embodiment 1 of the present invention. Will be explained. 1A is a plan view of the display device, FIG. 1B is a side view of the display device, FIG. 2 is a detailed view of a part of FIG. 1A, and FIG. 3 is a functional block diagram of the display device.
The eyeglass-type HMD according to Embodiment 1 includes a display device, lenses 121 and 122 arranged at positions of the left and right eyes of the user, one end connected to the lenses 121 and 122, and the other end to the user's temporal region. And a pair of temples 123 and 124 fixed to each other.
As shown in FIG. 1A, FIG. 1B, and FIG. 2, the display device includes light sources 101 and 110 that output beams for drawing pixels constituting a display image, and wave fronts of the beams output from the light sources 101 and 110. Wavefront shape changing units 102 and 109 that change the shape, scanning units 103 and 108 that two-dimensionally scan the beams output from the wavefront shape changing units 102 and 109 toward the deflection units 104 and 107, and scanning units 103 and 108 Deflection units 104 and 107 that deflect the scanning light toward the user's eyes, control units 105 and 111 that control the above-described units, and headphone units 106 and 112.
The light source 101, the wavefront shape changing unit 102, and the scanning unit 103 constitute the left-eye image output unit 100. Similarly, the light source 110, the wavefront shape changing unit 109, and the scanning unit 108 constitute an image output unit (not shown) for the right eye.
In this embodiment, the light sources 101 and 110, the wavefront shape changing units 102 and 109, the scanning units 103 and 108, the control units 105 and 111, and the headphone units 106 and 112 are accommodated in the temples 123 and 124, and the deflection unit 104 and 107 are arranged on the side of the lenses 121 and 122 facing the user's eyes.
The light source 101 outputs a beam. As shown in FIG. 2, the output beam is a laser beam obtained by combining the laser beams output from the red laser light source 211, the blue laser light source 212, and the green laser light source 213. , 212, and 213, by appropriately modulating the output, laser light of any color can be output. Furthermore, by modulating in conjunction with the wavefront shape changing units 102 and 109 and the scanning units 103 and 108, an image can be displayed on the retina of the user's eye.
In FIG. 2, the red laser light source 211 is a semiconductor laser light source that outputs a red laser, and the blue laser light source 212 is a semiconductor laser light source that outputs a blue laser. On the other hand, the green laser light source 213 is configured by combining a semiconductor laser light source that outputs infrared rays and an SHG (Second-Harmonic Generation) element that converts infrared rays into green. However, the present invention is not limited to this, and the green laser light source 213 may be a semiconductor laser light source that outputs a green laser, or each light source may be a solid laser, a liquid laser, a gas laser, or a light emitting diode.
In FIG. 2, the laser light is modulated by the laser light sources 211, 212, and 213 of each color, but an intensity modulation unit that modulates the light output from the laser light sources 211, 212, and 213 is used as the laser light sources 211, 212, By using in combination with H.213, the laser beam may be modulated. The laser light sources 211, 212, and 213 that output at a constant intensity can be applied to the present invention by being combined with the intensity modulator.
The red laser light source 211, the blue laser light source 212, and the green laser light source 213 respectively express the hue, saturation, and brightness of the pixels displayed on the retina by appropriately modulating the intensity of the output beam. In addition to the modulation control described above, correction control may be performed in consideration of the influence of the optical system from the light source 101 to the eye, such as the scanning unit 103 and the deflection unit 104. For example, since the beam from the scanning unit 103 is obliquely incident on the deflecting unit 104, the display area is distorted to a shape other than a rectangle such as a trapezoid. Therefore, laser output control may be performed in conjunction with the scanning unit 103 so that the display area is a display area that has been reversely corrected in advance so as to be rectangular.
The light source 101 may include the light detection unit 214 illustrated in FIG. The light detection unit 214 detects the intensity of reflected light from the user's eyes. The direction of the line of sight or the position of the pupil can be estimated by changing the intensity of the reflected light.
The wavefront shape changing unit 102 changes the wavefront shape of the beam from the light source 101 so that the spot size of the beam deflected by the deflecting unit 104 falls within a predetermined range. The “spot size” of the beam will be described later as a spot size on the retina of the user's eye, but may be a spot size on the pupil, a spot size on the cornea, or a spot size on the deflecting unit 104. The spot size on the retina is the same as the pixel size to be displayed. The “wavefront shape” is a three-dimensional shape of a beam wavefront, and includes a flat, spherical, and aspherical shape.
The wavefront shape changing unit 102 shown in FIG. 2 has a focal length horizontal component changing unit 201 and a focal length vertical component changing unit 202 arranged in series on the optical path. As a result, the curvature in the horizontal direction and the curvature in the vertical direction of the beam can be changed independently. The focal length horizontal component changing unit 201 changes the curvature in the horizontal direction by changing the distance between the cylindrical lens and the mirror. The focal length vertical component changing unit 202 changes the curvature in the vertical direction by using a cylindrical lens arranged perpendicular to the cylindrical lens of the focal length horizontal component changing unit 201. Further, both the focal length horizontal component changing unit 201 and the focal length vertical component changing unit 202 change the beam diameter in accordance with the change in curvature.
Note that if the horizontal curvature is changed more greatly than the vertical direction, it can cope with the change in the horizontal direction, so if you want to make the horizontal viewing angle of the screen larger than the vertical viewing angle, or place the scanning unit 103 in the temporal region This is particularly effective when the horizontal incident angle of the beam from the scanning unit 103 to the deflecting unit 104 is larger than the vertical incident angle.
In FIG. 2, among the items representing the wavefront shape, only a part of the wavefront shape, that is, the curvature in the horizontal direction, the curvature in the vertical direction, and the respective diameters, is changed. There may be means for changing the distribution of curvature and the shape and size of the wavefront end. By these means, there is an effect that the influence of aberration can be reduced and the display image quality can be improved.
The wavefront shape changing unit 102 in FIG. 2 changes the wavefront shape using a cylindrical lens and a mirror, but other means include a liquid crystal lens, a variable shape lens such as a liquid lens, a diffraction element, and an EO element. (Electro-optical conversion element) or the like may be used.
The scanning unit 103 performs two-dimensional scanning with the beam from the wavefront shape changing unit 102. The scanning unit 103 is a single-plate small mirror that can change the angle two-dimensionally, more specifically, a MEMS (Micro-Electro-Mechanical-System) mirror.
The scanning unit 103 may be realized by a combination of two or more types of scanning units, such as for horizontal scanning and vertical scanning. By dividing into a horizontal scanning part and a vertical scanning part, there is an effect that one vibration hardly influences the other and an effect that the structure of the scanning part can be simplified.
The scanning unit 103 is not limited to a method of physically tilting the mirror, but a method of moving a lens, a method of rotating a diffraction element, a liquid crystal lens, a deformable lens, an AO element (acousto-optic element), or EO. A method using a deflecting element such as an element (electro-optical conversion element) may also be used.
The deflecting unit 104 deflects the direction of the beam scanned by the scanning unit 103 in a direction toward the pupil of the user's eye. In the deflection unit 104, for example, a photopolymer layer is formed on the inner surface of the lens of the glasses, and a Lippmann volume hologram is formed on the photopolymer layer, so that the beam from the scanning unit 103 is diffracted toward the user's eye. It is made in. In the photopolymer layer, three holograms that reflect light from the laser light sources 211, 212, and 213 of red, green, and blue may be formed in multiple layers, or three layers corresponding to each color of light. A hologram may be stacked.
In addition, by using the wavelength selectivity of the hologram, it is possible to diffract only the light of the light source wavelength and not to diffract the light of wavelengths other than the light source wavelength that occupies most of the light from the outside world. And can. There is an effect that the deflection unit 104 can be made thin by deflecting the beam by diffraction of the hologram.
The hologram can be formed by forming a photopolymer layer on the surfaces of the lenses 121 and 122 and exposing the lens 121 and 122 with object light and reference light. For example, the deflecting units 104 and 107 are irradiated with object light from the outside of the lenses 121 and 122 (above the lenses 121 and 122 in FIG. 1A) and with reference light from the positions of the scanning units 103 and 108. Here, by adjusting the incident angle or the like of the object light, various deflection characteristics 801 to 806R as shown in FIGS. 6A to 6G can be imparted to the deflecting units 104 and 107.
The control unit 105 includes an integrated circuit that controls each unit of the HMD. As illustrated in FIG. 3, the control unit 105 may include a central processing unit 501, a storage unit 502, and an input / output control unit 503.
The central processing unit 501 supervises processing of the entire display device while exchanging signals with the storage unit 502 and the input / output control unit 503. The storage unit 502 stores data used by the control unit 105.
The input / output control unit 503 controls the control signal output to the light source 101, the wavefront shape changing unit 102, the scanning unit 103, and the like to be controlled by the control unit 105 and the signal input from the control target. The input / output control unit 503 includes a light source input / output control unit 510, a wavefront shape change input / output control unit 511, a scanning input / output control unit 512, a deflection input / output control unit 513, a headphone input / output control unit 514, a power source for each control target type. An input / output control unit 515, a communication input / output control unit 516, and the like may be provided. By executing processing related to input / output in the input / output control unit 503, there is an effect of reducing the load on the central processing unit 501.
Note that the control unit 105 may include a communication unit 520 that wirelessly connects to a peripheral device such as a mobile phone and receives a video / audio signal. Thereby, the connection between the HMD and the peripheral device becomes wireless, and there is an effect that the wearability of the HMD can be improved.
The headphone unit 106 includes a speaker and outputs sound. The headphone unit may include a battery that supplies power to each unit of the display device.
The configuration of the light source 110, the wavefront shape changing unit 109, the scanning unit 108, the deflecting unit 107, the control unit 111, and the headphone unit 112 is the same as that of the light source 101, the wavefront shape changing unit 102, the scanning unit 103, the deflecting unit 104, and the like. Since it is common with the control part 105 and the headphone part 106, description is abbreviate | omitted.
Next, in the beam scanning display device according to the first embodiment, when the relative position of the user's pupil and the deflection unit 104 changes as the eyeball rotates, the disturbance of the image visually recognized by the user is suppressed. A configuration for this will be described with reference to FIGS. 4 to 6G. 4 is a diagram illustrating a state in which the user's eyeball is looking in front, FIG. 5 is a diagram illustrating a state in which the user's eyeball is rotated to the left, and FIGS. 6A to 6G are deflections applied to the deflection units 104 and 107. It is a figure which shows the variation of the characteristics 801-806R. Although only the deflection unit 104 will be described below, the same applies to the deflection unit 107.
As shown in FIG. 4, unlike the conventional deflection mirror of FIG. 23, the deflection unit 104 of the present invention is such that at least a part of the beam scanned by the scanning unit 103 is different from the center of the user's pupil. And has a deflection characteristic of deflecting so as to pass through the pupil. More specifically, it has a deflection characteristic that deflects the beam to be incident on the pupil at different positions depending on the incident angle of the beam to the pupil.
In the conventional system shown in FIG. 23, the beam that enters the pupil from the left angle, the beam that enters from the front, and the beam that enters from the right angle are arranged so that the beam passes through the pupil at the center position of the pupil. The beam was deflected.
On the other hand, in FIG. 4 of the present invention, a beam incident from the left angle to the pupil passes through the pupil at a position on the left side of the pupil center, and a beam incident from the front of the pupil is at the pupil center position. The deflecting unit 104 deflects the beam incident from the right angle of the pupil so that the beam passes through the pupil at a position on the right side of the pupil center.
As a result, when the user rotates the eyeball to the left in order to see the left side of the screen and the pupil moves to the left, in the conventional method, FIG. 23 becomes the state of FIG. 24 and no beam can pass through the pupil. Eye misalignment will occur. However, in the present invention, FIG. 4 becomes the state of FIG. 5, and the beam from the left angle can pass through the pupil, so that the user can see the left side of the screen. Similarly, when the user moves the pupil to the right in order to see the right side of the screen, the user can continue to look at the right side of the screen.
Similarly to the horizontal direction, the beam is deflected so that the beam passes through the pupil at different positions as shown in FIG. 4 in the vertical direction, so that the user moves the pupil upward to view the upper side of the screen. Even in this case, the user can continue to look at the upper side of the screen, and can continue to look at the lower side of the screen even when the pupil is moved downward to see the lower side of the screen.
Assuming that the pupil diameter is 3 millimeters, the distance from the pupil to the deflection unit 104 is 15 millimeters, and the distance from the pupil to the center of eyeball rotation is 10.5 millimeters, the screen viewing angle that can be continuously viewed is calculated as shown in FIG. In this case, the pupil shift occurs when the line of sight moves about 14 degrees or more from the center of the screen, whereas in the case of FIG. 4 of the present invention, if the line of sight moves from the center of the screen to about 26 degrees, the line of sight continues to be seen. be able to.
As described above, the deflecting unit 104 may be configured such that the beam is incident on the pupil at different positions depending on the incident angle of the beam to the pupil, or may be a deflecting unit 104 that combines various deflection methods. For example, different deflection characteristics may be provided for the left eye and the right eye. It has the effect of compensating for the pupil misalignment of one eye with the other eye. Further, a deflection characteristic may be imparted so that the horizontal incident angle and the vertical incident angle of the beam to the pupil are different. There is an effect that the pupil shift generation condition can be made different between the horizontal field angle and the vertical field angle. Further, different deflection characteristics may be given to the light beams from the plurality of scanning units. There is an effect that a pupil deviation of a beam from a certain scanning unit can be compensated by a beam from another scanning unit.
With reference to FIGS. 6A to 6G, a variation in the deflection characteristics applied to the deflection unit 104 will be described. 6A is a diagram showing the deflection characteristics 801 described in FIGS. 4 and 5, and FIGS. 6B to 6G are diagrams showing other deflection characteristics 802 to 806R. 6A to 6G, a straight line that passes through the center of the pupil and is perpendicular to the deflection unit 104 is defined as a virtual line l, a region on the left side of the virtual line 1 of the deflection unit 104 is a left deflection region 104L, and a right side from the virtual line l. The region is a right deflection region 104R. The incident angle of the beam refers to an angle formed by the beam and the imaginary line l.
In the deflection characteristic 801 shown in FIG. 6A, the beam scanned from the scanning unit 103 to the left deflection region 104L passes through the region on the left side of the pupil center, and the beam scanned into the right deflection region 104R is the region on the right side of the pupil center. Passes through the center of the pupil. Further, in this deflection characteristic 801, all the deflected beams are condensed behind the center of the pupil (closer to the center of the eyeball). That is, the deflection focus is formed behind the pupil. As a result, when the eyeball is rotated to the left, in addition to the effect of continuing to see the left side of the screen, there is also an effect that the right side of the screen can gradually disappear from the right end side of the screen. In addition, there is an effect that does not require a large modification from the manufacturing method of the deflection unit 104 in the conventional method.
In addition, the deflection characteristic 801 shown in FIG. 6A can be applied not only in the horizontal direction but also in the vertical direction. Specifically, a beam that passes through the center of the pupil and scans the upper deflection area above the imaginary line perpendicular to the deflection unit 104 passes through the user's pupil in the area above the pupil center, and is below the imaginary line. The beam may be deflected so that the beam scanned into the lower deflection area passes through the user's pupil in the area below the pupil center.
Furthermore, as a modification of the deflection characteristic 801 shown in FIG. 6A, the distance from the pupil to the deflection focus may be made different between the horizontal direction and the vertical direction. If the distance in the vertical direction is made longer than the horizontal direction, the vertical eyeball rotation in which the pupil shift occurs can be increased, and the upper and lower angles of view in which the pupil shift does not occur can be widened. This method is effective because the horizontal angle of view is artificially widened by complementing the left and right eyes, but the vertical angle of view cannot be compensated by the left and right eyes.
In the above description, the deflection characteristics are defined independently in the horizontal direction and in the vertical direction, but the present invention is not limited to this and may be defined two-dimensionally. In this case, the screen areas to be displayed to the user will be described in terms of “screen center portion”, “screen middle portion”, and “screen edge portion” in order from the screen center. When the user's line of sight is in the center of the screen, the incident angle of the beam to the pupil is the smallest at the center of the screen and the largest at the end of the screen. On the other hand, among the user's pupils, a predetermined region including the pupil center will be described by the term “pupil central portion”, and the outer region will be described by the term “pupil end”.
6A, the deflection characteristic 801 shown in FIG. 6A deflects the beam at the center of the screen toward the center of the pupil, deflects the beam at the center of the screen toward the center of the pupil (excluding the pupil center), and The beam is deflected toward the end of the pupil. Similarly, the deflection characteristic 802 shown in FIG. 6B deflects the beam at the screen edge toward the pupil edge and deflects the beam at the screen center and the screen middle toward the pupil center (pupil center). Yes. Thereby, when the eyeball is rotated to the left, in addition to the effect of continuing to look at the left side of the screen, there is also an effect of increasing the eyeball rotation angle at which the middle portion of the right side of the screen can be continuously viewed.
A deflection characteristic 803 shown in FIG. 6C deflects the beam at the screen edge and the screen middle toward the pupil edge, and deflects the beam at the center of the screen toward the pupil center (pupil center). Thereby, in addition to the effect of continuing to look at the left side of the screen when the eyeball is rotated to the left, it is possible to increase the eyeball rotation angle at which the left middle portion of the screen can be continuously viewed even when the eyeball is further rotated to the left. There is also an effect.
The deflection characteristic 804 shown in FIG. 6D further modifies the deflection characteristic 803 of FIG. 6C to deflect the beam at the center of the screen toward the pupil end. As a result, in addition to the effect of continuing to look at the left side of the screen when the eyeball is rotated to the left, the effect of increasing the eyeball rotation angle that can continue to look at the center of the screen even when the eyeball is further rotated to the left There is also.
A deflection characteristic 805 shown in FIG. 6E further deforms the deflection characteristic 801 in FIG. 6A and deflects the beam at the edge of the screen to pass outside the pupil when the line of sight is at the center of the screen. As a result, when the eyeball is rotated to the left, in addition to the effect of continuing to see the left middle portion of the screen, there is also the effect of starting to see the left edge of the screen. Further, when the eyeball is rotated to the left, there is also an effect that the eyeball rotation angle at which the end of the screen can be continuously viewed can be increased.
6F and 6G show the deflection characteristic 806L of the beam that is scanned into the left deflection region 104L and the beam that is scanned into the right deflection region 104R, and the incident angle of the beam to the pupil and the beam to the pupil. The beam is deflected so that the distance between the incident position and the pupil center is asymmetrical with respect to the virtual line l.
Specifically, the deflection characteristic 806L shown in FIG. 6F deflects the beam on the left side of the screen in the same manner as the deflection characteristic 801 shown in FIG. 6A, and deflects the beam on the right side of the screen in the same way as in FIG. . That is, the incident angle of the beam scanned to the left deflection region 104L is smaller than that of the beam scanned to the right deflection region 104R, and the incident position of the beam scanned to the left deflection region 104L and the pupil center are The beam is deflected so that the distance becomes larger than the beam scanned to the right deflection region 104R.
Similarly, the deflection characteristic 806R shown in FIG. 6E deflects the beam on the right side of the screen in the same manner as the deflection characteristic 801 shown in FIG. 6A, and deflects the beam on the left side of the screen in the same way as in FIG. That is, the incident angle of the beam scanned into the right deflection region 104R is smaller than the beam scanned into the left deflection region 104L, and the incident position of the beam scanned into the right deflection region 104R and the pupil center are The beam is deflected so that the distance becomes larger than the beam scanned in the left deflection region 104L.
For example, when the eyeball is rotated to the left by providing the deflection characteristic 806L to the deflection unit 104 for the left eye and the deflection characteristic 806L to the deflection unit 107 for the right eye, There is an effect that you can continue to see. Further, when the eyeball is rotated to the right, there is an effect that the right eye can continue to see the right side of the screen.
Note that the method of the present invention as shown in FIG. 4 may be combined with the method of providing a plurality of deflection focal points as shown in FIG. Further, the deflecting units 104 and 107 move or rotate the deflecting units 104 and 107 and the scanning units 103 and 108 in order to deflect the beam so that it passes through the pupil at different positions depending on the beam incident angle to the pupil. You may use the method.
In the first embodiment, a method of drawing an image by two-dimensionally scanning a beam will be described. However, display light from a two-dimensional image display element such as a liquid crystal is condensed in the vicinity of the pupil (Maxwell view and The deflecting units 104 and 107 may be deflected as described above.
1A to 2 may be included in one casing or may be included in a plurality of casings. For example, the light sources 101 and 110 may be included in a separate housing from the scanning units 103 and 108, or the headphone units 106 and 112 may not be provided. Moreover, each part may be distributed. For example, the control units 105 and 111 may be partly included in the light sources 101 and 110 and the scanning units 103 and 108. There may be a plurality of each part. For example, there may be two scanning units for the left eye and the right eye. Further, each unit may be shared by a plurality of devices. For example, the light source 101 may be shared by two display devices.
With the above configuration, in the display device of the present invention, the deflecting units 104 and 107 deflect so that the beam enters the pupil at different positions according to the beam incident angle to the pupil. This has the effect of reducing the problem of pupil misalignment without having a plurality of deflection focal points.
Since there is no need to provide a plurality of deflection focal points, there are problems associated with a plurality of deflection focal points, such as a case where a double image is drawn on the retina, a problem that the light utilization efficiency of the beam is reduced, and a high output light source. Issues required, increased power consumption, complicated manufacturing methods of the deflecting units 104 and 107, reduced characteristics of the deflecting units 107 and 107, and complicated display device as a whole There is also an effect that can be avoided.
With reference to FIG. 7, the display apparatus 10 which concerns on Embodiment 2 of this invention is demonstrated. FIG. 7 is a schematic configuration diagram of the display device 10.
The display device 10 according to the second embodiment includes image output units 3R and 3L that output the emitted light 2, and a deflecting unit that deflects the emitted light 2 toward the user's eyes 8R and 8L (condensing positions 11R and 11L). 15, control units 5R and 5L that control the image output units 3R and 3L, and an overall control unit 6 that controls the processing of the control units 5R and 5L. The image output units 3R and 3L include light sources 1R and 1L, scanning units 4R and 4L that two-dimensionally scan the emitted light 2 from the light sources 1R and 1L, and a light detection unit 17. The deflecting unit 15 includes hologram mirrors 15R and 15L arranged at positions facing the left and right eyes 8R and 8L, respectively. As in the above configuration, the display device 10 shown in the second embodiment includes a bilaterally symmetric optical system, and emits light 2 emitted from the light sources 1R and 1L to the condensing positions 11R and 11L of the left and right eyes 8R and 8L. Guided.
Next, the operation of the display device 10 configured symmetrically will be specifically described focusing on the operation of the optical system. Here, the operation of the optical system on the right side of the symmetric optical system will be described as an example.
As shown in FIG. 7, the light source 1R includes at least a blue laser light source (hereinafter referred to as “B light source”) 13b, a red laser light source (hereinafter referred to as “R light source”) 13r, and a green laser light source (hereinafter referred to as “G light source”). The light source 13 includes an RGB light source 13 including 13 g. Then, the intensity of the laser light emitted in time series using the RGB light source 13 is modulated according to the magnitude of the input current, thereby outputting an image projected on the retina 8a. With such a configuration, it is possible to realize a display device 10 with good color reproducibility, small size and low power consumption.
Here, a semiconductor laser that emits laser light having a wavelength of 450 nm and a wavelength of 650 nm is used for the B light source 13b and the R light source 13r, and a SHG laser excited by a semiconductor laser that emits laser light having a wavelength of 530 nm is used for the G light source 13g. Used. The laser light 14 emitted from the B light source 13b and the R light source 13r is converted into parallel rays by the lens 14c and emitted from the light source 1R. Further, a parallel light beam is emitted from the G light source 13g.
The scanning unit 4R includes a movable mirror 4a, and two-dimensionally scans the laser light 14 from the light source 1R toward the hologram mirror 15R.
The hologram mirror 15R deflects the laser light 14 scanned by the scanning unit 4R in a direction toward the user's eyes (condensing position 11R). The display device 10 includes a deflection unit position adjustment unit 16 that moves the deflection unit 15 in a direction (horizontal direction in FIG. 7) that intersects the user's line-of-sight direction (vertical direction in FIG. 7). The deflecting unit position adjusting unit 16 includes driving units 16L and 16R that move the left and right hologram mirrors 15L and 15R independently.
The laser beams 14 emitted from the light source 1R are combined into one by the reflection mirror 14a and the dichroic mirror 14b and enter the movable mirror 4a of the scanning unit 4R. Then, the laser light 14 is scanned as the outgoing light 2 on the reflecting surface 15a of the hologram mirror 15R by the movable mirror 4a.
The emitted light 2 is reflected by the reflecting surface 15a of the hologram mirror 15R and enters the pupil 7 of the right eye 8R, and then projects an image on the retina 8a. Since the outgoing light 2 is scanned in a two-dimensional plane on the reflecting surface 15a of the hologram mirror 15R, the movable mirror 4a rotates not only in the horizontal direction (left and right direction) but also in a direction perpendicular thereto. Can do. The operation of the left optical system of the display device 10 is performed using the left hologram mirror 15L as described above.
Here, the distance between the center lines 18 of the pupils 7 of the right eye 8R and the left eye 8L is defined as the inter-pupil distance 9. Further, the distance between the condensing position 11R of the outgoing light 2 reflected by the reflecting surface 15a of the hologram mirror 15R and the condensing position 11L of the outgoing light 2 reflected by the reflecting surface 15a of the hologram mirror 15L is set between the condensing positions. It is defined as distance 12.
In the display device 10 configured as described above, the hologram mirror 15R and the hologram mirror 15L are arranged in such a positional relationship that the distance 9 between the pupils of the observer and the distance 12 between the condensing positions are different from each other. That is, the condensing positions 11 </ b> L and 11 </ b> R where the emitted light 2 incident on the left and right pupils 7 is focused are shifted symmetrically from the center line 18 of the pupil 7.
With this configuration, when the pupil 7 is moved by the rotation of the eyes 8R and 8L, part of the outgoing light 2 incident on one of the left and right eyes 8R and 8L is blocked by the iris 8b. The outgoing light 2 is not blocked by the iris 8b. As described above, since the image can be seen with at least one of the eyes 8R and 8L, the display device 10 with less missing image output can be realized.
8A and 9A are enlarged views of main parts of the display device 10 according to the second embodiment, and FIGS. 8B and 9B are enlarged views of main parts of the conventional display device for comparison with FIGS. 8A and 9A.
FIG. 8A and FIG. 8B show an enlarged view of the main part including the optical system in the vicinity of the left eye 8L of the display device. In FIG. 8A, the condensing position 11L of the emitted light 2 that displays the projected image 20 is slightly closer to the left side than the center line 18 of the left eye 8L. On the other hand, in FIG. 8B, the condensing position 11L is on the center line 18 of the left eye 8L and is located in the center even when viewed from the left and right irises 8b.
9A and 9B show the output light 2 and the left eye when the left eye 8L is moved to the left without moving the face from the state of FIGS. 8A and 8B and the left side is viewed from the center of the image 20. The optical positional relationship with 8L is shown.
As shown in FIG. 9B, in the conventional display device, when the left image 20L is viewed, the right image 20R is blocked by the iris 8b and cannot be seen. However, in the display device 10 shown in FIG. 9A as shown in FIG. 9A, the condensing position 11L is slightly closer to the left side than the center line 18 of the left eye 8L, so the right image 20R is also blocked by the iris 8b. It looks without being.
9A and 9B show the case of the left eye 8L, the same result is obtained in the case of the right eye 8R. That is, in the conventional display device, when the eyes 8R and 8L are rotated so as to look at the left side or the right side of the video 20, the video 20 on the opposite side is blocked by the iris 8b almost simultaneously and becomes invisible.
On the other hand, in the display device 10 shown in the second embodiment, when the eyes 8R and 8L are rotated so as to look at the left side or the right side of the video 20, the opposite video is at least one of the eyes 8R and 8L. It can be seen that Therefore, when the pupil 7 is moved by the rotation of the eyes 8R and 8L, the video 20 can be seen with at least one of the eyes 8R and 8L, and thus there is no lack of video output. 10 can be realized.
The display device 10 according to the second embodiment configured as described above further includes a light detection unit 17 that detects the reflected light 2b from the pupil 7 in each of the left and right eyes 8R and 8L, as shown in FIG. The control unit 5 and the overall control unit 6 control at least one of the intensity of the emitted light 2 emitted from the image output units 3R and 3L and the position of the deflection unit 15 based on the signal of the light detection unit 17. Yes.
With reference to FIG. 10A, FIG. 10B, and FIG. 11, the control units 5L and 5R, the overall control unit 6, and the light detection unit 17 of the display device 10 according to Embodiment 2 will be described. 10A is a schematic configuration diagram of the light detection unit 17, FIG. 10B is a diagram illustrating another form of the light detection unit 17, and FIG. 11 is a functional block diagram of the display device 10.
The light detection unit 17 according to the second embodiment detects reflected light from the user's eyes, so that the emitted light 2 is incident on the pupil 7 or the emitted light 2 is blocked by the iris 8b and is blocked in the pupil 7. Detect whether it was incident. Further, the center position of the pupil 7 is detected from the intensity of the reflected light.
As shown in FIG. 10A, the reflected light 2b is incident on the light detection unit 17, and the two dichroic mirrors 17a and 17b cause blue laser light (hereinafter referred to as “B light”) 2B and green laser light (hereinafter referred to as “ G light ”2G and red laser light (hereinafter referred to as“ R light ”) 2R, and are detected by the respective light detection units 17B, 17G, and 17R. The detected optical signal is converted into an electrical signal, transmitted to the light reception control unit 17c via the wiring 19, and then transmitted to the control units 5L and 5R and the overall control unit 6.
Similarly, as shown in FIG. 10B, the reflected light 2b is incident on the light detection unit 17, and the diffraction grating 17g causes blue laser light (hereinafter referred to as “B light”) 2B and green laser light (hereinafter referred to as “G”). 2G) and red laser light (hereinafter referred to as “R light”) 2R, and are detected by the respective light detection units 17B, 17G, and 17R. The detected optical signal is converted into an electrical signal, transmitted to the light reception control unit 17c via the wiring 19, and then transmitted to the control units 5L and 5R and the overall control unit 6.
In this way, by spectroscopically detecting the reflected light 2b for each wavelength band, it is possible to detect the color of the iris 8b that differs depending on the observer, so it is possible to accurately detect whether the light ray is blocked by the iris 8b. It becomes like this.
Next, referring to FIG. 11, the overall control unit 6 uses the light amount control unit 61 that controls the light amount of the laser light 14 output from the light sources 1 </ b> R and 1 </ b> L, and the deflection unit 15 using the deflection unit position adjustment unit 16. And a deflection unit position control unit 62 for controlling the position of.
Based on the detection result of the light detection unit 17, the light amount control unit 61 determines whether both of the hologram mirror 15L and the beam deflected by the hologram mirror 15L are incident on the user's eyes 8R and 8L, or one of them. It is determined whether or not the beam has entered the user's eyes 8R and 8L. When it is determined that one of the beams does not enter the user's eyes 8R and 8L, the light amount of the other beam is increased in the light sources 1R and 1L.
With this configuration, the intensity of the reflected light 2b is low when the emitted light 2 passes through the pupil 7 and reaches the retina 8a, and the intensity of the reflected light 2b when the emitted light 2 is reflected by the iris 8b. Therefore, based on the reflected light intensity, it is determined which of the eyes 8R and 8L is observing with the eyes 8R and 8L, or both of the eyes 8R and 8L are observing, and the information is obtained. Basically, the right and left control units 5L and 5R and the overall control unit 6 can control the increase / decrease in the amount of the emitted light 2 to allow the observer to observe an image with appropriate brightness.
That is, when the light is visible to both eyes, the light amount of the light sources 1R and 1L is reduced, and when the light is visible only with one eye, the light amount is increased to suppress fluctuations in the light amount when the pupil 7 is moved. A video 20 that is easier to see can be obtained.
Further, the deflection unit position control unit 62 calculates the pupil distance 9 of the user based on the detection result of the light detection unit 17. Then, the deflection mirror position adjustment unit 16 is controlled to move the hologram mirror 15L and the hologram mirror 15R so that the condensing position distance 12 is different from the calculated pupil distance 9.
By adopting such a configuration, even when observers with different inter-pupil distances 9 use the same display device 10 as in the second embodiment, the deflection mirror position adjusting unit 16 is used to change the hologram mirror 15L and the hologram mirror 15R. Can be easily moved to a position facing the eyes 8R and 8L. Therefore, since the distance 12 between the condensing positions can be appropriately set for each observer, the observer can observe an image without any missing image output.
In FIG. 11, an example in which the light amount control unit 61 and the deflection unit position control unit 62 are included in the overall control unit 6 is shown, but the present invention is not limited to this and is included in either the control unit 5R or the control unit 5L. Alternatively, the processing may be shared by the control unit 5R, the control unit 5L, and the overall control unit 6.
The drive units 16L and 16R constituting the deflection unit position adjustment unit 16 may be actuators controlled by the control units 5L and 5R and the overall control unit 6 or along rails attached to the frame. The left and right hologram mirrors 15L and 15R may be manually moved.
Furthermore, in the second embodiment, the example in which the condensing positions 11L and 11R are shifted in the horizontal direction (left and right direction) with respect to the center line 18 for each of the right eye 8R and the left eye 8L has been described. 11L and 11R do not have to be located on a horizontal line connecting the two left and right pupils, and at least one of them may be located off the horizontal line. That is, it may be located above or below the pupil or in an oblique direction. However, it is preferable that the left and right pupils are shifted symmetrically. In this case, it is possible to prevent the screen from disappearing when the eyes are rotated in the vertical direction.
A display device 30 according to Embodiment 3 of the present invention will be described with reference to FIG. FIG. 12 is a diagram illustrating a schematic configuration diagram of the display device 30. The basic configuration of the display device 30 is the same as that of the display device 10 shown in FIG. 7, and therefore, detailed description of the common points will be omitted, and differences will be mainly described.
In the display device 30 according to the third embodiment, the hologram mirror 15L and the hologram mirror 15R project images with different visual fields 31 onto the retinas 8a of the eyes 8R and 8L, respectively. In addition, the area | region enclosed with the elliptical broken line in FIG. 12 shows the visual field 31, and has shown the left visual field 31L and the right visual field 31R, respectively. Here, the distance 9 between the pupils and the distance 12 between the condensing positions, which is the distance between the condensing positions 11L and 11R, have the same length.
With such a configuration, when the pupil 7 is moved by the rotation of the eyes 8R and 8L, the observer can make the image visible with at least one of the eyes 8R and 8L. As a result, it is possible to realize the display device 30 with no missing image output and to visually recognize the entire video output from the image output unit 3.
FIG. 13 is an enlarged view of a main part of the display device 30 according to the third embodiment. That is, FIG. 13 shows an enlarged view of the main part including the optical system in the vicinity of the eyes 8R and 8L of the display device 30. In FIG. 13, the condensing positions 11L and 11R where the emitted light 2 for displaying the projected image 20 is collected in the pupil 7 are located on the center line 18 of the eyes 8R and 8L, but the left eye 8L and the right eye The left and right visual fields 31L and 31R with respect to the center line 18 are different from 8R. The left eye 8L condenses the emitted light 2 from the hologram mirrors 15L and 15R into the pupil 7 so that the visual field on the left side of the center line 18 is wide and the right eye 8R has a wide visual field on the right side of the central line 18.
In order to display images with different fields of view on the left and right eyes 8R and 8L of the user, the hologram mirror 15L according to the third embodiment passes through the center of the pupil and is a center line (virtual line) 18 perpendicular to the hologram mirror 15L. The incident angle of the beam on the pupil of the beam scanned in the left deflection region on the left side and the beam scanned in the right deflection region on the right side from the center line 18 is asymmetrical with respect to the center line 18. It has a deflection characteristic for deflecting the beam. In FIG. 12, the incident angle of the beam scanned into the left deflection area is larger than the incident angle of the beam scanned into the right deflection area.
Similarly, the hologram mirror 15R passes through the center of the pupil and scans the left side deflection area on the left side of the center line (virtual line) 18 perpendicular to the hologram mirror 15R and the right side deflection area on the right side of the center line 18. The deflected beam has a deflection characteristic that deflects the beam so that the incident angle of the beam to the pupil is asymmetrical with respect to the center line 18. In FIG. 12, the incident angle of the beam scanned into the right deflection area is larger than the incident angle of the beam scanned into the left deflection area.
FIG. 14 is an enlarged view of a main part of the display device 30 according to the third embodiment when the eyes 8R and 8L are rotated. That is, when the eyes 8R and 8L are moved without moving the face from the state of FIG. 13 and the left side is viewed from the center of the image 20, the optical between the emitted light 2 and the eyes 8R and 8L is obtained. The positional relationship is shown. At this time, in the left and right eyes 8L and 8R, the left and right visual field ranges with respect to the center line 18 of the left visual field 31L and the right visual field 31R in the hologram mirrors 15L and 15R are different. As shown in FIG. 4, the video 32L and the video 32R are obtained. Here, in the right eye 8R, a part of the image 32 is obstructed by the iris 8b and is missing as shown in the image 32R. However, in the left eye 8L, since the visual field range on the right side of the center line 18 is made compact, the entire image 20 is clearly projected on the retina 8a.
With such a configuration, when the pupil 7 is moved by the rotation of the eyes 8R and 8L, the observer can make the image visible with at least one of the eyes 8R and 8L. As a result, it is possible to realize the display device 30 with no missing image output and to visually recognize the entire video 20 output from the image output unit 3.
As in the second embodiment, the distance 9 between the pupils of the observer and the distance 12 between the condensing positions may be different. By adopting such a configuration, even when the pupil 7 is further moved by the rotation of the eyes 8R and 8L, the image can be seen with at least one of the eyes 8R and 8L. It is possible to realize the display device 30 that has no missing output.
Moreover, it is good also as a structure further provided with the deflection | deviation part position adjustment part 16 which moves the position which opposed the eyes 8R and 8L of the hologram mirror 15L and the hologram mirror 15R. With such a configuration, even when observers with different inter-pupil distances 9 use the same display device 30 of the present invention, the right and left deflection units 15 can be easily moved to the eyes 8R using the deflection unit position adjustment unit 16. , 8L can be moved to a position facing. Therefore, since the distance 12 between the condensing positions can be appropriately set for each observer, the observer can observe an image without any missing image output.
In the third embodiment, as in the second embodiment, the condensing positions 11L and 11R do not have to be located on the horizontal line connecting the two left and right pupils, and at least one of the positions is deviated from the horizontal line. May be. That is, it may be located above or below the pupil or in an oblique direction. However, it is preferable that the left and right pupils are shifted symmetrically.
A display device according to Embodiment 4 of the present invention will be described with reference to FIGS. 1A, 1B, 2, and 15. FIG. FIG. 15 is a functional block diagram of the display device. The configuration shown in FIGS. 1A, 1B, and 2 is the same as that of the first embodiment, and a description thereof will be omitted.
In the display device according to the fourth embodiment, the deflection units 104 and 107 have a plurality of focal points as countermeasures for pupil misalignment. Specifically, the deflection units 104 and 107 deflect deflection characteristics so that the beams scanned by the scanning units 103 and 108 are focused on a first focal point and a second focal point different from the first focal point. Have That is, the deflecting units 104 and 107 have a function of branching the beams from the scanning units 103 and 108 into a beam toward the first focus and a beam toward the second focus. The deflection units 104 and 107 having the above-described configuration can be manufactured by a conventional method for manufacturing a hologram mirror. For example, it can be manufactured by devising a combination of object light and reference light.
The control unit 105 includes an integrated circuit that controls each unit of the HMD. Further, a communication unit that wirelessly connects to a peripheral device such as a mobile phone and receives a video / audio signal may be provided.
The control unit 105 visually recognizes the user before and after the change of the pupil position in response to the pupil position changing from the position including the first focus to the position including the second focus due to the rotation of the user's eyeball. The output of the image output unit 100 is controlled so that the virtual image can be seen in the same direction. At the same time, the output of the image output unit 100 is controlled so that the size of the virtual image visually recognized by the user before and after the change of the pupil distance is the same.
Note that in a display device that displays a virtual image at infinity, “the virtual image looks in the same direction” means that the beam that draws the same pixel before and after the change in the pupil position is transmitted from the deflecting units 104 and 107 to the user's eyes. It means that it becomes substantially parallel in the region toward
Specifically, as shown in FIG. 15, the control unit 105 includes a pupil position detection unit 1051A, an output image control unit 1052A, and a scanning angle control unit 1053A.
The pupil position detection unit 1051A detects a change in the pupil position, which is the position of the user's pupil center, based on the detection result of the light detection unit 214.
The output image control unit 1052A applies the light sources 101 and 110 so that the beam for drawing the same pixel is substantially parallel in the region from the deflection units 104 and 107 toward the user's eyes before and after the change of the pupil position. The beam for drawing each pixel is shifted in the direction in which the pupil position of the user has changed and output. Further, the output of the image output unit 100 is controlled so that the size of the virtual image visually recognized by the user before and after the change in the pupil distance is the same.
The scanning angle control unit 1053A scans the scanning units 103 and 108 so that the beam for drawing the same pixel is substantially parallel in the region from the deflecting units 104 and 107 toward the user's eyes before and after the change of the pupil position. The beam for drawing each pixel is shifted in the direction in which the pupil position of the user has changed and scanned.
In the fourth embodiment, a method of drawing an image by two-dimensionally scanning a beam will be described. However, display light from a two-dimensional image display element such as a liquid crystal is condensed near the pupil (Maxwell view). The deflecting units 104 and 107 may be deflected as described above.
Next, the display device of FIG. 1A and FIG. 1B sets the display position and size of the output video in a direction to reduce the change in the position and size of the display video caused by the switching of the focus position corresponding to the pupil position. The flow of operation to change is demonstrated using FIG.16 and FIG.17. Although only the processing for the left eye side will be described below, the same processing needs to be performed for the right eye side.
(S01) The light detection unit 214 detects the pupil position, and proceeds to the operation of S02. The light detection unit 214 detects the intensity of beam reflected light from the user's eyes. The cornea on the surface of the eye has an aspherical shape, and only when the beam is incident from the front of the eye, the beam is incident on the cornea surface and reflected vertically to detect reflected light with a higher intensity. . Therefore, the pupil position detection unit 1051A of the control unit 105 can estimate that the beam passes through the center of the pupil perpendicular to the pupil plane when strong reflected light is detected. Since the incident position and direction of the beam on the eye can be calculated based on the scanning angle of the scanning unit 103 at that time, the pupil position can be estimated using the reflected light.
The method for detecting the reflected light in S01 and the method for detecting the line of sight using the reflected light in S02, which will be described later, can be performed by using the reflected light of the beam scanned by the scanning unit 103 as shown in the fourth embodiment. Alternatively, a method using reflected light of a light source different from the above beam may be used. For example, in Patent Document 5, line of sight detection is realized by detecting infrared light reflected by an eye emitted from an infrared light emitting diode with an image sensor. Further, in Patent Document 6, line-of-sight detection is realized by detecting reflected light of the beam scanned by the scanning unit with an image sensor.
The intensity of the reflected light from the eye may be represented by a ratio between the intensity of the emitted light modulated by the light source 101 and the intensity of the reflected light detected by the light detection unit 214. Thereby, there is an effect that the influence of the intensity change of the emitted light accompanying the change of the display image can be reduced. Further, the reflected light may be detected while scanning light that is not felt by the eye, such as infrared rays, at a constant intensity. Alternatively, the focal point of the infrared deflecting unit 104 may be set to a position different from the focal point of visible light, for example, by setting the focal point of the eyeball to the center of rotation, and may be a position suitable for detection of the pupil position. Thereby, there is an effect that the reflected light can be detected independently of the change of the display image.
Instead of using the light detection unit 214, a method of photographing the eye with a camera and detecting the pupil position from the photographed image may be used. Further, the pupil position may be detected by detecting an electrical signal from a muscle related to eyeball rotation. Alternatively, a method of inducing eyeball rotation and estimating the pupil position by changing the display position of information in the screen may be used.
In addition to detecting the pupil position, the pupil size (diameter) may be detected. The pupil size may be measured using reflected light from the pupil or iris, or may be a method of estimating the pupil size by detecting the surrounding brightness.
If the reflected light cannot be detected in S01, the pupil position may be set as a predetermined value. For example, when the reflected light cannot be detected because the beam has not been output yet, the pupil position may be set on the assumption that the line of sight is directed toward the center of the screen.
(S02) The pupil position detection unit 1051A of the control unit 105 determines the focal position corresponding to the pupil position, and proceeds to the operation of S03. Since the focal position is known at the time of manufacturing the deflecting units 104 and 107, the focal position closest to the pupil position obtained in S01 is determined as the “focal position corresponding to the pupil position”.
In the example of FIG. 17, the deflecting unit 104 has two focal points, a focal point A and a focal point B, and the beam incident on the deflection position A is deflected to the focal point A and the focal point B, and similarly to the deflection position B. The incident beam is also deflected to the focal point A and the focal point B. Here, when the pupil position is detected as the pupil position A in S01, the focus A is determined as the “corresponding focal position” in S02. When the pupil position is detected as the pupil position B, the focal point B is determined as the “corresponding focal point position”.
A method other than the method of selecting the focal position closest to the pupil position may be used. For example, when there are a plurality of focal positions in the pupil, any of them may be selected, and when there is no focal position in the pupil, any focal position may not be selected and display may not be performed during that time. .
(S03) The pupil position detection unit 1051A of the control unit 105 determines whether or not the focus position determined in S02 is different from the focus position determined last time. If different, the process proceeds to S04, and if the same, the process proceeds to S06. When the previous determination result cannot be obtained, it may be regarded as “different” and the operation may proceed to S04.
(S04) The output image control unit 1052A of the control unit 105 corrects the display position of the image, and proceeds to the operation of S05. If the previous focal position is different from the current focal position, the display position is corrected so that the image is incident on the front of the head from the same angle. Specifically, before and after the change of the pupil position, the beam for drawing each pixel on the light source 101 so that the beam for drawing the same pixel is substantially parallel in the region from the deflection unit 104 toward the user's eyes. Are shifted in the direction in which the pupil position of the user has changed.
In the example of FIG. 17, when the pupil position before the eyeball rotation is A and the pupil position after the rotation is the pupil position B, the image displayed at the deflection position A is displayed at the deflection position B along with the rotation. Correct the display position. With this correction, an image that has been seen from the pupil position A in the direction A1 can be seen from the pupil position B in the same direction A2 as the direction A1, and the deviation of the image position due to eyeball rotation can be corrected.
When the virtual screen is at a distance of infinity ahead of the direction A1, the direction A2 is the same as the direction A1, but when the distance to the virtual screen is short, both the direction A1 and the direction A2 are in the virtual screen. The direction A2 is set so as to go to one point, and the display position is corrected.
Instead of the output image control unit 1052A, the scanning angle control unit 1053A may perform the above processing. Specifically, before and after the change of the pupil position, each of the scanning units 103 and 108 is set so that the beam for drawing the same pixel is substantially parallel in the region from the deflecting units 104 and 107 toward the user's eyes. The beam for drawing the pixels is shifted and scanned in the direction in which the pupil position of the user has changed.
When the head is rotated, a method of changing the display position according to the rotation angle may be adopted. In that case, it is good also as a change which combined the display position change by head rotation, and the display position change by the correction | amendment of this invention.
(S05) The output image control unit 1052A of the control unit 105 corrects the display size of the image, and proceeds to the operation of S06. When the previous focal position is different from the current focal position, the display size is corrected so that the viewing angle between two different points in the video does not change regardless of the focal position.
In the example of FIG. 17, when the pupil position before the eyeball rotation is A and the pupil position after the rotation is the pupil position B, the displayed video is enlarged and displayed with the rotation. Since the distance B from the pupil position B to the deflection position B is longer than the distance A from the pupil position A to the deflection position A, the ratio B / A times that is the ratio is enlarged to display the focus. Even when moving from the position A to the focal position B, the viewing angle between two different points in the video does not change, so that the shift in the video size accompanying the eyeball rotation can be corrected.
Note that only one of the display position correction in S04 and the display size correction in S05 may be corrected. The output image control unit 1052A and the scanning angle control unit 1053A may share processing. For example, the scanning angle control unit 1053A may be in charge of the display position correction in S04, and the output image control unit 1052A may be in charge of the display size correction in S05.
In FIG. 17, the beam from one scanning unit 103 is deflected to a focal point A and a focal point B, but a plurality of scanning units and light sources corresponding to a plurality of focal points may be provided. Then, the image light passing through the focus A and the image light passing through the focus B can be controlled independently, and the operations of S04 and S05 can be performed simultaneously at the focus A and the focus B independently. As a result, even when the focal point A and the focal point B are in the pupil at the same time, and the image via the focal point A and the image via the focal point B overlap on the retina, there is an effect that the overlapping portion of the image can be matched without shifting. Furthermore, in order to reduce the brightness of the overlapped portion being added and brightened, if the brightness of the overlapped portion is previously weakened with a light source, there is an effect of reducing the problem of the overlapped portion being brightened.
(S06) The light source 101 controls the output of the beam, and proceeds to the operation of S07. When the display position and the display size are corrected in S04 and S05, the output of the beam is controlled so that a corrected image is obtained.
By appropriately modulating the intensity of the beams output from the red laser light source 211, the blue laser light source 212, and the green laser light source 213, the hue, saturation, and brightness of the pixels displayed on the retina are expressed. In addition to the output control described above, correction control may be performed in consideration of the influence of the optical system from the light source 101 to the eye, such as the scanning unit 103 and the deflection unit 104.
For example, since the beam from the scanning unit 103 is obliquely incident on the deflecting unit 104, the display area is distorted to a shape other than a rectangle such as a trapezoid. Therefore, laser output control may be performed in conjunction with the scanning unit 103 so that the display area is a display area that has been reversely corrected in advance so as to be rectangular.
Note that when a part of the image is outside the deflection region of the deflection unit 104 due to the correction of the display position and size, a method of not outputting a part of the image may be used. Further, in order to avoid a situation in which the image is not output, an image may be output in advance to only a part of the deflection area so that the image can be continuously output after correction.
(S07) The wavefront shape changing unit 102 changes the wavefront shape of the beam from the light source 101 so that the beam spot size on the retina is within a predetermined range, and proceeds to the operation of S08. Since the beam spot size on the retina changes depending on the positional relationship between the scanning unit 103, the deflecting unit 104, the pupil and the retina, etc., the beam spot size depends on the change of the pupil position, the change of the scanning angle, and the change of the deflecting unit position. , Change the wavefront shape of the beam. For example, when it is desired to change the horizontal focal length of the wavefront shape, the horizontal focal length is changed by changing the distance between the cylindrical lens and the mirror of the focal length horizontal component changing unit 201 of the wavefront shape changing unit 102. Similarly, when it is desired to change the vertical focal length, the focal length vertical component changing unit 202 changes it.
(S08) The scanning unit 103 changes the scanning angle of the beam from the wavefront shape changing unit 102 by changing the tilt of the MEMS mirror, and the operation proceeds to S09. When the scan angle is changed by the scan angle control unit 1053A, the changed scan angle is set.
(S09) The deflecting unit 104 deflects the beam from the scanning unit 103 to a plurality of focal positions set near the user's pupil, and proceeds to the operation of S01. The beam deflected by the diffraction effect of the hologram mirror of the deflecting unit 104 passes through the pupil, reaches the retina, and is perceived as an image by the user.
Note that a series of processing from S06 to S09 may be executed sequentially, may be executed simultaneously, or the execution order may be switched. Thereby, it is possible to make an appropriate order according to the time difference or delay from the start of execution of each means to preparation, actual operation, post-processing, and completion of execution, and the total processing time can be shortened.
Further, the frequency of executing the processes from S01 to S05 may be different from the frequency of executing the processes from S06 to S09. You may move to operation | movement of S06 after execution of S09.
Furthermore, the operations from S01 to S09 may be processing operations with probability. For example, the probability that the focal position has changed may be expressed stochastically, such as 50%. As a result, even when the predicted value is uncertain, there is an effect that a higher image quality can be displayed than when there is no prediction.
With the above operation, it is possible to realize an operation of drawing an image on the retina of the user's eye with the corrected display position and display size as the eyeball rotates.
FIG. 18 is a diagram illustrating a corrected display example. When the pupil position moves to the left with respect to the user's head, the heart of the display image is enlarged and displayed by moving the display position to the left. Similarly, when the pupil position moves to the right, the heart moves to the right and is enlarged and displayed. By correcting the display position and size, it is possible to make the image position and size not change even if the user moves his / her eyes.
With the configuration and operation described above, in the display device of the present invention, when the deflecting units 104 and 107 deflect the display light to a plurality of focal positions corresponding to changes in the pupil position due to eyeball rotation, the focal position corresponding to the pupil position. This has the effect of reducing the change in the position and size of the display image that accompanies switching. In addition, since the position and the size change become larger as the deflection units 104 and 107 are closer to the eyes, this configuration has an effect that the deflection units 104 and 107 can be arranged closer to the eyes. In addition, as a countermeasure against pupil misalignment, the problem of the method of providing the deflecting units 104 and 107 with a plurality of focal points is solved, and as a result, an HMD having a wide angle of view and a large screen that easily causes pupil misalignment can be realized.
In the fourth embodiment, the control unit 105 performs control. However, a method performed by the control unit 111 may be used, or a method in which processing is shared by the two control units 105 and 111 may be used.
A display apparatus according to Embodiment 5 of the present invention will be described with reference to FIGS. 1A, 1B, and 2. FIG. The configuration shown in FIGS. 1A, 1B, and 2 is the same as that of the first embodiment, and thus description thereof is omitted. The display device according to the fifth embodiment is configured such that the user can continue to view the image even when the glasses shift occurs.
As shown in FIGS. 19A and 19B, the deflecting unit 104 according to the fifth embodiment has a plurality of focal points A and B as a countermeasure against mounting pupil misalignment. Since the beam scanned by the scanning unit 103 is reflected by the deflecting unit 104 so as to pass through the focal point A and the focal point B, an image can be seen by the beam passing through the focal point A in FIG. In FIG. 19B later, the image can be seen by the beam passing through the focal point B.
In FIG. 19B, because of the occurrence of glasses misalignment, the deflection unit 104 of the glasses lenses 121 and 122 moves downward and far away from the eyeball. As a result, the focus A and the pupil position are shifted. In comparison, the focal point B above and far from the deflecting unit 104 corresponds to the pupil position. As shown in FIG. 19B, the position of the focal point B is set so that the inclination of the line connecting the focal point A and the focal point B is the same as the inclination of the movement in which the deflection unit 104 is displaced due to the glasses shift. That is, the focal point A and the focal point B are located on a straight line parallel to the ridgeline of the user's nose.
Further, if the distance from the focal point A to the focal point B is set to be equal to or larger than the pupil width (height) in the vertical direction and equal to or smaller than the pupil width in the horizontal direction, when the glasses-type HMD moves downward with respect to the face, a plurality of focal points are obtained. The situation where a plurality of beams from the laser beam are incident on the pupil can be reduced, and the situation where the beam is not incident from any of the focal points can also be reduced.
Instead of giving the deflecting unit 104 a plurality of focal points, a method of moving the focal point by moving or rotating the deflecting unit 104 or the scanning unit 103 may be used. For example, with reference to FIG. 20, another example for preventing the wearing pupil shift will be described. FIG. 20 is a functional block diagram of the display device according to the fifth embodiment.
As shown in FIG. 20, the display device includes a rotator 215, a relative position calculation unit 1051B, and a scanning unit position adjustment unit 1052B. The rotating body 215 is disposed at a position that contacts the user's nose between the lenses 121 and 122. On the other hand, the relative position calculation unit 1051B and the scanning unit position adjustment unit 1052B are included in the control unit 105.
The rotating body 215 rotates as the deflecting units 104 and 107 move in the vertical direction. The relative position calculation unit 1051B detects a change in the relative position between the user's pupil center and the deflection units 104 and 107 from the rotation angle of the rotator 215. The rotator 215 and the relative position calculation unit 1051B constitute a relative position detection unit 120 that detects a change in the relative position between the user's pupil center and the deflection units 104 and 107.
In response to the detection result of the relative position detection unit 120, the scanning unit position adjustment unit 1052B changes the scanning unit 103, according to the change of the pupil center of the user from the position including the first focus to the position including the second focus. The positions of the scanning units 103 and 108 are moved so that the direction of the beam scanned from 108 to the deflecting units 104 and 107 changes from the first direction to a second direction different from the first direction.
Further, in this case, the deflecting units 104 and 107 have a first interference fringe for condensing the beam incident from the first direction on the first focal point and the beam incident from the second direction on the second focal point. It is comprised by the hologram which has the 2nd interference fringe condensed on. In order to form a plurality of interference fringes, for example, a plurality of combinations of object light and reference light may be prepared and multiple exposure may be performed on the photopolymer layer.
In the display device having the above-described configuration, the glasses shift is detected by the relative position detection unit 120. Then, the scanning unit position adjustment unit 1052B changes the relative positions of the scanning units 103 and 108 and the deflection units 104 and 107 based on the detection result of the relative position detection unit 120, so that the user continues to view the image. Can do.
According to this method, since the deflecting units 104 and 107 do not need to focus the beams from the scanning units 103 and 108 on a plurality of focal points at the same time, various problems caused when the pupil includes a plurality of focal points at the same time. It can be avoided.
In Embodiment 5, a method of drawing an image by two-dimensionally scanning a beam will be described. However, display light from a two-dimensional image display element such as a liquid crystal is condensed in the vicinity of the pupil (Maxwell view and The deflecting units 104 and 107 may be deflected as described above.
With the configuration described above, the display device of the present invention has an effect that it is difficult to generate a situation in which an image cannot be seen as a result of eliminating the problem of wearing pupil misalignment even when glasses misalignment occurs in the glasses type HMD. In addition, since the problem of glasses misalignment can be reduced, there is an effect that a heavy HMD with relatively easy eyeglass misalignment, an HMD with a weight balance in the front (lens portion), and an HMD with a small contact area around the nose and ears can be realized. . Further, as a result of reducing the problems when the HMD is made into a glasses, there is also an effect that the HMD can be made into a glasses.
Note that a synergistic effect can be expected by combining the above-described embodiments in any combination. Moreover, there exists an advantageous effect also by applying to the use as shown below. However, the application of the present invention is not limited to the following.
FIG. 21 is a configuration diagram of a vehicle-mounted HUD (Head-up Display) according to the sixth embodiment of the present invention.
The basic mechanism and operation of the light source 101, the wavefront shape changing unit 102, the scanning unit 103, the deflecting unit 104, the control unit 105, and the headphone unit 106 are the same as those in the first embodiment.
In the sixth embodiment, an image is displayed to a user who is on board. As in the first embodiment, the deflecting unit 104 has a beam reflection characteristic and a transmission characteristic of visible light from the outside of the vehicle, so that the display according to the present invention can be seen while viewing the scene outside the vehicle. Accordingly, there is an effect that information related to driving behavior, whereabouts, and the like such as vehicle speed, cautions and warnings, and destination guidance can be seen while looking at the scene outside the vehicle.
The light source 101, the wavefront shape changing unit 102, and the scanning unit 103 may be attached near the ceiling of the car as shown in FIG. Accordingly, there is an effect that the view from the window is not obstructed, and that the optical path is shortened and the display accuracy can be improved by disposing it near the eye. Alternatively, the light source 101 may be disposed at a location away from the wavefront shape changing unit 102 such as the lower part of the vehicle body, and a beam may be transmitted from the light source 101 to the wavefront shape changing unit 102 using an optical fiber. Thereby, there exists an effect which can reduce the area | region for installing the light source 101 in a ceiling part.
The control unit 105 may be arranged in the dashboard. A control device other than the display device of the present invention, for example, a control device such as a vehicle speed management device or a guidance control device (car navigation system) may also serve as the control unit 105. This has the effect of reducing the total number of control devices.
The headphone unit 106 does not need to be in contact with the user's ear, and may be a speaker mounted on an indoor surface around the user, for example, a door or a front dashboard.
The deflection unit support unit 401 supports the deflection unit 104 from the ceiling or the upper part of the window. The position adjustment function of the deflection unit support unit 401 can adjust the position and inclination of the deflection unit 104 according to the user's head position. The adjustment may be performed manually by the user or may be performed automatically. As an automatic method, a camera is installed in the vicinity of the deflection unit support unit 401, and the deflection unit 104 is moved and rotated to an appropriate position and angle by capturing and recognizing the position change of the user's head and eyes. It is also possible to make adjustments.
FIG. 22 is a configuration diagram of a chair-mounted display device according to the seventh embodiment of the present invention.
In the seventh embodiment, an image is displayed to a user sitting on a chair.
The light source 101, the wavefront shape changing unit 102, and the scanning unit 103 may be arranged in a portion from the back of the chair to the deflection unit 104 in front of the user's eyes as shown in FIG. Although it arrange | positions above a user's head in FIG. 22, you may arrange | position to a temporal region or the head lower part.
The control unit 105 may be disposed in the lower part of the chair. A control device different from the display device of the present invention, for example, a control device such as a massage control device may also serve as the control unit 105. This has the effect of reducing the total number of control devices.
The headphone unit 106 may be a headphone that is in contact with the user's ear, or may be a speaker that is installed at the back or side of the head.
The control processing in each embodiment described above is performed by the CPU interpreting and executing predetermined program data stored in a storage device (ROM, RAM, hard disk, etc.) that can execute the processing procedure described above. Realized. In this case, the program data may be introduced into the storage device via the recording medium, or may be directly executed from the recording medium. The recording medium refers to a recording medium such as a semiconductor memory such as a ROM, a RAM, or a flash memory, a magnetic disk memory such as a flexible disk or a hard disk, an optical disk such as a CD-ROM, DVD, or BD, or a memory card such as an SD card. . The recording medium is a concept including a communication medium such as a telephone line or a conveyance path.
The display device according to the present invention can reduce the influence of pupil misalignment and can be applied to uses such as a display device, a display system, and a display method.
1A is a plan view of a display device according to Embodiment 1. FIG. 1B is a side view of the display device according to Embodiment 1. FIG. FIG. 2 is a detailed configuration diagram of the display device according to the first embodiment. FIG. 3 is a functional block diagram of the display device according to the first embodiment. FIG. 4 is a diagram illustrating a state in which the user's eyes are facing the front in the display device according to the first embodiment. FIG. 5 is a diagram illustrating a state where the user's eyes are facing left in the display device according to the first embodiment. FIG. 6A is a diagram illustrating an example of a deflection characteristic imparted to the deflection unit. FIG. 6B is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 6C is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 6D is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 6E is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 6F is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 6G is a diagram illustrating another example of the deflection characteristic imparted to the deflection unit. FIG. 7 is a schematic configuration diagram of a display device according to the second embodiment. FIG. 8A is a diagram illustrating a state where the user's eyes are facing the front in the display device according to the second exemplary embodiment. FIG. 8B is a diagram illustrating a state in which the user's eyes are facing the front in a conventional display device. FIG. 9A is a diagram showing a state where the user's eyes are facing left in the display device according to Embodiment 2. FIG. 9B is a diagram illustrating a state in which the user's eyes are facing left in a conventional display device. FIG. 10A is a schematic configuration diagram of a light detection unit of the display device according to Embodiment 2. FIG. 10B is a diagram illustrating another example of the light detection unit of the display device according to Embodiment 2. FIG. 11 is a functional block diagram of the display device according to the second embodiment. FIG. 12 is a schematic configuration diagram of a display device according to the third embodiment. FIG. 13 is a diagram showing a state in which the user's eyes are facing the front in the display device according to Embodiment 3 of the invention. FIG. 14 is a diagram showing a state in which the user's eyes are facing left in the display device according to Embodiment 3 of the invention. FIG. 15 is a functional block diagram of the display device according to the fourth embodiment. FIG. 16 is a flowchart showing the operation of the display device according to the fourth embodiment. FIG. 17 is a diagram illustrating an operation example of the display device when the pupil position changes. FIG. 18 is a diagram illustrating a display example of the display device when the pupil position changes. FIG. 19A is a diagram illustrating a state in which the user wears the display device according to the fifth embodiment. FIG. 19B is a diagram illustrating a state where the position of the deflection unit is shifted downward from the state of FIG. 19A. FIG. 20 is a functional block diagram of the display device according to the fifth embodiment. FIG. 21 is a diagram showing an example of the use of the display device according to the present invention. FIG. 22 is a diagram showing another example of the use of the display device according to the present invention. FIG. 23 is a diagram illustrating a state in which the user's eyes face the front in a conventional display device. FIG. 24 is a diagram illustrating a state in which the user's eyes are facing left in a conventional display device. FIG. 25 is a diagram showing a conventional display device including a deflecting mirror having a plurality of focal points. FIG. 26 is a diagram illustrating a state before and after a change in pupil position in a conventional display device. FIG. 27 is a diagram illustrating a direction in which an image can be seen in a conventional display device.
2 outgoing light 2b reflected light 2B blue laser light 2G green laser light 2R red laser light 4a movable mirror 6 overall control unit 7 pupil 8a retina 8b iris 8L left eye 8R right eye 9 interpupillary distance 10, 30 display device 11L, 11R Optical position 12 Condensing position distance 13 RGB light source 14 Laser light 14a Reflective mirrors 14b, 17a, 17b Dichroic mirror 14c Lens 15a Reflective surface 15L, 15R Hologram mirror 16 Deflection part position adjustment part 16L, 16R Drive part 17c Light reception control part 18 Center line 19 Wiring 20, 20L, 20R, 32, 32L, 32R Video 31, 31L, 31R Field of view 61 Light quantity control unit 62 Deflection unit position control unit 3L, 3R, 100 Image output unit 1L, 1R, 101, 110 Light source 102, 109 Wavefront shape changing unit 4L, 4R, 103, 108 Scanning unit 15, 104, 107 Deflection unit 5L, 5R, 105, 111 Control unit 106, 112 Headphone unit 120 Relative position detection unit 121, 122 Lens 123, 124 Temple 201 Focal length horizontal component change unit 202 Focal length vertical component change 215 Rotating body 13r, 211 Red laser light source 13b, 212 Blue laser light source 13g, 213 Green laser light source 17, 17B, 17G, 17R, 214 Photodetection unit 401 Deflection unit support unit 501 Central processing unit 502 Storage unit 503 Input / output control Unit 510 light source input / output control unit 511 wavefront shape change input / output control unit 512 scanning input / output control unit 513 deflection input / output control unit 514 headphone input / output control unit 515 power input / output control unit 516 communication input / output control unit 520 communication unit 801 802, 803, 804, 8 05,806L, 806R Deflection characteristics 1051A Pupil position detection unit 1052A Output image control unit 1053A Scan angle control unit 1051B Relative position calculation unit 1052B Scan unit position adjustment unit
A display device for displaying an image on a user's retina,
An image output unit that outputs display light of an image, and includes: a light source that outputs a beam for drawing each pixel constituting the image; and a scanning unit that scans the beam output from the light source in a two-dimensional direction. An image output unit;
A deflection unit that deflects display light output from the image output unit in a direction toward the user's eyes, suppresses image disturbance caused by a change in relative position with the user's pupil , and At least a part of the scanned beam has a deflection characteristic that deflects the beam so as to pass through the pupil at a position different from the center of the user's pupil, and the beam scanned by the scanning unit is directed to the user's pupil. A display device comprising: a deflection unit having a deflection characteristic of deflecting so as to pass through different positions of a pupil according to an incident angle .
The deflection unit passes through the pupil center, and a beam scanned in the left deflection region on the left side of the virtual line perpendicular to the deflection unit passes through the user's pupil in the region on the left side of the pupil center, and is on the right side of the virtual line. The display device according to claim 1 , wherein the display device has a deflection characteristic that deflects the beam so that the beam scanned in the right deflection region passes through the pupil of the user in a region on the right side of the pupil center.
The deflection unit includes an incident angle of the beam to the pupil and a distance between the incident position of the beam to the pupil and the center of the pupil in the beam scanned in the left deflection region and the beam scanned in the right deflection region. The display device according to claim 2 , wherein the display device has a deflection characteristic of deflecting a beam so as to be asymmetrical with respect to the virtual line.
The deflection unit includes a left-eye deflection unit that deflects a beam scanned by the scanning unit in a direction toward the user's left eye, and a right-eye deflection unit that deflects the beam in the direction toward the user's right eye. ,
The deflection unit for the left eye has a smaller incident angle to the pupil of the beam scanned in the left deflection region than the beam scanned in the right deflection region, and the beam to the pupil of the beam scanned in the left deflection region. Having a deflection characteristic of deflecting the beam so that the distance between the incident position and the pupil center is larger than the beam scanned in the right deflection region;
The right-eye deflection unit is configured such that an incident angle of a beam scanned in the right deflection region to the pupil is smaller than a beam scanned in the left deflection region, and the beam scanned into the right deflection region enters the pupil. Having a deflection characteristic of deflecting the beam such that the distance between the incident position and the pupil center is larger than the beam scanned in the left deflection region;
The display device according to claim 3 .
The deflection unit passes through the pupil center, and the beam scanned in the upper deflection region above the imaginary line perpendicular to the deflection unit passes through the region above the pupil center of the user's pupil and is below the imaginary line. The display device according to claim 4 , wherein the display device has a deflection characteristic that deflects the beam so that the beam scanned in the lower deflection region passes through a region below the center of the pupil of the user's pupil.
The display device according to claim 5 , wherein the deflection unit is a hologram that deflects a beam by diffraction.
A deflection unit that deflects display light output from the image output unit in a direction toward the user's eyes, and has a deflection characteristic that suppresses image distortion caused by a change in relative position with the user's pupil; With
In the deflection unit, at least a part of the beam scanned by the scanning unit is a pupil of the user.
A left eye deflection unit that has a deflection characteristic of deflecting so as to pass through the pupil at a position different from the center of the aperture, and deflects the beam scanned by the scanning unit in a direction toward the left eye of the user; A right-eye deflection unit that deflects in a direction toward the user's right eye,
The left-eye deflection unit and the right-eye deflection unit include a pupil center of the user's left eye and a pupil center of the right eye
The distance between the pupils, the focusing position of the beam in the left eye, and the focusing of the beam in the right eye
It is arranged in a positional relationship such that the distance between the condensing positions, which is the distance to the position, is different from each other.
The display device further includes a deflection unit position adjusting unit that moves the left-eye deflection unit and the right-eye deflection unit so as to make the inter-pupil distance and the condensing position distance different. Item 8. The display device according to Item 7 .
A light detection unit that detects reflected light from the pupils of the left and right eyes of the user;
The distance between the pupils is calculated based on the detection result of the light detection unit, and the deflection unit position adjustment unit is controlled so that the distance between the condensing positions is different from the calculated inter-pupil distance. The display device according to claim 8 , further comprising: a deflection unit position control unit that moves the deflection unit for the eye and the deflection unit for the right eye.
The display device further determines, based on a detection result of the light detection unit, that one of the beams deflected by the left-eye deflection unit and the right-eye deflection unit has not entered the user's eyeball. The display device according to claim 9 , further comprising a light amount control unit that increases the light amount of the other beam in the light source.
The display device according to claim 10 , wherein the light detection unit spectrally detects reflected light for each predetermined wavelength.
A deflection unit that deflects display light output from the image output unit in a direction toward the user's eyes and has a deflection characteristic that suppresses image disturbance caused by a change in a relative position with the user's pupil, A left-eye deflection unit that deflects the beam scanned by the scanning unit in a direction toward the user's left eye, and a right-eye deflection unit that deflects the beam in the direction toward the user's right eye, The deflection unit includes a beam that is scanned in the left deflection region on the left side of the virtual line that passes through the center of the pupil and is perpendicular to the deflection unit for the left eye, and a beam that is scanned in the right deflection region on the right side of the virtual line. And a deflection characteristic of deflecting the beam so that an incident angle of the beam to the pupil is asymmetrical with respect to the virtual line, and the right-eye deflection unit passes through the center of the pupil and the right-eye deflection unit Scan to the left deflection area to the left of the virtual line perpendicular to A deflection characteristic of deflecting the beam so that the incident angle of the beam to the pupil is asymmetrical with respect to the imaginary line. A deflection unit having
A deflection unit that deflects display light output from the image output unit in a direction toward the user's eyes, suppresses image disturbance caused by a change in relative position with the user's pupil, and A deflection unit having a deflection characteristic that is a characteristic of deflecting the beam to be scanned to the first focus and the second focus different from the first focus;
A light detection unit for detecting reflected light from the user's pupil;
Based on the detection result of the light detection unit, a pupil position detection unit that detects a change in the pupil position that is the position of the pupil center of the user;
A virtual image visually recognized by the user before and after the change of the pupil position in response to the change of the pupil position from the position including the first focus to the position including the second focus, based on the detection result of the pupil position detection unit. And a control unit for controlling the output of the previous image output unit so that the images can be seen in the same direction.
The control unit controls the output of the image output unit so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change of the pupil position. The display device according to claim 13 .
The control unit draws each pixel on the light source so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change of the pupil position. The display device according to claim 14 , further comprising an output image control unit that outputs a beam by shifting the beam in a direction in which the pupil position of the user has changed.
The display device according to claim 15 , wherein the output image control unit further controls the output of the image output unit so that the size of a virtual image visually recognized by a user is the same before and after the change of the pupil position.
The control unit draws each pixel on the scanning unit so that a beam for drawing the same pixel is substantially parallel in a region from the deflection unit toward the user's eye before and after the change of the pupil position. The display device according to claim 14 , further comprising: a scanning angle control unit that scans a beam to be shifted in a direction in which the pupil position of the user has changed.
A deflection unit that deflects display light output from the image output unit in a direction toward the user's eyes, suppresses image disturbance caused by a change in relative position with the user's pupil, and A deflection characteristic for deflecting the beam to be scanned to a first focal point and a second focal point different from the first focal point, wherein the beam scanned by the scanning unit is the first focal point. A deflection unit having a deflection characteristic for deflecting the focal point so that the light is condensed to the second focal point above the first focal point and higher than the first focal point by the user and farther from the first focal point. With
The display device according to claim 18 , wherein the first and second focal points are located on an imaginary line substantially parallel to a ridge line of the user's nose.
The display device according to claim 19 , wherein the vertical distance between the first and second focal points is equal to or greater than the height of the user's pupil, and the horizontal distance is equal to or less than the width of the user's pupil.
The display device according to claim 20 , wherein the deflecting unit simultaneously deflects the beam scanned by the scanning unit in a direction toward each of the first and second focal points.
The display device further includes a relative position detection unit that detects a change in a relative position between the pupil center of the user and the deflection unit;
According to the detection result of the relative position detection unit, the scanning unit is scanned from the scanning unit to the deflection unit in response to the change of the pupil center of the user from the position including the first focus to the position including the second focus. A scanning unit position adjusting unit that moves the scanning unit so that the direction of the beam changes from the first direction to a second direction different from the first direction;
The deflecting unit focuses a beam incident from the first direction on the first focal point.
The display device according to claim 20 , wherein the display device includes a hologram having a plurality of interference fringes and a second interference fringe that focuses a beam incident from the second direction on the second focus.
The relative position detector
A rotating body that is arranged at a position in contact with the user's nose and that rotates as the deflection unit moves in the vertical direction;
The display device according to claim 22 , further comprising: a relative position calculation unit that detects a change in a relative position between a pupil center of the user and the deflection unit based on a rotation angle of the rotating body.
JP2009514297A 2007-11-21 2008-11-21 Display device Active JP5237268B2 (en)
JP2009514297A JP5237268B2 (en) 2007-11-21 2008-11-21 Display device
JPWO2009066475A1 JPWO2009066475A1 (en) 2011-04-07
JP5237268B2 true JP5237268B2 (en) 2013-07-17
JP2009514297A Active JP5237268B2 (en) 2007-11-21 2008-11-21 Display device
EP2465004A2 (en) * 2009-08-13 2012-06-20 BAE Systems PLC Head up display system
JP5197883B1 (en) * 2011-08-31 2013-05-15 パイオニア株式会社 Image display device
WO2013057923A1 (en) * 2011-10-20 2013-04-25 パナソニック株式会社 Display device and display system
JP5919899B2 (en) * 2012-03-08 2016-05-18 セイコーエプソン株式会社 Virtual image display device and method for adjusting position of virtual image display device
DE102012205164A1 (en) * 2012-03-29 2013-10-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Projection display and method for projecting a total image
US10018839B2 (en) * 2012-05-30 2018-07-10 Pioneer Corporation Display device, head-mounted display, display method, display program and storage medium
JP6248931B2 (en) * 2012-07-24 2017-12-20 ソニー株式会社 Image display device and image display method
TWI470272B (en) * 2012-07-24 2015-01-21 Univ Nat Chiao Tung Image display device
CN104718495B (en) * 2012-10-11 2018-02-27 田原博史 Video observing system
JP6209456B2 (en) * 2013-05-31 2017-10-04 株式会社Ｑｄレーザ Image projection apparatus and projection apparatus
ITMO20130173A1 (en) * 2013-06-18 2014-12-19 Meta System Spa Equipment with volumetric detector, can be used in particular in antitrusione systems for vehicles
CN109919117A (en) * 2013-11-25 2019-06-21 原相科技股份有限公司 Eyeball arrangement for detecting and pupil method for detecting
CN104090371B (en) * 2014-06-19 2017-07-04 京东方科技集团股份有限公司 A kind of 3D glasses and 3D display systems
CN105785749B (en) * 2014-12-24 2018-11-13 联想(北京)有限公司 A kind of display methods and electronic equipment
US10197895B2 (en) * 2015-03-31 2019-02-05 Hamamatsu Photonics K.K. Projection display device
JP6231541B2 (en) * 2015-06-25 2017-11-15 株式会社Ｑｄレーザ Image projection device
CN105353512B (en) * 2015-12-10 2018-06-29 联想(北京)有限公司 A kind of method for displaying image and image display device
JP6231545B2 (en) * 2015-12-22 2017-11-15 株式会社Ｑｄレーザ Image projection device
CN105551380B (en) * 2016-03-03 2018-03-23 京东方科技集团股份有限公司 Minute surface display device
WO2018186046A1 (en) * 2017-04-04 2018-10-11 国立大学法人福井大学 Image generating device and image generating method
JP2002277822A (en) * 2001-03-21 2002-09-25 Japan Science & Technology Corp Retina projection display method and device for the method
JP2002303819A (en) * 2002-02-05 2002-10-18 Olympus Optical Co Ltd Video display device
JP2004157173A (en) * 2002-11-01 2004-06-03 Japan Science & Technology Agency Wide visual region retina projection type display system
2008-11-21 US US12/523,784 patent/US8246170B2/en active Active
2008-11-21 WO PCT/JP2008/003445 patent/WO2009066475A1/en active Application Filing
2008-11-21 CN CN 201110267927 patent/CN102289073B/en active IP Right Grant
2008-11-21 CN CN 200880002690 patent/CN101589329B/en active IP Right Grant
2008-11-21 JP JP2009514297A patent/JP5237268B2/en active Active
2012-07-19 US US13/553,013 patent/US8398242B2/en active Active
CN102289073B (en) 2014-01-15
CN102289073A (en) 2011-12-21
US8246170B2 (en) 2012-08-21
US20120280956A1 (en) 2012-11-08
CN101589329B (en) 2011-10-12
JPWO2009066475A1 (en) 2011-04-07
CN101589329A (en) 2009-11-25
US8398242B2 (en) 2013-03-19
WO2009066475A1 (en) 2009-05-28
US20100097580A1 (en) 2010-04-22
KR20150136601A (en) 2015-12-07 Method for displaying an image projected from a head-worn display with multiple exit pupils