Source: https://patents.google.com/patent/JP2011166744A/en
Timestamp: 2020-01-20 02:02:46
Document Index: 142235564

Matched Legal Cases: ['art, 4', 'art, 5', 'art, 7', 'art, 10', 'art, 34', 'art, 36']

JP2011166744A - Method for correcting stereoscopic image, stereoscopic display device, and stereoscopic image generating device - Google Patents
Method for correcting stereoscopic image, stereoscopic display device, and stereoscopic image generating device Download PDF
JP2011166744A
JP2011166744A JP2010255678A JP2010255678A JP2011166744A JP 2011166744 A JP2011166744 A JP 2011166744A JP 2010255678 A JP2010255678 A JP 2010255678A JP 2010255678 A JP2010255678 A JP 2010255678A JP 2011166744 A JP2011166744 A JP 2011166744A
JP2010255678A
JP5615136B2 (en
Kazuhiro Ishiguchi
和博 石口
2010-01-12 Priority to JP2010003634 priority Critical
2010-01-12 Priority to JP2010003634 priority
2010-11-16 Application filed by Mitsubishi Electric Corp, 三菱電機株式会社 filed Critical Mitsubishi Electric Corp
2010-11-16 Priority to JP2010255678A priority patent/JP5615136B2/en
2011-08-25 Publication of JP2011166744A publication Critical patent/JP2011166744A/en
2014-10-29 Publication of JP5615136B2 publication Critical patent/JP5615136B2/en
<P>PROBLEM TO BE SOLVED: To provide a method for taking a complicated crosstalk amount caused by a response delay of liquid crystal into consideration, maintaining display quality as much as possible, and reducing a crosstalk amount. <P>SOLUTION: A method for correcting stereoscopic images includes: (a) at least one of a step of detecting a range of crosstalk and a crosstalk amount occurring on a left image 1 or a right image 2 as black-side correction data, and a step of detecting the range of crosstalk and the crosstalk amount as white-side correction data, based on crosstalk characteristic data based on gradations of the left image 1 and gradations of the right image 2; (b) at least one of a step of making the black-side correction data into lower-limit data with a smoothing filter 8, and a step of making the white-side correction data into upper-limit data with a smoothing filter 7; and (c) a step of performing gamma conversion of the left image 1 or the right image 2 based on at least one of the lower-limit data and the upper-limit data and producing a corrected left image 10 or a corrected right image. <P>COPYRIGHT: (C)2011,JPO&INPIT
The present invention relates to a stereoscopic image correction method for correcting a stereoscopic image, a stereoscopic display device using the stereoscopic image correction method, and a stereoscopic image generation device.
Conventionally, various methods have been put to practical use in stereoscopic devices, such as those capable of stereoscopic viewing with the naked eye and those using special glasses. Methods that enable stereoscopic viewing with the naked eye include holography, a method of controlling the light reaching the left and right eyes of the observer with a parallax barrier and lenticular lens installed on the surface of the liquid crystal panel, and the direction of the emitted light There is a method of controlling light that reaches the left and right eyes of an observer in a time-sharing manner by combining a backlight having a characteristic (hereinafter referred to as a directional backlight) and a field sequential type liquid crystal panel.
On the other hand, as a method using special glasses, there are a method of separating left and right images by viewing images with different polarization by providing polarizing plates with different polarization directions on the left and right sides of the glasses, and shutter glasses and field sequential type liquid crystal. There is a method of controlling the light reaching the left and right eyes of the observer in time division by combining with the panel.
Many of the stereoscopic display devices using the above-described method have stereoscopic crosstalk (hereinafter, referred to as crosstalk) that deteriorates the visibility of a stereoscopic video, although the factors are various. Crosstalk means that the left and right parallax images are mixed (imaged) with each other. When crosstalk exists, there is a problem in that a false image (hereinafter referred to as a ghost) is visually recognized in a portion that is not originally projected, thereby obstructing stereoscopic vision or increasing the fatigue of stereoscopic vision. Arise.
As a stereoscopic display device that can be stereoscopically viewed with the naked eye and performs stereoscopic display by combining a directional backlight and a liquid crystal panel, for example, two light sources that focus on each of the right eye and the left eye of an observer are used. When the liquid crystal display panel displays a parallax image for the right eye, the right eye light source is turned on in synchronization with it, and when the parallax image for the left eye is displayed, the light source for the left eye is synchronized with it. There is a stereoscopic display device that displays a stereoscopic image by turning on and alternately displaying left and right parallax images (see, for example, Patent Document 1).
The cause of the crosstalk that occurs in the stereoscopic display device according to Patent Document 1 is broadly divided into stray light in the backlight and the liquid crystal panel, and the brightness of light emitted in the direction of the right eye when the left eye light source is turned on. Is not completely zero (in the case of a light source for the right eye, the component in which the luminance of light emitted in the direction of the left eye does not completely become zero) and the liquid crystal panel response because the liquid crystal panel is driven in a time-sharing manner. It consists of components due to delay.
Among the causes of crosstalk, the component caused by stray light hardly changes regardless of what the liquid crystal panel displays, so the amount of crosstalk is simply the reverse side (that is, the display of the parallax image for the left eye). A signal processing technique relating to crosstalk removal correction in such a case is disclosed (see, for example, Patent Document 2).
Japanese Patent Laid-Open No. 2001-66547 (FIG. 1) JP 2001-298754 A
Patent Document 2 discloses a crosstalk correction method when the crosstalk amount is a simple constant multiple, and cannot cope with a case where a complicated crosstalk amount such as a liquid crystal delay occurs. Further, since the minimum luminance of the input image is raised to the level of the maximum crosstalk amount, there is a problem that the overall contrast is remarkably lowered and the display quality is deteriorated.
The present invention has been made to solve these problems. In consideration of a complicated amount of crosstalk caused by response delay of liquid crystal, etc., the display quality is maintained as much as possible and the amount of crosstalk is maintained. An object of the present invention is to provide a method for reducing the above.
In order to solve the above-described problems, a stereoscopic image correction method according to the present invention is a stereoscopic image correction method for correcting a stereoscopic image displayed based on a left image and a right image, and (a) a left image and a right image When an image is input and the crosstalk characteristic data based on the gray level of the left image and the gray level of the right image is used, the crosstalk range and the amount of crosstalk occurring in the left image or the right image are brightly displayed. At least one of a step of detecting the black side correction data for the object and a step of detecting the white side correction data for the thing causing the dark display; and (b) after step (a), black The side correction data is input to the smoothing filter, the black side correction data is made a smooth slope from the range where the crosstalk is generated by the smoothing filter to the outside of the range, and the black side correction data is reduced. The process of making data and the white side correction data are input to the smoothing filter, the white side correction data is made a smooth slope from the range where crosstalk occurs by the smoothing filter to the outside of the range, and the white side correction data is set to the upper limit data. (C) After step (b), gamma conversion is performed on the left image or the right image based on at least one of the lower limit data or the upper limit data, and the corrected left image or Generating a corrected right image.
According to the present invention, (a) the left image and the right image are input, and the crosstalk generated in the left image or the right image based on the crosstalk characteristic data based on the gradation of the left image and the gradation of the right image. At least one of a step of detecting the range and the amount of crosstalk as black-side correction data for a thing causing a bright display and a step of detecting as a white-side correction data for a thing causing a dark display; (B) After the step (a), the black side correction data is input to the smoothing filter, and the black side correction data is converted into a smooth slope from the range where the crosstalk is generated by the smoothing filter to the outside of the range. The step of setting the correction data as the lower limit data and the white side correction data are input to the smoothing filter, and the range where the crosstalk is generated by the smoothing filter is out of the range. Based on at least one of the lower limit data or the upper limit data after the step (b) and (c) the step (b), wherein the white side correction data is a smooth slope and the white side correction data is the upper limit data. It includes a step of performing gamma conversion on the left image or right image to generate a corrected left image or a corrected right image. The amount of crosstalk can be reduced while maintaining the quality as much as possible.
It is a block diagram which performs the correction | amendment and production | generation process of the stereo image by Embodiment 1 of this invention. It is a figure which shows an example of a structure of the three-dimensional display apparatus by Embodiment 1 of this invention. It is a figure which shows an example of the ideal timing chart of the three-dimensional display apparatus by Embodiment 1 of this invention. It is a figure which shows an example of the timing chart in case stray light exists in the backlight by Embodiment 1 of this invention. It is a figure which shows an example of the timing chart in case stray light exists in the backlight by Embodiment 1 of this invention, and there exists a response delay of a liquid crystal. It is a figure which shows the sample image used for description by Embodiment 1 of this invention. It is the figure which showed the luminance distribution of the horizontal direction in the vertical direction center position of the sample image in FIG. 6 by Embodiment 1 of this invention. It is the figure which showed the change of the brightness | luminance with respect to FIG. 7 in case the crosstalk by the backlight by Embodiment 1 of this invention exists. FIG. 9 is a diagram illustrating a change in luminance with respect to FIG. 7 in the case where there is crosstalk caused by response delay of liquid crystal in addition to FIG. 8 according to the first embodiment of the present invention. It is a figure which shows the sample image in the case of the brightness | luminance of FIG. 9 by Embodiment 1 of this invention. FIG. 10 is a diagram showing a change in luminance with respect to FIG. 9 when crosstalk correction is performed by contrast suppression. It is a figure which shows the sample image in the case of the brightness | luminance of FIG. It is the figure which showed the change of the brightness | luminance with respect to FIG. 9 at the time of performing the crosstalk correction by Embodiment 1 of this invention. It is a block diagram of the overdrive process of the stereoscopic display device by Embodiment 1 of this invention. It is a figure which shows the test image for creating the table of the overdrive of the stereoscopic display device by Embodiment 1 of this invention. It is a figure which shows the structure of a table when the table of the overdrive of the stereoscopic display device by Embodiment 1 of this invention is an initial value. FIG. 16 is a diagram showing an image when the test image of FIG. 15 is displayed when the overdrive table of the stereoscopic display device according to the first embodiment of the present invention is an initial value. FIG. 16 is a diagram illustrating an image when the test image of FIG. 15 is displayed when the overdrive table of the stereoscopic display device according to the first embodiment of the present invention is corrected. It is a figure which shows the structure of a table when converting the image of FIG. 18 by Embodiment 1 of this invention into a gradation value. It is a figure which shows an example of the test image used in order to produce the table of FIG. 19 by Embodiment 1 of this invention visually. It is a figure which shows the gradation difference with the gradation without crosstalk in the table of FIG. 19 by Embodiment 1 of this invention. It is a figure which shows the structure of B table used by the signal processing in the case of FIG. 21 by Embodiment 1 of this invention. It is a figure which shows the structure of W table used by the signal processing in the case of FIG. 21 by Embodiment 1 of this invention. It is a figure which shows the correction data value of the white and black side corresponding to the image position obtained from the input image shown in FIG. 6 by Embodiment 1 of this invention. FIG. 25 is a diagram showing white / black correction data when one-dimensional LPF processing is performed on the white / black side correction data of FIG. 24 according to the first embodiment of the present invention. FIG. 26 is a diagram showing that the white / black correction data of FIG. 25 according to Embodiment 1 of the present invention has been converted into upper limit / lower limit values input to a gamma conversion unit. It is a figure which shows the calculation content of the gamma conversion by Embodiment 1 of this invention. It is a figure which shows the gradation with respect to the correction | amendment image position produced | generated by Embodiment 1 of this invention. It is a conceptual diagram of the two-dimensional filter in general image processing. It is a figure which shows an example of the setting of the filter range in the two-dimensional filter by Embodiment 1 of this invention. It is a figure which shows an example of the setting of the filter range in the two-dimensional filter by Embodiment 1 of this invention. It is a figure which shows an example of the setting of the filter range in the two-dimensional filter by Embodiment 1 of this invention. It is a figure which shows the image which performed the correction process of this Embodiment 1 with respect to the sample image of FIG. 6 by Embodiment 1 of this invention. It is a block diagram which correct | amends considering the characteristic change by temperature with respect to FIG. 1 by Embodiment 1 of this invention. It is a figure which shows an example of a structure of the three-dimensional display apparatus by Embodiment 1 of this invention. It is a figure which shows an example of arrangement | positioning of the parallax barrier when it sees from the display surface of FIG. 35 by Embodiment 1 of this invention. It is a figure which shows an example of a structure of the three-dimensional display apparatus by Embodiment 1 of this invention. It is a block diagram which shows an example of the correction | amendment image generation part by Embodiment 2 of this invention. It is a figure which shows an example of the setting of the filter range in the two-dimensional filter by Embodiment 2 of this invention. It is a figure which shows an example of the setting of the filter range in the two-dimensional filter by Embodiment 2 of this invention. It is a schematic diagram of the interpolation calculation by Embodiment 2 of this invention.
FIG. 1 is a block diagram for performing a stereoscopic image correction and generation process according to Embodiment 1 of the present invention. As shown in FIG. 1, the left image 1 and the right image 2 are corrected by the corrected image generation unit 3. The corrected left image and the corrected right image are three-dimensionally displayed by being displayed as the liquid crystal drive image 5 after being overdriven by the overdrive unit 4. The corrected image generation unit 3 corrects the stereoscopic image displayed based on the left image 1 and the right image 2, and the correction data unit 6 corrects the gradation of the input left image 1 and the right image 2. Based on the crosstalk characteristic data (FIGS. 19 to 22 to be described later) based on the gray level of the image, the range of crosstalk and the amount of crosstalk generated in the left image 1 or the right image 2 is set to the black side on the low gradation side. The black side correction data and the white side correction data with the high gradation side as the white side are detected. Each of the detected black side correction data and white side correction data is input to 2DLPF (two-dimensional low-pass filter) 7 and 8 (smoothing filter), and the black side from the range where crosstalk is generated by 2DLPF 7 and 8 to the outside of the range. The correction data and the white side correction data are set to a smooth slope, the black side correction data is set as the lower limit data, and the white side correction data is set as the upper limit data. Then, the gamma conversion unit 9 performs gamma conversion on the left image 1 or the right image 2 based on the lower limit data and the upper limit data obtained through the 2DLPFs 7 and 8, and the corrected left image 10 or the corrected right image ( (Not shown). The processing in the corrected image generation unit 3 will be described in detail later.
FIG. 2 is a diagram illustrating an example of the configuration of the stereoscopic display device according to the first embodiment of the present invention. As shown in FIG. 2, the stereoscopic display device includes a directional backlight 11 and a liquid crystal panel 12, and performs stereoscopic display by combining these. The directional backlight 11 emits light separated into light emitted only in the direction of the right eye 13 (light for the right eye) and light emitted only in the direction of the left eye 14 (light for the left eye) by an electrical signal. . As such a light emission principle, for example, there is a method described in Patent Document 1, which is realized by lighting one of the right-eye light source and the left-eye light source. As another method, the light emission direction from the light source can be controlled by combining a slit and a liquid crystal that opens and closes light between the backlight and the liquid crystal panel. In the first embodiment, the configuration and method of the stereoscopic display device are not limited, and detailed description thereof is omitted here.
Next, a method of driving the liquid crystal panel and the backlight according to the above method will be described. FIG. 3 is an example of an ideal timing chart of the stereoscopic display device according to Embodiment 1 of the present invention. As shown in FIG. 3, one frame is composed of a left frame and a right frame. When driving for the left frame is started, a video for the left eye is written on the liquid crystal panel. In the left frame shown in FIG. 3, the predetermined pixel is white display (high brightness). The response of the liquid crystal in the liquid crystal panel is generally not so fast, and usually takes several milliseconds. Therefore, it is necessary to turn on the backlight for the left eye when the liquid crystal responds sufficiently. On the other hand, in the right frame, an image for the right eye is written on the liquid crystal panel. In the right frame shown in FIG. 3, the predetermined pixel is displayed in black (the luminance is low). Similarly, in the right frame, when the liquid crystal sufficiently responds, the backlight light for the right eye is turned on. By repeating the operation in each frame at a high speed, it is possible to project different images (in the above case, the predetermined pixels are white in the left eye and black in the right eye). If a parallax image for display is displayed, a stereoscopic effect can be felt in the display.
In an actual device using the above-described system, crosstalk occurs roughly due to two factors. The first factor is that stray light may be emitted as light on a side opposite to the desired side (a frame on a side different from the desired frame) due to directional backlight, irregular reflection in the liquid crystal panel, or the like. FIG. 4 is an example of a timing chart when stray light is present in the backlight according to the first embodiment of the present invention. As can be seen by comparing FIG. 4 and FIG. 3, the light for the left eye emitted from the backlight is generated as stray light at the time when the light for the right eye is lit. As a result, assuming that the light reaching the left eye has the same backlight lighting time in the left and right frames,
T W × L ON + T B × L X (1)
The luminance is proportional to. Similarly, the light reaching the right eye is
T B × R ON + T W × R X (2)
The luminance is proportional to. Ideally, for the left eye, both the right frame and the left frame should have the same luminance as when white is displayed. The brightness when the right frame and the left frame are displayed in white is
T W × L ON + T W × L X (3)
T W × L ON + T B × L X − (T W × L ON + T W × L X ) = (T B −T W ) × L X (4)
Appears as crosstalk in the left frame. Similarly, the amount of crosstalk in the right frame is
T B × R ON + T W × R X − (T B × R ON + T B × R X ) = (T W −T B ) × R X (5)
Since T W > T B , the left frame (white display) is displayed darker and the right frame (black display) is displayed brighter.
The second factor causing the crosstalk is the response delay of the liquid crystal in the liquid crystal panel. In the time-division type stereoscopic display device, since the image is displayed by repeatedly turning on and off the light source, if the one frame period is too long, it is visually recognized as a large flicker. Therefore, the frequency of one frame is generally set to 60 Hz or more. With this setting, the period of the left and right sub-frames (left frame and right frame) is approximately 8 ms, and the liquid crystal is further shortened in consideration of the stability of the transmittance of the liquid crystal during the lighting period within this period. I need to respond. FIG. 5 is an example of a timing chart when stray light is present in the backlight according to the first embodiment of the present invention and there is a response delay of the liquid crystal. In the liquid crystal transmittance waveform of FIG. 5, the solid line shown in FIG. 4 is shown by a broken line for comparison with FIG. As shown in FIG. 5, when there is a response delay of the liquid crystal, the average transmittance of the liquid crystal during the lighting period of the left and right frames is not T W and T B but T BW and T WB . Assuming that the transmittances when the right and left frames are displayed in white and when the right and left frames are displayed in black are T WW and T BB , respectively,
T BW × L ON + T WB × L X − (T WW × L ON + T WW × L X ) (6)
It becomes. Similarly, the amount of crosstalk in the right frame is
T WB × R ON + T BW × R X − (T BB × R ON + T BB × R X ) (7)
It becomes. If the amount of crosstalk in equations (6) and (7) is to be reduced to 0, T BW , T WB , L ON , L X , R ON , and R X are constants determined by the capabilities of the display device. Therefore, the variable amounts are T WW and T BB , and may be set as shown below.
T WW = (T BW × L ON + T WB × L X ) / (L ON + L X ) (8)
T BB = (T WB × R ON + T BW × R X ) / (R ON + R X ) (9)
In Formula (8), since T WB × L X << 1, it is indicated that it is necessary to set darker than T BW × L ON at a ratio of L ON / (L ON + L X ). (9) indicates that it is necessary to set the brightness brighter than T WB × R ON mainly by T BW × R X / (R ON + R X ). However, since the response of the liquid crystal changes greatly depending on the changing gradation and temperature, it is practically difficult to simply correct with such a function.
Next, the above description will be described using an actually displayed image. FIG. 6 is a diagram showing a sample image used for explanation according to the first embodiment of the present invention. As shown in FIG. 6, the left side shows an image for the left eye (hereinafter referred to as a left frame image), and the right side shows an image for the right eye (hereinafter referred to as a right frame image). A white window is drawn on a black background in both the left and right frame images, but the relative positions of the windows are different on the left and right. FIG. 7 is a diagram showing the luminance distribution in the horizontal direction (X direction) at the vertical center position of the sample image in FIG. 6 according to Embodiment 1 of the present invention. The upper part of FIG. 7 shows the luminance distribution of the left frame image, and the lower part shows the luminance distribution of the right frame image. As shown in FIG. 7, the positions of the white windows are different on the left and right.
FIG. 8 is a diagram illustrating a change in luminance with respect to FIG. 7 when there is crosstalk caused by the backlight according to the first embodiment of the present invention. In FIG. 8, the regions are defined as 1, 2, 3, 4, and 5 from the left for easy explanation. Moreover, the thick line of FIG. 7 is shown with the broken line. A region where the left frame image is displayed in white and the right frame image is displayed in black is a region 4. In FIG. 8, since the liquid crystal is ideal, if T B in equations (1) and (2) is 0, the luminance appearing in the left frame image is T W × L ON , which matches the luminance in FIG. To do. Meanwhile, the luminance appearing in the right frame image, not T W × R X becomes, T W × R X unless R X is not 0 0. In the left frame image in the region 4, it seems that there is no crosstalk according to the equation (1), but the crosstalk occurs in contrast with the region 3 shown in the equation (3), so the result is shown in the equation (4). Crosstalk will occur by the amount. Further, in the right frame image, the crosstalk is generated by the amount shown in the equation (5) in comparison with the region 5. The amount of crosstalk is a difference in brightness at adjacent identical display gradations.
FIG. 9 is a diagram showing a change in luminance with respect to FIG. 7 in the case where there is crosstalk caused by response delay of the liquid crystal in addition to FIG. 8 according to the first embodiment of the present invention. It is a figure corresponding to 7). The broken line in FIG. 9 indicates the thick line in FIG. As shown in FIG. 9, when attention is paid to the region 4, in the left frame image, the luminance that matches the broken line in FIG. 8 is lowered from the broken line in FIG. 8 due to the response delay of the liquid crystal. . Further, the right frame image shows that the luminance is further increased as compared with FIG. The difference between FIG. 8 and FIG. 9 is the presence or absence of the response delay of the liquid crystal, but the crosstalk is worsened by the response delay of the liquid crystal. FIG. 10 shows an image in the case of the luminance in FIG.
In order to remove the above crosstalk by signal calculation processing, for example, the liquid crystal transmittance of the liquid crystal of the left frame image is set higher in the region 4 and the liquid crystal transmittance of the liquid crystal of the right frame image is set lower. However, setting exceeding the maximum transmittance of the liquid crystal panel or setting of negative transmittance is impossible. Therefore, in reality, the difference in brightness between adjacent display gradations is set to zero. The luminance distribution at that time is shown in FIG. As shown in FIG. 11, the broken line indicates the thick line in FIG. 9. In area 4, the luminance cannot be increased in the left frame image, and the luminance cannot be decreased in the right frame image. Therefore, the luminance of area 3 in the left frame image is set according to equation (8). The brightness of the region 5 at is set according to the equation (9). Similarly, when the luminances of the areas 1, 3 and 5 in other left and right frame images are set, the luminance distribution shown in FIG. 11 is obtained. When the luminance distribution shown in FIG. 11 is shown as an image, the image shown in FIG. 12 is obtained. As shown in FIG. 12, the crosstalk is completely eliminated, but there is a problem that white luminance / black luminance = contrast is remarkably lowered, and the quality of the whole image quality is unavoidable.
Therefore, the present invention aims to obtain an image having a luminance distribution as shown in FIG. As shown in FIG. 13, since the luminance in the region 4 and the region 2 cannot be increased (or decreased) in both the left and right frame images, the luminance in the region corresponding to the same display gradation adjacent to the luminance is maximized from the crosstalk level. By smoothly changing to the contrast level, the outline of the ghost generated by the crosstalk is blurred to make it difficult to see. This utilizes the property that the human eye is sensitive to abrupt changes in luminance and chromaticity and insensitive to smooth changes. Hereinafter, video signal processing for obtaining an image in which the corrected image has the luminance distribution shown in FIG. 13 will be described.
A known overdrive technique is used for a normal liquid crystal display device and a field sequential type stereoscopic display device using liquid crystal. FIG. 14 is a block diagram of the overdrive process of the stereoscopic display device according to the first embodiment of the present invention. As shown in FIG. 14, since the left image 15 and the right image 16 are alternately written in the liquid crystal, while the left image 15 is written in the liquid crystal (the current image is the left image 15), the state of the previous liquid crystal Is the right image 16 (the previous image is the right image 16), and while the right image 16 is written on the liquid crystal (the current image is the right image 16), the previous liquid crystal state is the left image 15 (the previous image is Left image 15). The left image 15 and the right image 16 are selected by the frame selection 17 for each of the left and right frames, and are input to the overdrive (table) 18. In the case of a moving image, in the frame configuration starting from the left as shown in FIG. 3, the right frame 16 of the previous frame is used for reference in the left frame (left image 15), and the same frame is used in the right frame (right image 16). The left video 15 is used for reference. Although not shown in FIG. 6, since the video one frame before is used as a reference as described above, it is realized by temporarily storing the video data in a delay means such as a frame memory and adjusting the timing of the video data. The overdriven image is displayed on the display device as a liquid crystal drive image 19.
As an overdrive processing method, it is possible to use some function, but the method using a look-up table is the simplest to deal with complicated device characteristics. For example, in the case of an 8-bit gray scale liquid crystal device, it is possible to deal with any table with 256 (current image) × 256 (previous image) tables. Created by thinning out the number to some extent. At that time, intermediate data not existing in the table is generated by interpolation. If it is a table, even if a theoretical mathematical expression is complicated, it is not necessary to consider it, and correction processing can be easily performed.
A specific table data creation method used for overdrive processing will be described. Here, in an 8-bit liquid crystal device, it is considered that table values are set at 32 gradation intervals (9 values of 0, 32, 64, 96, 128, 160, 192, 224, and 255). The above is an example, and the number of divisions may be increased depending on the target accuracy. FIG. 15 is a diagram showing a test image for creating an overdrive table of the stereoscopic display device according to Embodiment 1 of the present invention. As shown in FIG. 15, the left frame image on the left has nine gradation bars arranged in order from the left. In the right frame image on the right side, nine gradation bars are arranged in order from the top. In order to easily compare the left and right frame images, the gray scale bars are repeatedly displayed three times in the left and right frame images. Here, it is assumed that the initial values of the table are set as shown in FIG. As shown in FIG. 16, since 9 gradations are set, 9 × 9 = 81 pieces of data are formed. In the table shown in FIG. 16, the same value is taken in the column direction (that is, the current gradation), and it does not depend on the value of the previous gradation at all. That is, this corresponds to the case without overdrive.
FIG. 17 is a diagram showing an image when the test image of FIG. 15 is displayed when the overdrive table of the stereoscopic display device according to Embodiment 1 of the present invention is the initial value. As shown in FIG. 17, the left and right frame images are different from the image shown in FIG. 15 due to the influence of the stray light by the backlight and the crosstalk due to the response delay of the liquid crystal. Therefore, by appropriately adjusting the values in the table shown in FIG. 16, it is possible to correct not only liquid crystal overdrive but also crosstalk including backlight stray light. The diagonal components shown in FIG. 16 are shaded when the previous gradation and the current gradation are the same. That is, it means that the gray levels of the left and right frame images are the same in the stereoscopic video. Therefore, in order to reduce the influence of the crosstalk, the diagonal components in FIG. 16 are fixed and the other table elements are adjusted in the range of 0 to 255. Examples of the adjustment method include a visual method and a luminance measurement method, but even a visual method can be sufficiently adjusted.
Here, paying attention to the left frame image, the table value shown in FIG. 16 is adjusted and set so that the same luminance is obtained in the vertical direction with reference to the luminance of the display unit corresponding to the diagonal component. For example, in the current gradation 128 and the previous gradation 128, the luminance is just in the center of the display unit, but the upper side from the center is slightly darker. Therefore, the values corresponding to the current gradation 128 and the previous gradation 96 in the table are set to slightly higher values such as 135 instead of 128. On the other hand, since the lower side from the center is slightly brighter, the values corresponding to the current gradation 128 and the previous gradation 160 in the table are set to 110, for example, to be slightly lower. Such setting is sequentially performed in the vertical direction, and the vertical direction shown in FIG. 17 is set to have the same luminance.
When the left frame image is adjusted, the right frame image is automatically adjusted so that the horizontal direction has the same luminance. However, looking at the column of the current gradation 255, as shown in FIG. 17, all the values other than the diagonal component are displayed lower than the luminance of the diagonal component, but all the values in the table are 255. It cannot be set brighter (set to a higher value). Similarly, in the column of the current gradation 0, all the components other than the diagonal component are displayed brightly as shown in FIG. 17, but the values in the table are all 0. Can not be set). Therefore, even if the gradation is 0 or 255, there is a region that is saturated and cannot be set.
An image obtained by adjusting within a settable range is shown in FIG. As shown in FIG. 18, when attention is paid to the left frame image, it can be seen that the crosstalk is removed in the vertical lines from the fourth line to the eighth line from the left. In addition, since the table values are saturated in the first to third and ninth vertical lines from the left, crosstalk remains. If the crosstalk is removed using only such an overdrive table, the diagonal components of the table shown in FIG. 16 correspond to the above fourth to eighth lines without using 0 to 255 gradations. 64 to 224 gradations are used, and for example, (64, 68, 82, 101, 123, 148, 173, 199, 224) may be set in order from the upper left of the table. By setting in this way, all the elements of the table can be set without being saturated. However, such setting is the same as the processing shown in FIGS. 11 and 12, and the black luminance is not 64 or less and the white luminance is not 224 or more. The quality of the image quality will be reduced.
In the first embodiment, ghost visibility due to crosstalk is reduced by performing overdrive processing using the overdrive unit 4 shown in FIG. 1 that has been corrected to the display state as shown in FIG. The video signal input to the overdrive unit 4 is generated by the corrected image generation unit 3 shown in FIG.
First, necessary data is created before the processing in the corrected image generation unit 3 in FIG. In the image shown in FIG. 18, the luminance corresponding to each cell (81 cells) in the table shown in FIG. ) Is converted into data. As a method of visual comparison, for example, a test pattern as shown in FIG. 20 is used. As shown in FIG. 20, the left frame image is on the left side and the right frame image is on the right side. The position of the center window is the same, the center window of the left frame image has 255 gradations, and the center window of the right frame image has 0 gradations. The background of both the left and right frame images has the same gradation and is variable. When the image shown in FIG. 20 is displayed on the stereoscopic display device and the left frame image is viewed, for example, the 255 gradation region of the center window becomes slightly dark due to crosstalk. At this time, the gradation of the background when the gradation of the background is changed to be as bright as the central window can be used as data. FIG. 19 shows a table for the image shown in FIG. Note that the above data conversion is not so strict, and a slight overdrive correction shift in the intermediate gradation region may be summarized as 0. The table shown in FIG. 19 is similar to the overdrive table, but the table shown in FIG. 19 only shows measurement data. In order to make the table shown in FIG. 19 easier to understand, FIG. 21 shows a table in which the difference from the diagonal component is taken in the column direction. Comparing the image shown in FIG. 18 with the table shown in FIG. 21, the darkly displayed portion in the image of FIG. 18 is a negative value, the brightly displayed portion is a positive value, and there is no crosstalk. It can be seen that is indicated by a value of zero. For later calculations, the current gradation in FIG. 21 is defined as X, the data of any cell is defined as Z, and two tables (B table and W table) are created according to the following equations.
Table B: 0 when Z ≦ 0, Z × 255 / (255-X) (10) otherwise
W table: 0 when Z ≧ 0, otherwise −Z × 255 / X (11)
FIG. 22 shows the B table obtained by the equation (10), and FIG. 23 shows the W table obtained by the equation (11). Here, in the expressions (10) and (11), when Z is not 0, it is not set as Z because the corrected gradation value for a pixel with Z other than 0 is Z when Gamma conversion described later is performed. This is to ensure that
Next, correction processing in the corrected image generation unit 3 in FIG. 1 will be described. Although FIG. 1 shows a block diagram for correcting the left image 1 (left frame image), the same correction is performed for the right image 2 (right frame image). The left image 1 and the right image 2 input to the correction image generation unit 3 are corrected by the correction data unit 6 on the white side (high gradation side) correction data (white side correction data) and the black side (low gradation side). Are divided into correction data (black side correction data). The above-described B table and W table are used to generate each correction data. Considering that the display device is actually color (RGB) display, the gradation values for the colors of the left and right images are (R L , G L , B L ) and (R R , G R , B R, respectively. )
BR L = B table (R L , R R ) (12)
BG L = B table (G L , G R ) (13)
BB L = B table (B L , B R ) (14)
WR L = W table (R L , R R ) (15)
WG L = W table (G L, G R) ··· (16)
WB L = W table (B L , B R ) (17)
Are calculated. Here, () in the formulas (12) to (17) indicates (current gradation, previous gradation). For example, when R L = 32 and R R = 224, the B table ( R L , R R ) = 54.
The maximum values in (BR L , BG L , BB L ) and (WR L , WG L , WB L ) calculated in this way are set as black side correction data and white side correction data, respectively. This is a value calculated for each pixel. When the correction data distribution (luminance distribution) in the cross section at the center of the input image shown in FIG. 6 is viewed, the distribution is as shown in FIG. As shown in FIG. 24, the broken line indicates the thick line in FIG. Further, only the left image is shown in both the upper and lower stages of FIG. 24, and the upper stage is white side correction data and the lower stage is black side correction data. The white side correction data indicates the location and degree of occurrence of darkly displayed crosstalk, and the black side correction data indicates the location and extent of brightly displayed crosstalk.
The white side correction data and the black side correction data calculated for each pixel are input to the 2DLPFs 7 and 8 shown in FIG. For simplicity, the case where a one-dimensional low-pass filter is used in FIG. 24 will be described first. Although there are several types of LPFs, here, LPFs using Equation (18) will be described. The position is X, the white correction data at X is Y (X), and the LPF calculation Z (X) at position X is defined as in the following equation (18).
In Expression (18), not the mere LPF but the maximum value of the LPF in different areas is adopted. This indicates that the larger of the average from the position X to the N pixels on the right side and the average from the position X to the left side for the N pixels is adopted. In calculating the left and right averages, whether or not to include the point at the position X and how much N should be determined may be determined by the degree of the final correction result. When the black side correction data is similarly calculated, FIG. 24 becomes as shown in FIG.
The white side correction data and the black side correction data that have been processed by the LPF obtained for each pixel are input as an upper limit value (formula (19)) and a lower limit value (formula (20)) to the gamma conversion unit 9 in FIG. Is done. Here, a value subtracted from 255 is used for the white side correction data.
Upper limit = 255-white side correction data (LPF) (19)
Lower limit = black side correction data (LPF) (20)
Plotting for equations (19) and (20) gives FIG.
In the gamma conversion unit 9, the following equation (21) is calculated based on the input video (left image in FIG. 1) X and the upper limit value and lower limit value in the corresponding screen coordinates.
Gamma output = Lower limit + (Upper limit−Lower limit) × X ÷ 255 (21)
FIG. 27 shows the calculation content of the equation (21). In FIG. 27, setting the upper limit value and the lower limit value means that the contrast is set to the upper limit / lower limit. Strictly speaking, the contrast by photometry is different from this definition because the video signal and the output luminance are not proportional to each other, but it is shown only as the contrast at the input signal level. Here, equation (21) describes the division by 255, but in order to reduce the amount of computation when hardware, equation (19)
Upper limit = 256-white side correction data (LPF) (22)
And formula (21) is
Gamma output = Lower limit + (Upper limit−Lower limit) × X ÷ 256 (23)
It is good. As described above, when the video signal (for example, the upper stage in FIG. 7) input to the gamma conversion unit 9 is calculated based on the upper limit value and the lower limit value shown in FIG. 26, the result is as shown in FIG.
In the area 4 shown in FIG. 28, the maximum gradation in FIG. 6 should be input originally, but even if the maximum gradation is input, a luminance exceeding a certain level cannot be displayed. The image gradation is lowered to the value. Then, as the region 4 moves to the region 3, the gradation of the image is gradually increased. In region 3, it is possible to output higher luminance, but when the luminance is suddenly increased, the edge of the ghost is visually recognized, so that the luminance is gradually increased. On the other hand, when moving from the region 4 to the region 5, there is no influence of crosstalk, and the gradation of the region 5 is changed sharply so as to become an original edge, and the region 5 outputs at the lowest gradation. When moving from the region 3 to the region 2, the gradation of the region 2 is changed steeply so as to be the original edge. The gradation of the region 2 should originally be input with the lowest gradation, but it is not changed even if the gradation is set to be lower than the lowest gradation. When shifting from the region 2 to the region 1, the gradation is gradually changed to finally reach the lowest gradation. Since this is a portion that does not have an edge, the ghost edge is hardly seen. When the corrected image shown in FIG. 28 is input to the overdrive unit 4, basically only the portion where the crosstalk shown in FIG. 20 is 0 is used, so that the display according to the corrected image can be obtained. . Therefore, when the above calculation is performed on the input left image 1 and right image 2 and the obtained corrected image is displayed, an image as shown in FIG. 13 is displayed.
Next, a two-dimensional LPF obtained by expanding the LPF represented by Expression (18) to two dimensions will be described. FIG. 29 is a conceptual diagram of a two-dimensional filter in general image processing. The general formula of the filter is as shown in the following formula (24).
In Expression (24), f () is data for each pixel, and a () is a filter constant. A simple LPF is an averaging filter, and each of a (i, j) is a positive number that is not 0 and constant. In FIG. 29, calculation is performed for data of nine pixels around the point of interest (x, y). In this embodiment, a sufficient effect is exhibited by using an averaging filter. However, in Equation (18), the average maximum value is taken separately from the focus point on the left and right sides.
(A) In FIG. 30, the average (two) is calculated for each of the left and right areas of the point of interest. The maximum value of the two calculated average values is acquired.
(B) In FIG. 31, the average is calculated for each of the four areas obliquely from the point of focus. The maximum value of the calculated four average values is acquired.
(C) In FIG. 32, the average is calculated for each of the four areas in the vertical and horizontal directions from the point of interest. The maximum value of the calculated four average values is acquired.
(D) Combine the areas shown in FIG. 31 and FIG.
Among the above (A) to (D), the calculation amount of (D) is the largest, but the calculation result is the best. Here, “the calculation result is good” means that the result of correction performed on many images is good, and artifacts due to correction are less likely to occur. In addition to the above, since there are various combinations such as changing the weighting of a (i, j) in Expression (24), the optimum filter may be determined by experiment. As described above, in the 2DLPFs 7 and 8, the absolute value of each of the black side correction data and the white side correction data obtained by dividing the periphery of the pixel to be processed into a plurality of areas and performing the smoothing process for each area. The maximum value is processed as the lower limit data and the upper limit data. The area may or may not include the pixel to be processed.
Since the magnitudes in the x and y directions in the above two-dimensional filter are the slope width of the corrected image shown in FIG. 28, if it is too small, the slope becomes steep and the effect of blurring the ghost edge is diminished. On the other hand, if it is too large, the amount of calculation becomes large and the effect of correcting crosstalk for a narrow area is diminished because averaging is performed over a wide area. Accordingly, as a guideline for determining the sizes in the x and y directions in the two-dimensional filter, it is preferable to set the minimum range in which the effect of blurring the worst crosstalk edge is produced. The larger the worst amount of crosstalk, the greater the change in luminance, which requires a wider range. Normally, the worst crosstalk is obtained when a white window is displayed against a black display background.
FIG. 33 is a diagram illustrating an image after the correction processing according to the first embodiment is performed on the video signal of FIG. Compared to FIG. 10 where no correction is performed, it can be seen that the edge of the ghost is less visible. This is the worst case of displaying a white window against a black display background, so that a slight ghost is visually recognized, but the ghost is not clearly displayed as shown in FIG. The viewpoint becomes easy to go to the image to be made, and stereoscopic viewing becomes easy. If a person who can directly view this drawing by a parallel method, a crossing method, or the like sees, the image shown in FIG. 10 is at a loss as to where the actual width of the window is. However, in the case of the image shown in FIG. 33, the window should be able to be specified reliably. As a result of performing the correction according to the present embodiment on a photographic image in which a lot of crosstalk actually occurs, it has been confirmed that the stereoscopic visibility is improved in most of them. In addition, although the contrast locally decreases, the original contrast of the device can be obtained in the vicinity of a region where the crosstalk does not occur or is small, and the deterioration of the overall display quality is reduced.
In the first embodiment, a liquid crystal display device using a directional backlight has been described as an example. However, for example, the present invention can also be applied to a method of performing field sequential driving on a liquid crystal panel using shutter glasses. . This is because if the backlight stray light is replaced with the leaked light from the shutter, the rest can be corrected by the same principle as in the first embodiment. When a directional backlight is used, it can be used as a two-screen display device (that displays different images depending on the viewing angle) depending on the separation angle. Even in this case, the correction according to the first embodiment can be applied.
In addition, since the response performance of the liquid crystal panel varies greatly depending on the temperature, when the temperature range of the usage environment is wide, the device is often provided with a temperature sensor, and the overdrive table value is often rewritten depending on the temperature. In the first embodiment, as shown in FIG. 34, when the temperature of the use environment is taken into consideration, the correction data table 20 for each temperature (the substance is FIG. 22) in the same manner as the overdrive table 21 for each temperature is created. , 23), and the correction data value used according to the temperature is rewritten in the same manner as the overdrive table 21.
FIG. 35 is a diagram illustrating an example of the configuration of the stereoscopic display device according to the first embodiment. As shown in FIG. 35, in the stereoscopic display device, the parallax barrier 24 is installed on the front surface (or the back surface) of the liquid crystal panel 23, and the liquid crystal panel 23 is aligned with the opening (white portion in the drawing) of the parallax barrier 24. There is a stereoscopic display device configured to display an image for the left eye 26 and an image for the right eye 25. The main cause of the crosstalk in the stereoscopic display device shown in FIG. 35 is, for example, that the light from the backlight 22 irradiated to display the image for the right eye 25 is the light shielding portion of the parallax barrier 24 (the black portion in the figure). ) Is reflected again by the liquid crystal panel 23, passes through the opening of the parallax barrier 24, and exits in the direction of the left eye 26. The present embodiment can be applied even to such crosstalk. However, in the stereoscopic display device shown in FIG. 35, when a still image is displayed, the predetermined pixel of the liquid crystal panel 23 always displays an image for the right eye 25 or an image for the left eye 26. As described above, the overdrive unit 4 shown in 1 performs overdrive processing for each pixel instead of for each frame.
FIG. 36 is a diagram illustrating an example of an arrangement of the parallax barrier 24 when viewed from the display surface of FIG. There are various arrangements of the parallax barriers 24 when viewed from the display surface. For example, as shown in FIG. 36, the parallax barriers 24 are opened in a checkered pattern in units of RGB (red green blue) subpixels. . FIG. 36 shows an arrangement of the opening (white portion in the drawing) and the closing portion (black portion in the drawing) of the parallax barrier 24 as viewed from the left eye 26. Here, the following description will be given focusing on the B pixel of X = 2 and Y = 2.
The B pixel of X = 2 and Y = 2 should not be visually recognized by the left eye 26, but as described above, the adjacent G pixel of X = 2, Y = 2, X = 3, Y = 2 Crosstalk is generated as the stray light is emitted from four openings of the R pixel, the B pixel of X = 2, Y = 1, and the B pixel of X = 2, Y = 3. The amount of generated crosstalk is proportional to the display brightness of the B pixel of X = 2, Y = 2, and can be compensated by the B pixel of X = 2, Y = 3, for example. That is, the crosstalk can be corrected by setting the display luminance of the B pixel of X = 2 and Y = 3 to be darker by the amount of light leaking from the B pixel of X = 2 and Y = 2. The video input to the overdrive unit 4 shown in FIG. 1 is the same image on the left and right in the above (method using the directional backlight 11 in FIG. 2), but the stereoscopic display device (parallax barrier 24 in FIG. 35). In the method using the above, the same processing can be performed by replacing the adjacent left and right pixels of the same color.
As described above, even if correction is performed by the overdrive unit 4, correction cannot be performed with a negative gradation or a gradation exceeding 100%, and finally the correction is performed only to the level shown in FIG. I can't do that. Accordingly, the overdrive unit 4 shown in FIG. 1 is replaced with a crosstalk correction unit in the stereoscopic display device shown in FIG. 35, and the correction data unit 6 further performs black side correction based on the gradation of the pixel of interest and the gradation of the adjacent same color pixel. By calculating data and white side correction data (amount that cannot be corrected by the crosstalk correction unit), the same processing as described above (FIG. 1) can be performed.
As an actual usage example of the correction method according to the first embodiment, a method in which all processes shown in FIG. 1 are provided in the 3D display device 28 (stereoscopic display device) shown in FIG. 37, or the corrected image generation unit 3 shown in FIG. There are various application examples, such as a method in which only the PC 27 shown in FIG. 37 is provided with a PC (Personal Computer) 27 (stereoscopic image generation apparatus) or the PC 27 in FIG. In the case where the corrected image generation unit 3 is provided in the PC 27, if it is a still image, processing by software is possible, so that it is possible to improve the visibility of stereoscopic vision by taking it into a software display output unit such as a stereoscopic viewer. Since the correction method according to the present embodiment uses the device capability as correction data, some kind of calibration is required. When incorporated in software, as described above, the user can also create data by displaying a crosstalk image and a reference image without crosstalk side by side and comparing both images. On a PC partially equipped with hardware or equipped with a high-performance CPU (Central Processing Unit), real-time correction of moving images may be possible.
From the above, by performing the correction according to the first embodiment, the edge of the ghost that was visually recognized by crosstalk when not corrected is blurred to make it difficult for the human eye to visually recognize the stereoscopic display device. Can be greatly improved. In addition, the original contrast possessed by the stereoscopic display device is maintained at a location far from the region where the crosstalk occurs among the regions where the crosstalk does not occur (for example, both ends and the center of each frame image shown in FIG. 33). Compared with the method of correcting the crosstalk by reducing the contrast of the entire screen, it is possible to minimize the deterioration of the overall display quality. In this way, it is possible to reduce the crosstalk amount while maintaining the display quality as much as possible in consideration of the complicated amount of crosstalk caused by the response delay of the liquid crystal.
In the first embodiment, the processing load is the largest in 2DLPF. The second embodiment is characterized in that the processing load in the 2DLPF is reduced. The method will be described below.
FIG. 38 is a block diagram illustrating an example of a corrected image generation unit according to Embodiment 2 of the present invention. Other configurations and operations are the same as those of the first embodiment shown in FIG. In FIG. 38, a block diagram for correcting the left image 29 is shown, but the same processing is performed for the right image 30 as well.
As shown in FIG. 38, the left image 29 and the right image 30 pass through the pre-filters 31 and 32, respectively. The prefilters 31 and 32 will be described in detail later. The left image 29 and the right image 30 that have passed through the pre-filters 31 and 32 are input to the correction data unit 33, and are output after being separated into white side correction data and black side correction data in the left image 29. The white side correction data is input to the blocking unit 34, and the black side correction data is input to the blocking unit 35. In the blocking units 34 and 35, for example, 8 × 8 pixels are blocked as one block. For example, when the total number of pixels is 640 × 480, the block is 80 × 60. As a blocking method, a method of obtaining the maximum value among the 64 correction data included in one block has the highest correction effect. When obtaining the maximum value, even if there is noise of one pixel in the original video, for example, the maximum value is unconditionally taken, and it is an area that does not need to be corrected (an area with little crosstalk as a whole). However, there is a drawback that the correction amount becomes large.
In order to remove the noise described above, the pre-filters 31 and 32 are provided in the second embodiment. The prefilter may be a simple average filter, for example. However, the filter area only needs to be narrow, but if it is too wide, there is a drawback that the position of the edge is also blurred. A filter having a clear edge and effective for noise removal is a median filter. The median filter is a method in which data in the filter area are arranged in ascending or descending order, and data in the middle order is obtained as output data. Since the median filter requires data rearrangement, if the prefilter area is large, the amount of calculation becomes large. Normally, the surrounding 9 pixels including the point of interest is sufficient, but an optimal one may be determined by conducting an experiment including the type of filter.
The white side correction data and the black side correction data blocked by the blocking units 34 and 35 are input to the blocks 2DLPF 36 and 37, and the LPF is processed by the same method as that described in Expression (24) and FIGS. It is processed. However, the difference in the processing in the blocks 2DLPF 36 and 37 is that, for example, when the LPF processing is performed for each pixel in a 16 × 16 pixel region, 8 × 8 pixels are included in one block. LPF processing may be performed on × 2 blocks. That is, the blocks 2DLPF 36 and 37 perform processing in units of blocks. Further, it is preferable that the range of the LPF processing does not include its own block as shown in FIGS. 39 and 40, for example. This is because if the own block is included, the amount of correction necessary for the interpolation calculation in the subsequent interpolations 38 and 39 is smaller than the necessary amount.
The data output from the block 2DLPF 36, 37 is interpolated by interpolations 38, 39 to become information for each pixel. FIG. 41 shows a schematic diagram of interpolation. The value stored in the block approximates the value near the center of the block, and the value of the square point is interpolated from data (circles) of three blocks adjacent to the own block. When interpolation is performed using four points, interpolation is performed by the bilinear method. When it is desired to reduce the amount of calculation, interpolation can be performed by a linear method from three points excluding the point (circle) in the upper right block shown in FIG.
The processes after the interpolations 38 and 39 are the same as those in the first embodiment, and the gamma conversion unit 40 generates a corrected image (for example, the corrected left image 41 shown in FIG. 38). It is desirable that an image (for example, the left image 29 shown in FIG. 38) input to the gamma conversion unit 40 does not pass through the prefilter 31.
From the above, in the second embodiment, it is possible to reduce the calculation amount in the blocks 2DLPF 36 and 37 and the memory amount necessary for the calculation. Further, in the first embodiment, if the range in which the LPF processing in the 2DLPF 7 and 8 in FIG. It was calculated weakly, and there was a case where a sufficient correction effect could not be obtained. On the other hand, in the second embodiment, an effect is obtained that the above phenomenon is less likely to occur by obtaining the maximum value of the correction amount in the block when the block is formed.
In the first and second embodiments, the upper limit value (white side correction data) and the lower limit value (black side correction data) have been described as the limit values input to the gamma conversion units 9 and 40.
Here, the visibility of human eyes is also sensitive to a slight difference (luminance difference) at low luminance as defined by LIE of CIE 1976 (luminance 1/3). For this reason, even if there is some crosstalk on the white side, the white side is not as easily visible as the black side. Therefore, even if white crosstalk exists, the processing for calculating the upper limit value described so far can be omitted as long as the crosstalk is acceptable. As a result, the amount of calculation can be greatly reduced.
On the other hand, for example, a widely used TN (twisted nematic) type liquid crystal has a response characteristic that is much faster in response from white to black than from black to white. If such a liquid crystal is used and there are few other crosstalk factors, the processing for calculating the lower limit value described so far can be omitted. As a result, the amount of calculation can be greatly reduced.
Further, when correction is performed uniformly on the white side and the black side as shown in FIGS. 11 and 12, the contrast is greatly reduced and the image quality is deteriorated, but this main factor is uniformly on the black side. It is a correction, and the uniform correction on the white side does not cause much deterioration in image quality. For example, when the original contrast is 100: 1 (the luminance is white 100 and black 1), and there is the same 1% crosstalk on the white side and the black side, only the black side is uniform. When corrected, the contrast is 50: 1 (brightness is white 100, black 1 + 1 = 2), and when only white is corrected uniformly, it is 99: 1 (brightness is white 100-1 = 99, black 1). It is. Therefore, in the case of FIG. 1, the calculation of the white 2DLPF 7 is omitted, and the upper limit value input to the gamma conversion unit 9 is fixed (for example, the maximum crosstalk level generated on the white side, In this case, the white side is uniformly corrected, and the black side can be corrected only in the vicinity where the black side crosstalk occurs as described above. As a result, the amount of calculation can be greatly reduced and the image quality can be substantially maintained.
As described above, even when only one of the upper limit and lower limit calculations is used, the calculation amount can be greatly reduced and a good correction result can be maintained. When designing an integrated circuit so as to calculate either the upper limit or the lower limit, it is preferable to switch between the upper limit calculation and the lower limit calculation so that both upper limit and lower limit characteristics can be handled. In the case where only one of the upper limit and the lower limit is calculated, for example, in the first and second embodiments, calculation related to the method to be omitted (upper limit or lower limit) (for example, when the upper limit is omitted, in FIG. The calculation of the white side correction data, the 2DLPF 7, the value related to the white side in the correction data table 20, and the calculation of the white side correction data of the correction data unit 33, the blocking unit 34, the block 2DLPF 36, It goes without saying that the interpolation 38) can be omitted.
DESCRIPTION OF SYMBOLS 1 Left image, 2 Right image, 3 Correction image production | generation part, 4 Overdrive part, 5 Liquid crystal drive image, 6 Correction data part, 7, 8 2DLPF, 9 Gamma conversion part, 10 Correction left image, 11 Directional backlight, 12 LCD panel, 13 Right eye, 14 Left eye, 15 Left image, 16 Right image, 17 Frame selection, 18 Overdrive, 19 LCD drive image, 20 Correction data table, 21 Overdrive table, 22 Backlight, 23 LCD panel, 24 Parallax barrier, 25 right eye, 26 left eye, 27 PC, 28 3D display device, 29 left image, 30 right image, 31, 32 pre-filter, 33 correction data part, 34, 35 blocking part, 36, 37 block 2DLPF, 38 39 Interpolation, 40 Gamma conversion unit, 41 Corrected left image.
A stereoscopic image correction method for correcting a stereoscopic image displayed based on a left image and a right image,
(A) Crosstalk generated in the left image or the right image based on crosstalk characteristic data based on the gray level of the left image and the gray level of the right image when the left image and the right image are input At least one of a step of detecting the range and the crosstalk amount as black side correction data for a bright display cause and a white side correction data for a dark display cause Process,
(B) After the step (a), the black side correction data is input to a smoothing filter, and the black side correction data is converted into a smooth slope from within the range where the crosstalk occurs by the smoothing filter. The black side correction data is used as lower limit data, and the white side correction data is input to a smoothing filter, and the white side correction data is smoothed from the range where the crosstalk is generated by the smoothing filter to the outside of the range. And at least one of the steps of setting the white side correction data as upper limit data,
(C) After the step (b), based on at least one of the lower limit data and the upper limit data, gamma conversion is performed on the left image or the right image to generate a corrected left image or a corrected right image. Process,
A stereoscopic image correction method comprising:
In the step (b),
The smoothing filter divides the periphery of the pixel to be processed into a plurality of areas, and calculates a maximum absolute value of the black side correction data or the white side correction data subjected to the smoothing process for each area. The stereoscopic image correction method according to claim 1, wherein the lower limit data or the upper limit data is used.
(D) after the step (a), further comprising a step of blocking either the plurality of black side correction data or the plurality of white side correction data;
The stereoscopic image correction method according to claim 1, wherein the smoothing filter performs processing in units of blocks.
4. The method according to claim 1, further comprising: (e) a step of removing a noise component included in the left image and the right image by a pre-filter before the step (a). 3D image correction method.
5. The stereoscopic image correction method according to claim 1, wherein correction based on a temperature of a use environment is further performed on at least one of the black side correction data and the white side correction data. 6.
The solid according to any one of claims 1 to 5, further comprising a step of performing an overdrive process on the corrected left image or the corrected right image after the step (c). Image correction method.
In the step (f),
The stereoscopic image correction method according to claim 6, wherein the overdrive processing includes correction based on a temperature of a use environment.
A stereoscopic display device having an image correction function according to the stereoscopic image correction method according to claim 1.
The stereoscopic display device according to claim 8, further comprising an overdrive unit that performs an overdrive process on the corrected image generated by the image correction function.
A stereoscopic image generation device that has an image correction function according to the stereoscopic image correction method according to claim 1 and that generates and transmits a video to a stereoscopic display device,
The stereoscopic image generating apparatus, wherein the video is corrected in accordance with characteristics of the stereoscopic display apparatus.
JP2010255678A 2010-01-12 2010-11-16 Stereoscopic image correction method, stereoscopic display device, and stereoscopic image generation device Active JP5615136B2 (en)
JP2010003634 2010-01-12
JP2010255678A JP5615136B2 (en) 2010-01-12 2010-11-16 Stereoscopic image correction method, stereoscopic display device, and stereoscopic image generation device
US12/979,822 US8681148B2 (en) 2010-01-12 2010-12-28 Method for correcting stereoscopic image, stereoscopic display device, and stereoscopic image generating device
JP2011166744A true JP2011166744A (en) 2011-08-25
JP5615136B2 JP5615136B2 (en) 2014-10-29
ID=44258204
JP2010255678A Active JP5615136B2 (en) 2010-01-12 2010-11-16 Stereoscopic image correction method, stereoscopic display device, and stereoscopic image generation device
US (1) US8681148B2 (en)
JP (1) JP5615136B2 (en)
WO2012111422A1 (en) * 2011-02-15 2012-08-23 三菱電機株式会社 Image processing device, image display device, image processing method, and image processing program
JP2013051572A (en) * 2011-08-31 2013-03-14 Toshiba Corp Crosstalk correction amount evaluation device and crosstalk correction amount evaluation method
WO2013046984A1 (en) * 2011-09-26 2013-04-04 シャープ株式会社 Liquid crystal display device
EP2693760A2 (en) 2012-07-31 2014-02-05 NLT Technologies, Ltd. Stereoscopic image display device, image processing device, and stereoscopic image processing method
EP2693759A2 (en) 2012-07-31 2014-02-05 NLT Technologies, Ltd. Stereoscopic image display device, image processing device, and stereoscopic image processing method
KR20140082511A (en) * 2012-12-24 2014-07-02 엘지디스플레이 주식회사 Stereoscopic image display device and driving method thereof
JP2016090690A (en) * 2014-10-31 2016-05-23 セイコーエプソン株式会社 Video processing circuit, video processing method, electro-optic device and electronic apparatus
TWI569041B (en) 2011-02-14 2017-02-01 半導體能源研究所股份有限公司 Display device
US9270979B2 (en) * 2011-11-09 2016-02-23 Lg Electronics Inc. Apparatus and method for measuring 3-dimensional interocular crosstalk
CN102854631B (en) * 2012-09-27 2015-05-20 深圳市华星光电技术有限公司 Three-dimensional image display device and forming method thereof
TWI478146B (en) * 2013-01-15 2015-03-21 Au Optronics Corp Method for reducing crosstalk of stereoscopic image and display system thereof
JP2015197476A (en) * 2014-03-31 2015-11-09 ソニー株式会社 Signal processing method, display device, and electronic apparatus
JP2001258052A (en) * 2000-03-14 2001-09-21 Nippon Hoso Kyokai <Nhk> Stereoscopic image display device
JP2006163074A (en) * 2004-12-08 2006-06-22 Seiko Epson Corp Image signal supply method, image signal supply circuit, electrooptical apparatus and electronic device
JP2008287161A (en) * 2007-05-21 2008-11-27 Iri Ubiteq Inc Video display device and method of preparing correction data
JP2009507401A (en) * 2005-05-26 2009-02-19 リアルデー Ghost compensation to improve stereoscopic projection
JP2009080237A (en) * 2007-09-26 2009-04-16 Epson Imaging Devices Corp Dual-view display device
JP2011123230A (en) * 2009-12-10 2011-06-23 Sony Corp Display device
JP3096614B2 (en) 1995-05-30 2000-10-10 三洋電機株式会社 Video signal processing apparatus of the stereoscopic image display device
JP3305240B2 (en) 1997-10-23 2002-07-22 キヤノン株式会社 The liquid crystal display panel driving device and driving method
JP3585781B2 (en) 1999-08-31 2004-11-04 株式会社東芝 3D display device
JP2001298754A (en) 2000-04-11 2001-10-26 Tomohiko Hattori Crosstalk cancellation method and system for stereoscopic image
JP3722677B2 (en) 2000-08-18 2005-11-30 株式会社アドバンスト・ディスプレイ Liquid crystal display device
JP2004253879A (en) 2003-02-18 2004-09-09 Mitsubishi Electric Corp Stereoscopic image display
JP4136776B2 (en) * 2003-05-02 2008-08-20 キヤノン株式会社 Correction apparatus, imaging apparatus, correction method, computer-readable storage medium, and program
JP4376764B2 (en) 2004-12-01 2009-12-02 三菱電機株式会社 Stereoscopic image display device
JP2008009039A (en) 2006-06-28 2008-01-17 Epson Imaging Devices Corp Electrooptical device and electronic equipment
JP4967921B2 (en) * 2007-08-10 2012-07-04 セイコーエプソン株式会社 Apparatus, method, and program for image processing
2010-11-16 JP JP2010255678A patent/JP5615136B2/en active Active
2010-12-28 US US12/979,822 patent/US8681148B2/en active Active
JP5312698B2 (en) * 2011-02-15 2013-10-09 三菱電機株式会社 Image processing apparatus, image display apparatus, image processing method, and image processing program
KR101382058B1 (en) * 2011-08-31 2014-04-04 가부시끼가이샤 도시바 Crosstalk correction amount evaluating apparatus and crosstalk correction amount evaluating method
JP2014044396A (en) * 2012-07-31 2014-03-13 Nlt Technologies Ltd Stereoscopic image display device, image processing apparatus, and stereoscopic image processing method
US9280951B2 (en) 2012-07-31 2016-03-08 Nlt Technologies, Ltd. Stereoscopic image display device, image processing device, and stereoscopic image processing method
US10237541B2 (en) 2012-07-31 2019-03-19 Nlt Technologies, Ltd. Stereoscopic image display device, image processing device, and stereoscopic image processing method with reduced 3D moire
KR101979196B1 (en) * 2012-12-24 2019-05-16 엘지디스플레이 주식회사 Stereoscopic image display device and driving method thereof
US20110169821A1 (en) 2011-07-14
JP5615136B2 (en) 2014-10-29
US8681148B2 (en) 2014-03-25
Woods 2010 Understanding crosstalk in stereoscopic displays
US20120019529A1 (en) 2012-01-26 Display assemblies and computer programs and methods for defect compensation
CN102124490B (en) 2018-02-13 For reducing or removing the method and system of the afterimage perceived in the stereo-picture of display
KR100814160B1 (en) 2008-03-14 Image display method, image display device, and projector
US20110037829A1 (en) 2011-02-17 Display device, display method and computer program
US8670607B2 (en) 2014-03-11 Image processing method, image processing device and recording medium
JP4594510B2 (en) 2010-12-08 Transmission type image display device and driving method of transmission type image display device
EP1383343B1 (en) 2013-06-12 Autostereoscopic display
JP5299275B2 (en) 2013-09-25 Image processing apparatus and method, program, and display apparatus
RU2472234C2 (en) 2013-01-10 Apparatus for controlling liquid crystal display, liquid crystal display, method of controlling liquid crystal display, programme and data medium for programme
CN101951526B (en) 2013-02-13 Image signal processing apparatus and image display
US20100220178A1 (en) 2010-09-02 Image processing apparatus, image processing method, program, and three-dimensional image display apparatus
KR20110125733A (en) 2011-11-22 Stereoscopic image display and driving method thereof
US9230465B2 (en) 2016-01-05 Stereoscopic display apparatus and adjustment method
Ref document number: 5615136