Stereoscopic display method and apparatus

Abstract: This invention provides a stereoscopic display apparatus which can discriminate image signals for the the image signals for the right and left eyes. The basic principle of a stereoscopic apparatus according to an embodiment of this invention will be described below with reference to Figs. 2B and 2C. When the optical axes 210 and 211 of the photographing lenses are set to be parallel to each other, the position of the object image 201r in the field frame 212 is near the left end, and the position of the object image 201ℓ in the field frame 213 is near the right end. In order to detect a relative positional relationship, in the right-and-left direction, of the object on the basis of the signal waveforms shown in Fig. 2C, when the correlation calculation unit 105a performs a correlation calculation between the signal waveforms 215 and 216, the value τα corresponding to a peak value of the calculation result Cℓr(τ) is a positive value. On the other hand, when the image signals for the right and left eyes are input to the wrong sides, since the value τα corresponding to a peak value is a negative value, whether or not the right and left video signals are normally input can be discriminated by checking the polarity of the value τα.

Description: The present invention relates to the processing of stereoscopic display signals, for example in an apparatus such as a stereoscopic television system which can achieve a stereoscopic view on the basis of two, right and left image signals having a parallax. In general, a stereoscopic display apparatus achieves a stereoscopic view by displaying image signals for the right and left eyes on display units for the right and left eyes, respectively. In this case, a reproduction apparatus (display apparatus side) must discriminate the image signals for the right and left eyes from each other. For this purpose, a conventional apparatus adopts a method of adding a discrimination pulse to one image signal or changing the number of cycles of a color burst signal in one image signal on the image pickup device side. However, in the conventional stereoscopic display apparatus, the image pickup device requires a circuit for adding a discrimination signal or a circuit for changing the number of cycles of the color burst signal, while the reproduction apparatus requires a circuit for extracting the added discrimination signal or a circuit for detecting the number of cycles of the color burst signal, resulting in a complicated system arrangement. US 4145713 discloses a stereoscopic viewing device to which is connected a field recognition circuit which receives the composite video signals to be displayed. Synchronous operation at a field-by-field rate is triggered by coincidence and non-coincidence of horizontal sync pulses with coincidence pulses derived from the horizontal sync pulses. As a result, the field carrying the left eye image is always connected to the left eye lens of the viewer and the field carrying the right eye image is always coupled to the right eye lens of the viewer. As for a stereoscopic television system, a standard such as CCIR or the like is not determined yet. For this reason, even when a certain system adds a discrimination signal, the added signal cannot often be discriminated by another system. On the other hand, in place of adding such a discrimination signal, a user may connect, by himself or herself, image signals for the right and left eyes to the display units for the right and left eyes, respectively. However, if the user erroneously recognizes the image signals for the right and left eyes, if he or she keeps watching an image displayed in such a state, his or her eyes suffer considerable fatigue. An object of the present invention is to discriminate image signals for the right and left eyes to facilitate normal image display without the need for adding any special signals for discriminating the image signals for the right and left eyes. According to the present invention, there is provided a stereoscopic display apparatus as set out in claim 1. The present invention also provides a stereoscopic display method as set out in claim 11. The present invention also provides an apparatus for processing stereoscopic image signals as set out in claim 21. The present invention also provides a method for processing stereoscopic image signals as set out in claim 22. US-A-4567513 discloses a method and apparatus for producing a television image perceived by viewers to be stereoscopic. To address the problem of flicker, video processing is performed to produce globally converged alternating binocular video. US-A-4567513 discloses that the relative time of occurrence of corresponding stereo video elements within a horizontal scan can be used to determine if each corresponding stereo element pair is within the limit of binocular fusion, and that this correspondence detection can be used to implement alternation of converged stereo video elements while maintaining continuous video from one camera for unconverged video. The first step in determining if the corresponding video elements are within the limit of binocular fusion is to identify the corresponding elements through correlation measurement techniques. JP-A-3295393 discloses an apparatus to discriminate a stereoscopic picture from a normal picture, in which it is detected whether the correlation of an odd-numbered screen becomes lower than the correlation of an even-numbered screen as a voltage with a screen as reference, and the stereoscopic picture is discriminated by discriminating the level of the voltage by an appropriate time-constant. Features and advantages of embodiments of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof. BRIEF DESCRIPTION OF THE DRAWINGS In the accompanying drawings: Fig. 1 is a block diagram showing the arrangement of a stereoscopic display apparatus according to the first embodiment of the present invention; Figs. 2A to 2C are explanatory views for explaining the right/left discrimination operation executed by a right/left discrimination circuit shown in Fig. 1; Fig. 3 is a graph showing the correlation calculation result by the right/left discrimination circuit shown in Fig. 1; Fig. 4 is a circuit diagram showing the arrangement of a switching circuit shown in Fig. 1; Fig. 5 is a block diagram showing the arrangement of a right/left discrimination circuit used in a stereoscopic display apparatus according to the second embodiment of the present invention; Figs. 6A and 6B are explanatory views for explaining the right/left discrimination operation executed by a right/left discrimination circuit shown in Fig. 5; Fig. 7 is a graph showing the correlation calculation result by the right/left discrimination circuit shown in Fig. 5; Fig. 8 is a block diagram showing the arrangement of a stereoscopic display apparatus according to the third embodiment of the present invention; and Fig. 9 is a flow chart for explaining the right/left discrimination operation sequence of the third embodiment. Fig. 10A to 10C are views for explaining the operation of a display apparatus according to the fourth embodiment of the present invention; Figs. 11A and 11B are views showing the correlation calculation result in the display apparatus according to the fourth embodiment; Fig. 12 is a block diagram showing the arrangement of a switching circuit in a display apparatus according to the fifth embodiment of the present invention; and Figs. 13A and 13B are views for explaining the operation of the display apparatus according to the fifth embodiment. DESCRIPTION OF THE EMBODIMENTS (First Embodiment) The first embodiment of the present invention will be described below with reference to Figs. 1 to 4. Fig. 1 is a schematic block diagram showing the arrangement of a stereoscopic display apparatus according to this embodiment. Referring to Fig. 1, reference numerals 101 and 102 denote input terminals which respectively receive a composite video signal VIDEO1 as an image signal for the right eye and a composite video signal VIDEO2 as an image signal for the left eye. In this embodiment, the right and left composite video signals VIDEO1 and VIDEO2 are synchronized with each other, and are input in a state wherein they can be driven based on the same timing relationship. A power supply voltage for operating this display apparatus is supplied from a power supply circuit 125. When a switch in the power supply circuit 125 is turned on, the power supply voltage is supplied to respective blocks via connection lines (not shown). The input terminals 101 and 102 are respectively connected to YC separation circuits 103 and 104 each for separating the video signal into a luminance signal and a chrominance signal. The YC separation circuit 103 and 104 are connected to a right/left discrimination circuit 105 for discriminating whether or not the right and left video signals are normally input, and a switching circuit 106 for outputting the right and left video signals to appropriate blocks on the basis of the discrimination result of the right/left discrimination circuit 105. The right/left discrimination circuit 105 comprises a correlation calculation unit 105a and a discrimination unit 105b. The input terminal 101 is also connected to a synchronization separation circuit 107 for extracting a synchronization signal from the input video signal VIDEO1. The synchronization separation circuit 107 is connected to the right/left discrimination circuit 105, decoder circuits 108 and 109 for the image signals for the right and left eyes, and a timing generator 110, and outputs a synchronization signal to these circuits. The switching circuit 106 is connected to the decoder circuits 108 and 109 for the right and left eyes, and outputs the image signals for the right and left eyes to the decoder circuits 108 and 109 for the right and left eyes, respectively. The decoder circuit 108 is connected to a liquid crystal panel 115 via an RGB matrix circuit 112, an inverse γ circuit 113, and an analog driver 114. The analog driver 114 comprises a signal inversion circuit for inversion-driving the liquid crystal panel 115, an amplifier circuit for amplifying an input signal to a signal amplitude required for driving the liquid crystal panel 115, and a buffer circuit for outputting the image signal for the right eye to the liquid crystal panel 115. The analog driver 114 is connected to the timing generator 110, and its operation timing is controlled. The timing generator 110 generates timing signals for ON/OFF control of pixel transistors of the liquid crystal panel 115 and for transfer clocks of a shift register on the basis of the synchronization signal separated and output from the synchronization separation circuit 107 under the control of a system controller 111. These timing signals are input to the analog driver 114, a digital driver 116 for driving the liquid crystal panel 115, a backlight 117 for illuminating the liquid crystal panel 115 from the rear surface side, and a backlight turn-on circuit 118 for driving the backlight 117. The decoder circuit 109, an RGB matrix circuit 119, an inverse γ circuit 120, an analog driver 121, a liquid crystal panel 122, a digital driver 123, and a backlight 124 as the arrangement for processing the image signal for the left eye are respectively connected in the same manner as the above-mentioned decoder circuit 108, RGB matrix circuit 112, inverse γ circuit 113, analog driver 114, liquid crystal panel 115, digital driver 116, and backlight 117. The analog driver 121 and the digital driver 123 display an image for the left eye on the liquid crystal panel 122 in synchronism with the analog driver 114 and the digital driver 116 for the right eye on the basis of the operation timing signals output from the timing generator 110. In the above-mentioned arrangement, the video signal VIDEO1 input via the input terminal 101 is separated into a luminance signal Yri and a chrominance signal Cri by the YC separation circuit 103. The luminance signal Yri is input to the right/left discrimination circuit 105 and the switching circuit 106, and the chrominance signal Cri is input to the switching circuit 106. On the other hand, the video signal VIDEO2 input via the input terminal 102 is separated into a luminance signal Yℓi and a chrominance signal Cℓi by the YC separation circuit 104. The luminance signal Yℓi is input to the right/left discrimination circuit 105 and the switching circuit 106, and the chrominance signal Cℓi is input to the switching circuit 106. The synchronization signal extracted by the synchronization separation circuit 107 is input to the right/left discrimination circuit 105 together with the luminance signals Yri and Yℓi. The right/left discrimination circuit 105 extracts signal components corresponding to a scanning line position used for discrimination from the right and left luminance signals Yri and Yℓi by a method to be described later on the basis of the synchronization signal input from the synchronization separation circuit 107. Then, the circuit 105 discriminates whether or not the right and left video signals are normally input, and outputs a discrimination signal DET of HIGH level if it is determined that the right and left video signals are normally input; otherwise, it outputs a discrimination signal DET of LOW level. The discrimination signal DET is input to the switching circuit 106 together with the luminance signals Yri and Yℓi and the chrominance signals Cri and Cℓi. The right/left discrimination circuit 105 is also connected to the system controller 111, and the level of the discrimination signal DET is checked. The operation of the right/left discrimination circuit 105 will be described below with reference to Figs. 2A to 3. Fig. 2A is a view for explaining the relationship between an object and the fields of view of photographing lenses in an image pickup device for obtaining a stereoscopic image to be displayed on the display apparatus. Referring to Fig. 2A, reference numeral 201 denotes an object; 202 and 203, photographing lenses for the right and left eyes; and 204 and 205, image pickup elements for the right and left eyes. The field of view of the photographing lens 202 for the right eye is indicated by solid lines 206 and 207, and the field of view of the photographing lens 203 for the left eye is indicated by solid lines 208 and 209. Broken lines 210 and 211 respectively represent the optical axes of the right and left photographing lenses, and the two optical axes 210 and 211 are set to be parallel to each other. Fig. 2B is a view showing images formed on the image pickup elements 204 and 205. Referring to Fig. 2B, reference numerals 212 and 213 denote field frames of the photographing lenses for the right and left eyes, respectively; and 201r and 201ℓ, images of the object 201 formed on the right and left image pickup elements 204 and 205, respectively. Fig. 2C shows the signal waveforms of a scanning line corresponding to a position indicated by an alternate long and short dashed line 214 in Fig. 2B. Signal waveforms 215 and 216 respectively correspond to one scanning line used for discrimination of the above-mentioned luminance signals Yri and Yℓi. As can be seen from Figs. 2B and 2C, when the optical axes 210 and 211 of the photographing lenses are set to be parallel to each other, the position of the object image 201r in the field frame 212 is near the left end, and the position of the object image 201ℓ in the field frame 213 is near the right end. In order to detect a relative positional relationship, in the right-and-left direction, of the object on the basis of the signal waveforms shown in Fig. 2C, the correlation calculation unit 105a performs a correlation calculation between the signal waveforms 215 and 216. More specifically, if the signal waveform 215 in the field frame 212 is represented by Xr(t) and the signal waveform 216 in the field frame 213 is represented by Xℓ(t), a correlation calculation result (correlation parameter) Cℓr(τ) is given by: note that the integral range is one horizontal scanning period T. When the correlation calculation is executed based on equation (1), the result shown in Fig. 3 is obtained. More specifically, when the correlation calculation is executed based on image data Xr(t) for the right eye, a value τα corresponding to a peak value of the calculation result Cℓr(τ) is a positive value. On the other hand, when the image signals for the right and left eyes are input to the wrong sides, since the value τα corresponding to a peak value is a negative value, whether or not the right and left video signals are normally input can be discriminated by checking the polarity of the value τα. The switching circuit 106 will be described below with reference to Fig. 4. Fig. 4 is a circuit diagram showing the arrangement of the switching circuit 106. The switching circuit 106 has analog switches 401 to 404 for switching an input signal. The analog switches 401 to 404 are switching-controlled by a single control signal DET. More specifically, output terminals 401a to 404a are connected to h terminals 401b to 404b when the control signal DET is at HIGH level, and are connected to ℓ terminals 401c to 404c when the control signal DET is at LOW level. The output terminals 401a and 402a are connected to the decoder circuit 108 for the right eye, and the output terminals 403a and 404a are connected to the decoder circuit 109 for the left eye. As described above, the switching circuit 106 receives the luminance signals Yri and Yℓi, the chrominance signals Cri and Cℓi, and the discrimination signal DET output from the right/left discrimination circuit 105. The luminance signal Yri input from the YC separation circuit 103 for the image signal for the right eye is input to the h terminal 401b of the analog switch 401 and the ℓ terminal 403c of the analog switch 403, and the chrominance signal Cri is input to the h terminal 402b of the analog switch 402 and the ℓ terminal 404c of the analog switch 404. On the other hand, the luminance signal Yℓi input from the YC separation circuit 104 for the image signal for the left eye is input to the terminal 401c of the analog switch 401 and the h terminal 403b of the analog switch 403, and the chrominance signal Cℓi is input to the ℓ terminal 402c of the analog switch 402 and the h terminal 404b of the analog switch 404. In this arrangement, when the video signal VIDEO1 for the right eye is input to the input terminal 101, and the video signal VIDEO2 for the left eye is input to the input terminal 102, the discrimination signal DET output from the right/left discrimination circuit 105 changes to HIGH level. At this time, since all the output terminals 401a to 404a of the analog switches 401 to 404 are connected to the h terminals 401b to 404b, output signals Yro, Cro, Yℓo, and Cℓo from the output terminals 401a to 404a are respectively equal to the input signals Yri, Cri, Yℓi, and Cℓi. On the other hand, when the video signal VIDEO2 for the left eye, which is to be input to the input terminal 102, is input to the input terminal 101, and the video signal VIDEO1 for the right eye, which is to be input to the input terminal 101, is input to the input terminal 102, since the discrimination signal DET output from the right/left discrimination circuit 106 changes to LOW level, all the output terminals 401a to 404a of the analog switches 401 to 404 are connected to the input terminals 401c to 404c, and the output signals Yro, Cro, Yℓo, and Cℓo from the output terminals 401a to 404a are respectively equal to the input signals Yℓi, Cℓi, Yri, and Cri. Therefore, even when the video signals for the right and left eyes are input to the wrong sides, the image signal for the right eye can be normally input to the decoder circuit 108 for the right eye, and the image signal for the left eye can be normally input to the decoder circuit 109 for the left eye. Referring back to Fig. 1, the chrominance signal Cro of the video signal for the right eye, which is input to the decoder circuit 108 for the right eye by the above-mentioned method, is converted into baseband color difference signals R-Yr and B-Yr, and the converted signals are input to the RGB matrix circuit 112 in synchronism with the synchronization signal. On the other hand, the luminance signal Yro is output as a signal Yr without being subjected to any special processing. The RGB matrix circuit 112 respectively converts the color difference signals R-Yr and B-Yr, and the luminance signal Yr into R, G, and B signals Rr, Gr, and Br, and the R, G, and B signals are input to the analog driver 114 after they are subjected to gradation correction in the inverse γ circuit 113. The analog driver 114 inverts and switches the R, G, and B signals Rr, Gr, and Br in accordance with an input inversion control signal from the timing generator 110, amplifies these signals, and outputs analog image signals to the liquid crystal panel 115 for the right eye. The liquid crystal panel 115 displays the input analog image signals under the driving control of the digital driver 116. At this time, the system controller 111 monitors the output state of the discrimination signal DET output from the right/left discrimination circuit 105. When the controller 111 determines that the output state of the discrimination signal is not inverted for a predetermined period of time, i.e., stabilized, it controls the timing generator 110 to turn on the backlight 117. On the other hand, the decoder circuit 109, RGB matrix circuit 119, inverse y circuit 120, analog driver 121, liquid crystal panel 122, digital driver 123, and backlight 124 constitute the arrangement for processing the image signal for the left eye, and operate in the same manner as the above-mentioned decoder circuit 108, RGB matrix circuit 112, inverse γ circuit 113, analog driver 114, liquid crystal panel 115, digital driver 116, and backlight 117. Thus, a detailed description thereof will be omitted. As described above, according to this embodiment, even when the video signals for the right and left eyes are input to the wrong sides, the right/left discrimination circuit 105 can discriminate such a state, and the switching circuit 106 can switch circuits, so that the image signal for the right eye can be normally input to the decoder circuit 108 for the right eye, and the image signal for the left eye can be normally input to the decoder circuit 109 for the left eye. (Second Embodiment) The second embodiment of the present invention will be described below with reference to Figs. 5 to 7. The display apparatus according to this embodiment adopts a right/left discrimination circuit 105' shown in Fig. 5 in place of the right/left discrimination circuit 105 shown in Fig. 1 in the first embodiment described above. The right/left discrimination circuit 105' comprises field memories 501 and 502, a region setting unit 503, a correlation calculation unit 504, and a discrimination unit 505. Note that other arrangements are the same as those of the display apparatus shown in Fig. 1 in the first embodiment, and will be described while quoting Fig. 1. A luminance signal Yri separated from a video signal VIDEO1 by the YC separation circuit 103 is input to the field memory 501, and a luminance signal Yℓi separated from a video signal VIDEO2 by the YC separation circuit 104 is input to the field memory 502. The read/write control of the field memories 501 and 502 is executed by the system controller 111. A synchronization signal extracted by the synchronization separation circuit 107 is input to the region setting unit 503. The region setting unit 503 extracts only image data in a range, in which it is estimated that a principal object is present, from the right and left image signals. In a normal photographing operation, since the principal object is normally located at the center of the frame, image data near the center of the frame are extracted from the luminance signals Yri and Yℓi, as indicated by broken lines in Fig. 6B, and the extracted data are input to the correlation calculation unit 504. The correlation calculation unit 504 executes a correlation calculation between the image signals for the right and left eyes in the same manner as in the first embodiment, and the discrimination unit 505 discriminates, based on the correlation calculation result, whether or not the right and left video signals are normally input. As a result of discrimination, if the right and left video signals are normally input, a discrimination signal DET of HIGH level is output; otherwise, a discrimination signal DET of LOW level is output. The operation of the right/left discrimination circuit 105' will be described below with reference to Figs. 6A to 7. Fig. 6A is a view for explaining objects and the fields of view of photographing lenses in an image pickup device for obtaining a stereoscopic image to be displayed on the stereoscopic display apparatus, and illustrates a state wherein objects 601 and 602 are added to the state of Fig. 2A in the first embodiment. Fig. 6B shows images formed on the image pickup elements 204 and 205 in Fig. 6A. Referring to Fig. 6B, reference numerals 603 and 604 denote field frames of the photographing lenses for the right and left eyes, respectively; 601r and 601ℓ, images of the object 601 formed on the right and left image pickup elements 204 and 205, respectively; and 602r and 602ℓ, images of the object 602 formed on the right and left image pickup elements 204 and 205, respectively. The region setting unit 503 sets regions indicated by broken lines 605 and 606 in Fig. 6B in the field frames 603 and 604. When the correlation calculation between two image data in these ranges is executed, a correlation parameter Cℓr(τ) shown in Fig. 7 is obtained. As can be seen from Fig. 7, when there are a plurality of objects, a clear peak value does not appear. However, as can be understood from a comparison between an area (integral value) Sa of a region a satisfying τ > 0 indicated by hatching in Fig. 7, and an area (integral value) Sb of a region b satisfying τ < 0, Sa > Sb. Therefore, by comparing the areas Sa and Sb of the regions a and b, when Sa > Sb, it is determined that the right and left image data are normally input, and when Sa < Sb, it is determined that the right and left image data are input to the wrong sides. As described above, according to this embodiment, when there are a plurality of objects, the correlation calculation is performed for the entire data in a region where it is estimated that the objects are present, in place of the correlation calculation using image data for one scanning line. Therefore, background images in the field frames can be removed, and right/left discrimination can be accurately performed for an object with a complicated shape. (Third Embodiment) The third embodiment of the present invention will be described below with reference to Figs. 8 and 9. Fig. 8 is a block diagram showing the arrangement of a display apparatus according to this embodiment. This display circuit comprises, as new circuits, an input detection circuit 130 for detecting inputs of video signals, a synchronization separation circuit 131 for extracting a synchronization signal from a video signal VIDEO2 for the left eye, and a timer 132 which is connected to the system controller 111 and measures time from the input timing of the video signals. The input detection circuit 130 is connected to the synchronization separation circuits 107 and 131, and receives synchronization signals separated from video signals VIDEO1 and VIDEO2. Furthermore, the input detection circuit 130 is connected to the right/left discrimination circuit 105 and the system controller 111, and outputs an input detection signal to the right/left discrimination circuit 105 and the system controller 111. The right/left discrimination circuit 105 is not connected to the switching circuit 106, and outputs a discrimination signal DET to the system controller 111. The switching control of the switching circuit 106 is executed by the system controller 111. Other arrangements are the same as those in Fig. 1 in the first embodiment, and the same reference numerals in Fig. 8 denote the same parts as in Fig. 1. A video signal VIDEO2 input via the input terminal 102 is input to the synchronization separation circuit 131, and a synchronization signal extracted by the circuit 131 is input to the input detection circuit 130. At the same time, a synchronization signal extracted, by the synchronization separation circuit 107, from a video signal VIDEO1 input via the input terminal 101 is also input to the input detection circuit 130. The input detection circuit 130 detects the input of the image signals by checking, e.g., the pulse intervals of the two synchronization signals. The right/left discrimination operation sequence executed in the display apparatus with the above arrangement will be described below with reference to the flow chart shown in Fig. 9. When the power switch of the power supply circuit 125 is turned on (step S901), the input detection circuit 130 starts its operation (step S902). If it is detected that the video signals are input to both the input terminals 101 and 102, the input detection circuit 130 outputs an input detection signal indicating the input of the video signals to the system controller 111. Upon reception of the input detection signal, the system controller 111 starts the timer 132 (step S903), and starts the operation of the right/left discrimination circuit 105 (step S904). The right/left discrimination circuit 105 repetitively performs the right/left discrimination operation by the above-mentioned method until a predetermined period of time elapses from the start of the timer, and outputs the discrimination results to the system controller 111 (step S905). The system controller 111 stores all the discrimination results (HIGH or LOW levels of the discrimination signals) input from the right/left discrimination circuit 105 before an elapse of the predetermined period of time. After the elapse of the predetermined period of time, the system controller 111 stops the timer 132 (step S906), and compares the numbers of HIGH- and LOW-level signals of the obtained discrimination results (step S907). In an initial state after power-ON, the output terminals 401a to 404a of the analog switches 401 to 404 in the switching circuit 106 are connected to the h terminals 401b to 404b. If the system controller 111 determines in step S907 that the number of HIGH-level discrimination signals DET is larger than that of LOW-level discrimination signals DET, it maintains the switching circuit 106 in the initial state; otherwise, it switches the output terminals 401a to 404a to the ℓ terminals 401c to 404c (step S908). Upon completion of the operation of the switching circuit 106, the system controller 111 controls the timing generator 110 to drive the backlight turn-on circuit 118 (step S909). In this state, the liquid crystal panels 115 and 122 are set in an image display state, and keep displaying an image until the power switch is turned on (step S910). As described above, according to this embodiment, since the right and left signals are finally discriminated based on the majority rule after an elapse of a predetermined period of time from the input of the right and left video signals, the discrimination can be performed more accurately. Furthermore, the switching circuit is controlled in accordance with the discrimination result, and is not switched once the discrimination result is obtained. For this reason, the operation during display can be stabilized. As described above, according to the stereoscopic display apparatus of each of the above embodiments of the present invention, in a stereoscopic display apparatus which receives two different image signals, and displays the two different image signals on two display means for the right and left eyes, respectively, the right/left discrimination means discriminates, based on a correlation between the input two different image signals, if each of the two different image signals corresponds to a signal for the right or left eye, and the image signals output to the two display means are switched on the basis of the discrimination result. Therefore, the image signals for the right and left eyes can be accurately discriminated and displayed without adding any special signal for discriminating the image signals for the right and left eyes from each other. According to the stereoscopic display apparatus of an above embodiment of the present invention, since the right/left discrimination means discriminates, in a region set by the region setting means, if each of the two different image signals corresponds to a signal for the right or left eye, the right/left discrimination can be accurately performed for an object with a complicated shape in addition to the above effect. According to the stereoscopic display apparatus of an above embodiment of the present invention, the signal input discrimination means discriminates if the two different image signals are input. The right/left discrimination means discriminates signals for the right and left eyes a plurality of number of times for a predetermined period of time from when the signal input discrimination means discriminates that the two different image signals are input, and determines the majority of the discrimination results. Thereafter, the image signals are switched by the switching means on the basis of the result corresponding to the majority. Therefore, whether or not image signals for the right and left eyes are normally input can be discriminated more accurately. Further, since the switching operation of image signals by the switching means is stopped after the elapse of the predetermined period of time, the operation during display of the display apparatus can be stabilized. (Fourth Embodiment) The fourth embodiment of the present invention will be described with reference to Figs. 10A to 10C, 11A, and 11B. Note that the basic arrangement of a display apparatus of this embodiment is the same as that of the first embodiment in Fig. 1, and the arrangement of a right/left discrimination circuit of the fourth embodiment is identical to that in Fig. 5. The fourth embodiment will also be described with reference to Figs. 1 and 5. In the above-mentioned embodiments, the optical axes of the right and left cameras are set to be parallel to each other. However, in the fourth embodiment, the optical axes of right and left cameras cross each other at a given vergent angle. Fig. 10A is a view showing a state in which spherical objects 1013, 1001, and 1012 are vertically arranged on a table 1018, and optical axes 1011 and 1010 of the left and right cameras are focused on the object 1001. In this case, the images of the right and left cameras are shown in Figs. 10B and 10C. Fig. 10B shows discrimination regions 1016 and 1017 defined at locations where the objects are present as in the second embodiment. When a correlation calculation is performed for these discrimination regions 1016 and 1017 as in the second embodiment, a graph shown in Fig. 11A is obtained. In this case, since the optical axes 1011 and 1010 of the left and right cameras are directed toward the objects, the correlation values are almost symmetrical about τ = 0, unlike in Fig. 7. The right/left discrimination operation cannot be performed by comparing a region a with a region b. Fig. 10C shows a state in which the discrimination regions 1016 and 1017 are set below the central portion of the frame using a region setting unit 503 in Fig. 5. In general, within a photographing frame, when a camera faces toward a principal object, an object photographed in the lower portion of the frame is located in the left portion of the frame in the left camera and in the right portion of the frame in the right camera because the object in the lower portion of the frame is located in front of the principal object. For this reason, correlation values obtained when the discrimination regions 1016 and 1017 are defined, as shown in Fig. 10C, are given as follows. The region a having a positive τ values has a larger area than the region b having a negative τ values, as shown in Fig. 11B. Therefore, the areas of the regions a and b are compared with each other to allow right/left discrimination as in the second embodiment. Note that the above description applies to a case in which an object is photographed from a camera above the object. However, when an object is photographed by a camera below the object, the discrimination regions 1016 and 1017 are set above the central portion of the frame by the region setting unit 503, and the following processing is performed to allow right/left discrimination, as a matter of course. According to this embodiment, right/left discrimination can be performed even if the optical axes 1011 and 1010 of the left and right cameras are not set to be parallel to each other. (Fifth Embodiment) The fifth embodiment of the present invention will be described with reference to Figs. 12, 13A, and 13B. The basic arrangement of a display apparatus according to this embodiment is the same as that of the first embodiment in Fig. 1, and the fifth embodiment will also be described with reference to Figs. 1 and 5. The fifth embodiment is different from the first embodiment in the arrangement of a right/left discrimination circuit. Fig. 12 is a block diagram showing the arrangement of a right/left discrimination circuit 6b in the display apparatus according to this embodiment. Referring to Fig. 12, a signal input to the right/left discrimination circuit 6b is luminance signals Yri and Yli, and a synchronization signal. A signal output from the right/left discrimination circuit 6b is also a discrimination signal DET. Unlike in the first embodiment, the fifth embodiment additionally includes first and second field memories 1201 and 1202, an object extraction circuit 1203, a region discrimination circuit 1204, a size comparison circuit 1205, and a discrimination circuit 1206. The right and left luminance signals Yri and Yli are temporarily stored in the first and second field memories 1201 and 1202. Data exchange is performed between the field memories 1201 and 1202 and the object extraction circuit 1203 to extract an object within the frame. The region discrimination circuit 1204 discriminates whether the extracted object is located in the left or right half of the frame. In addition, the sizes of the right and left input images of the identical object are compared by the size comparison circuit 1205. Right/left discrimination is then performed by the discrimination circuit 1206 on the basis of the comparison result. This discrimination method is shown in Figs. 13A and 13B. Fig. 13A shows a state in which two objects 1312 and 1313 are photographed by left and right cameras whose optical axes 1311 and 1310 have a given vergent angle. In this case, the photographing frames are shown in Fig. 13B. In this embodiment, object portions of the images shown in Fig. 13B are extracted by the object extraction circuit 1203 in accordance with a contour extraction method or the like, and the right and left corresponding object images are specified in accordance with a correlation calculation or the like. In this case, an image 1312ℓ corresponds to an image 1312r, and an image 1313ℓ corresponds to an image 1313r. The region discrimination circuit 1204 then discriminates whether each of the corresponding objects is located in the right or left half of the frame. This can be easily known in accordance with addresses of data in the first and second field memories 1201 and 1202. In addition, the sizes of the objects are compared with each other by the size comparison circuit 1205. This size comparison is performed as follows. Correlation calculations are performed while the image magnification is changed step by step. An image magnification corresponding to the maximum correlation value is discriminated, and size comparison is performed at this image magnification. Note that although the region discrimination circuit discriminates whether each of the corresponding objects is located in the right or left half of the frame, the area of a region to the left of the center of the object is compared with the area of a region to the right of the center of the object, and a larger region is selected, as a matter of course. In the object extraction circuit 1202, the objects are subjected to segmentation in accordance with contour extraction to perform matching processing. Alternatively, the object extraction circuit 1202 may determine the image magnification described with reference to the size comparison circuit 1205, and matching processing between the right and left images may be performed at the determined image magnification. This matching processing is performed after the objects of the right and left images are scaled. In the processing of the size comparison circuit 1205 and the discrimination circuit 1206, scaling data of the objects of the matched right and left images are equivalent to the size comparison result between the objects. Therefore, right/left discrimination can be performed on the basis of the scaling data for the objects. As can be apparent from Fig. 11B, the image of the right camera is larger than that of the left camera in the right half of the frame. However, the image of the left camera is larger than that of the right camera in the left half of the frame. For this reason, the region discrimination circuit 1204 in Fig. 12 discriminates that a larger image of the object 1312 discriminated to be located on the right side is discriminated as the image of the right camera. To the contrary, a larger image of the object 1313 discriminated to be located on the left side is discriminated as the image of the left camera. Figs. 12, 13A, and 13B have exemplified that the number of objects is two. However, when the number of corresponding objects is increased, precision of right/left discrimination can be improved. According to this embodiment, right/left discrimination can be performed when the optical axes of the right and left cameras are not set to be parallel to each other as in the first and second embodiments or when an appropriate object is not photographed in the lower portion of the frame as in the fourth embodiment. As has been described above, in embodiments of the present invention, right and left images can be correctly connected with a simple arrangement without adding a circuit for adding a right/left discrimination signal to the image pickup device. As many apparently widely different embodiments of the present invention can be made without departing from the scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended claims.

Claims: A stereoscopic display apparatus, comprising: means (101, 102) for receiving two different image signals defining stereoscopic images to be displayed as right eye and left eye images; and means (115, 122) for displaying the two different image signals on respective display means for the right and left eyes to display the stereoscopic images; characterised by : right/left discrimination means (105; 105'; 6b) for discriminating, based on a correlation between the two different input image signals, whether an input signal is a signal for the right or left eye. The apparatus according to claim 1, further comprising switching means (106) for switching the signals output to the display means (115, 122) on the basis of a discrimination result from the right/left discrimination means. The apparatus according to claim 2, further comprising signal input discrimination means (130) for discriminating whether or not the two different image signals are input, wherein said right/left discrimination means (105) is arranged to discriminate the signals for the right and left eyes a plurality of number of times for a predetermined period of time from when said signal input discrimination means determines that the two different image signals are input, and to determine a majority of discrimination results, and wherein said switching means (106) is arranged to switch the image signals on the basis of a result corresponding to the majority. The apparatus according to claim 3, wherein the switching means (106) is arranged to stop the switching operation of the image signals after the elapse of the predetermined period of time. The apparatus according to any preceding claim, wherein said right/left discrimination means (105; 105') comprises correlation value calculation means (105a; 504) for calculating a correlation value representing the correlation between image data of the two different image signals, and means (105b; 505) for discriminating based on the calculated correlation value which of the two different image signals corresponds to a signal for the right or left eye. The apparatus according to any of claims 1 to 4, wherein said right/left discrimination means (105; 105') comprises correlation value calculation means (105a; 504) for calculating a correlation value representing the correlation between image data of the two different image signals, integral value calculation means (105a; 504) for calculating an integral value of the correlation values, and means (105b; 505) for discriminating based on the calculated integral value which of the two different image signals corresponds to a signal for the right or left eye. The apparatus according to any preceding claim, wherein said right/left discrimination means (105') comprises region setting means (503) for setting a discrimination region for discriminating which of the two different image signals corresponds to a signal for the right or left eye. The apparatus according to claim 7, wherein: the discrimination region is a window region set in an upper portion of each of regions of the image data of the two different image signals; and the two input image signals are signals picked up by a plurality of image pickup devices arranged such that optical axes of said plurality of image pickup devices cross each other at a predetermined angle. The apparatus according to claim 7, wherein the discrimination region is a window region set in a lower portion of each of regions of the image data of the two different image signals; and the two input image signals are signals picked up by a plurality of image pickup devices arranged such that optical axes of said plurality of image pickup devices cross each other at a predetermined angle. The apparatus according to any preceding claim, wherein said right/left discrimination means (6b) comprises: matching means (1203) for extracting contours of image data of the two different image signals to obtain shapes of objects and for matching the shapes of the objects in the image data of the two different image signals; and region discrimination means (1204) for discriminating whether the matched objects belong to left or right portions of the regions of the image data; and wherein the right/left discriminating means (6b) is arranged to discriminate each of the two different image signals as a signal for a right or left eye on the basis of a difference between the sizes of the matched objects and the discrimination result data from said region discrimination means. A stereoscopic display method, comprising: receiving two different image signals defining stereoscopic images to be displayed as right eye and left eye images; and displaying the two different image signals on respective display means for the right and left eyes to display the stereoscopic images; characterised by : a right/left discriminating step of discriminating, based on a correlation between the two different input image signals, whether an input signal is a signal for the right or left eye. The method according to claim 11, further comprising the step of switching the signals output for display on the basis of the result of the right/left discriminating step. The method according to claim 12, further comprising a signal input discrimination step of discriminating whether or not the two different image signals are input, wherein said right/left discrimination step discriminates the signals for the right and left eyes a plurality of number of times for a predetermined period of time from when said signal input discrimination step determines that the two different image signals are input, and determines a majority of discrimination results, and wherein said switching step switches the image signals on the basis of a result corresponding to the majority. The method according to claim 13, wherein, in the switching step, the switching operation of the image signals is stopped after the elapse of the predetermined period of time. The method according to any of claims 11 to 14, wherein said right/left discrimination step comprises a correlation value calculation step of calculating a correlation value representing the correlation between image data of the two different image signals, and discriminates based on the calculated correlation value which of the two different image signals corresponds to a signal for the right or left eye. The method according to any of claims 11 to 14, wherein said right/left discrimination step comprises a correlation value calculation step of calculating a correlation value representing the correlation between image data of the two different image signals, and an integral value calculation step of calculating an integral value of the correlation values, and discriminates based on the calculated integral value which of the two different image signals corresponds to a signal for the right or left eye. The method according to any of claims 11 to 16, wherein said right/left discrimination step comprises a region setting step of setting a discrimination region for discriminating which of the two different image signals corresponds to a signal for the right or left eye. The method according to claim 17, wherein: the discrimination region is a window region set in an upper portion of each of regions of the image data of the two different image signals; and the two input image signals are signals picked up by a plurality of image pickup devices arranged such that optical axes of said plurality of image pickup devices cross each other at a predetermined angle. The method according to claim 17, wherein: the discrimination region is a window region set in a lower portion of each of regions of the image data of the two different image signals; and the two input different image signals are signals picked up by a plurality of image pickup devices arranged such that optical axes of said plurality of image pickup devices cross each other at a predetermined angle. The method according to any of claims 11 to 19, wherein said right/left discrimination step comprises: a matching step of extracting contours of image data of the two different image signals to obtain shapes of objects and matching the shapes of the objects in the image data of the two different image signals; and a region discrimination step of discriminating whether the matched objects belong to left or right portions of the regions of the image data; and wherein each of the two different image signals is discriminated as a signal for a right or left eye on the basis of a difference between the sizes of the matched objects and the discrimination result from said region discrimination step. An apparatus for processing stereoscopic image signals, comprising: means (101, 102) for receiving two different image signals defining stereoscopic images to be displayed as right eye and left eye images; and characterised by : left/right discrimination means (105; 105'; 6b) for discriminating, based on a correlation between the two different input image signals, whether an input signal is a signal for the right or left eye. A method for processing stereoscopic image signals, comprising: receiving two different image signals defining stereoscopic images to be displayed as right eye and left eye images; and characterised by : discriminating, based on a correlation between the two different input image signals, whether an input signal is a signal for the right or left eye.

Inventors: MURAMOTO TOMOTAKA, MURAMOTO, TOMOTAKA
Applicants: CANON KK, CANON KABUSHIKI KAISHA
Application year: 1995
Main classification: H04N13
IPC codes: H04N15, H04N13