Abstract:
According to some aspects, an image processing apparatus is provided, comprising circuitry configured to receive an input image, the input image being supplied as a stereoscopic image including a left image for a left eye and a right image for a right eye, calculate depth information for each of a plurality of sub-regions of the input image based at least in part on the right image and the left image, and determine, for each of the plurality of sub-regions of the input image, at least one luminance component based at least in part on the depth information and a function indicating a relationship between depth information and luminance value.

Description:
CROSS REFERENCES TO RELATED APPLICATIONS 
       [0001]    This application is a continuation of and claims the benefit under 35 U.S.C. §120 of U.S. patent application Ser. No. 14/150,912, titled “IMAGE PROCESSING APPRATUS, IMAGE PROCESSING METHOD AND PROGRAM,” filed on Jan. 9, 2014, which is a continuation of U.S. patent application Ser. No. 12/951,116, titled “IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD AND PROGRAM,” filed on Nov. 22, 2010, now U.S. Pat. No. 8,660,337, issued Feb. 25, 2014, which claims priority under 35 U.S.C. §119(a) to Japanese Patent Application JP 2009-270077, filed on Nov. 27, 2009. The entire contents of these applications are hereby incorporated by reference in their entireties. 
     
    
     BACKGROUND OF THE INVENTION 
       [0002]    1. Field of the Invention 
         [0003]    The present invention relates to an image processing apparatus, an image processing method and a program, and particularly relates to an image processing apparatus, an image processing method and a program capable of providing 3D images with less sense of discomfort and uncomfortable feeling for human beings by adjusting parameters of monocular 3D information based on visual sense characteristics of human beings. 
         [0004]    2. Description of the Related Art 
         [0005]    As a method of displaying a 2D image on a 2D display and allowing a viewer to perceive the 2D image as a 3D image, there exists a method of presenting a 2D image for a left eye and a 2D image for a right eye in which binocular parallax (parallax between the left eye and the right eye) to the left and right eyes of the viewer respectively. 
         [0006]    As information for allowing a human to perceive stereoscopic effect and depth of an object, there are binocular 3D information by both eyes and monocular 3D information by a single eye. A human perceives stereoscopic effect and depth of the object or space by combining the monocular 3D information and the binocular 3D information. As the binocular 3D information, for example, binocular parallax, horizontal convergence and the like can be cited. As the monocular 3D information, for example, shading, contrast, color, a spatial frequency, shielding relation and the like can be cited. 
         [0007]    When stereoscopic effect and depth are desired to be enhanced in the case of displaying the 2D image on the 2D display and allowing the viewer to perceive the 2D image as the 3D image, for example, a method of increasing binocular parallax which is one of the binocular 3D information can be considered. 
         [0008]    However, to increase the binocular parallax has the following problems in the light of an ocular structure and visual sense characteristics of human beings. That is, human eyeballs are normally in a parallel or a rather inward convergence state, therefore, when the binocular parallax is increased more than the distance between pupils, the eyeballs are in a divergence state in which both eyes are directed to the outside. The distance between pupils differs depending on the age or sex, therefore, a person having distance between pupils which is smaller than the normal distance is liable to be in the divergence state. 
         [0009]    In the real world, sight lines of both eyes are directed to a gaze point as well as the focus of eyes is achieved on the point, therefore, distance of convergence of eyeballs corresponds to distance of adjustment thereof. However, when allowing the viewer to perceive the 3D image by the 2D image for the left eye and the 2D image for the right eye, the convergence can be adjusted on a position perceived as the 3D image, while the adjustment is focused on an image display surface, therefore, the distance by convergence of eyeballs does not corresponds to the distance by adjustment thereof. Accordingly, to emphasis stereoscopic effect and depth by increasing binocular parallax changes the distance by the convergence of eyeballs and the distance by the adjustment to a direction not correspond to each other, which may allow the viewer to perceive artificiality or to feel discomfort and visual fatigue. 
         [0010]    In order to reduce uncomfortable feeling and visual fatigue, a method of adjusting the binocular parallax is proposed. For example, in a method proposed in Japanese Patent No. 3749227 (Patent Document 1), plural sample images in which binocular parallax is set to different values are presented and whether the presented images are permitted or not is allowed to be responded to adjust the binocular parallax. 
         [0011]    However, when uncomfortable feeling and visual fatigue of the viewer are intended to be reduced, the binocular parallax is basically adjusted to a direction of reducing the stereoscopic effect and depth, therefore, realistic sensation and reality are reduced. Additionally, when stereoscopic effect and depth perceived by binocular 3D information are different from stereoscopic effect and depth perceived from monocular 3D information, the viewer may feel artificiality. 
         [0012]    Therefore, it is not preferable that stereoscopic effect and depth sense of the 3D image are enhanced by increasing the binocular parallax. 
         [0013]    On the other hand, a method of enhancing stereoscopic effect and depth sense by using monocular 3D information is also proposed. For example, in JP-A-2001-238231 (Patent Document 2), a method of changing characteristics of shading, shielding relation and a blurring state according to a depth position of an object in an image to enhance the depth sense is proposed. 
       SUMMARY OF THE INVENTION 
       [0014]    However, in Patent Document 2, which parameter should be set to which value based on which calculation equation is not specifically disclosed. Even when the value is set by trial and error, it is not certified that an obtained 2D image for the left eye and a 2D image for the right eye are natural and comfortable for human beings, and they may rather the viewer to feel artificiality or uncomfortable feeling or they may cause visual fatigue. 
         [0015]    In view of the above, it is desirable to provide 3D images with lesser sense of discomfort and uncomfortable feeling for human beings by adjusting parameters of monocular 3D information based on visual sense characteristics of human beings. 
         [0016]    According to one embodiment of the invention, there is provided an image processing apparatus including a depth information extraction means for extracting depth information from an input 3D image, a luminance extraction means for extracting luminance components of the 3D image, a contrast extraction means for extracting contrast components of the 3D image based on the luminance components of the 3D image extracted by the luminance extraction means, a storage means for storing a performance function indicating relation between the contrast components of the 3D image and depth amounts subjectively perceived, which is determined based on visual sense characteristics of human beings and a contrast adjustment means for calculating present depth amounts of the inputted 3D image from the contrast components of the 3D image extracted by the contrast extraction means based on the performance function with respect to at least one of a near side region and a deep side region of the inputted 3D image which are determined from the depth information extracted by the depth information extraction means and adjusting contrast components of the inputted 3D image based on the calculated present depth amounts and a set depth adjustment amount. 
         [0017]    According to one embodiment of the invention, there is provided an image processing method of an image processing apparatus storing a performance function indicating relation between contrast components of the 3D image and depth amounts subjectively perceived, which is determined based on visual sense characteristics of human beings and performing adjustment of depth sense of the inputted 3D image, which includes the steps of extracting depth information from the 3D image, extraction luminance components of the 3D image, extraction of contrast components of the 3D image based on the extracted luminance components of the 3D image, calculating present depth amounts of the inputted 3D image from the contrast components of the extracted 3D image based on the performance function with respect to at least one of a near side region and a deep side region of the inputted 3D image which are determined from the extracted depth information and adjusting contrast components of the inputted 3D image based on the calculated present depth amounts and the set depth adjustment amount. 
         [0018]    According to one embodiment of the invention, there is provided a program allowing a computer to execute processing of extracting depth information from an inputted 3D image, extracting luminance components of the 3D image, extracting contrast components of the 3D image based on the extracted luminance components of the 3D image, calculating present depth amounts of the inputted 3D image which are subjectively perceived from the extracted contrast components of the 3D image based on a performance function indicating relation between contrast components of the 3D image and the depth amounts subjectively perceived, which is determined based on visual sense characteristics of human beings with respect to at least one of a near side region and a deep side region of the inputted 3D image which are determined from the extracted depth information, and adjusting contrast components of the inputted 3D image based on the calculated present depth amounts and a set depth adjustment amount. 
         [0019]    According to the embodiments of the invention, depth information is extracted from the inputted 3D image, luminance components of the 3D image are extracted, contrast components of the 3D image are extracted based on the extracted luminance components of the 3D image, present depth amounts of the inputted 3D image which are subjectively perceived are calculated from the extracted contrast components of the 3D image based on the performance function indicating relation between contrast components of the 3D image and the depth amounts subjectively perceived, which is determined based on visual sense characteristics of human beings with respect to at least one of a near side region and a deep side region of the inputted 3D image which are determined from the extracted depth information, and contrast components of the inputted 3D image are adjusted based on the calculated present depth amounts and the set depth adjustment amount. 
         [0020]    The image processing apparatus may be an independent apparatus as well as an internal block forming one apparatus. 
         [0021]    According to the embodiments of the invention, the depth sense of the 3D image can be enhanced. 
         [0022]    Also according to the embodiments of the invention, parameters of monocular 3D information are adjusted based on visual sense characteristics of human beings, thereby providing the 3D image with lesser sense of discomfort or uncomfortable feeling for human beings. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0023]      FIG. 1  is a block diagram showing a configuration example of an image processing apparatus according to a first embodiment of the invention; 
           [0024]      FIG. 2  shows performance functions obtained by quantifying relation between Michelson contrasts C obtained by visual experiments and depth amounts D substantially perceived by contrast; 
           [0025]      FIG. 3  is a flowchart for explaining contrast adjustment processing performed by the image processing apparatus of  FIG. 1 ; 
           [0026]      FIG. 4  shows an example of a 3D image when supplied in the first data format; 
           [0027]      FIG. 5  shows an example of a depth image obtained by visualizing depth information extracted from the 3D image; 
           [0028]      FIG. 6  shows an example of a luminance image generated by extracting luminance components; 
           [0029]      FIG. 7  shows an example of spatial frequency component images obtained by visualizing the extraction results obtained by extracting respective spatial frequency components; 
           [0030]      FIG. 8  is a block diagram showing a configuration example of an image processing apparatus according to a second embodiment of the invention; 
           [0031]      FIG. 9  is a flowchart for explaining contrast adjustment processing performed by the information processing apparatus of  FIG. 8 ; and 
           [0032]      FIG. 10  is a block diagram showing a configuration example of a computer according to an embodiment of the invention. 
       
    
    
     DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0033]    Hereinafter, modes for carrying out the invention (referred to as embodiments in the following description) will be explained. The explanation is made in the following order. 
         [0034]    1. First Embodiment (an embodiment of changing depth sense by adjusting contrast) 
         [0035]    2. Second Embodiment (an embodiment capable of adjusting contrast while reflecting user&#39;s preference) 
       1. First Embodiment 
     Configuration Block Diagram of an Image Processing Apparatus 
       [0036]      FIG. 1  shows a configuration example of an image processing apparatus according to a first embodiment of the invention. 
         [0037]    An image processing apparatus  1  includes an image input unit  11 , a depth information extraction unit  12 , a luminance extraction unit  13 , a spatial frequency extraction unit  14 , a contrast extraction unit  15 , a memory unit  16 , a contrast adjustment unit  17 , an image processing unit  18  and an image output unit  19 . 
         [0038]    The image processing apparatus  1  performs processing of changing (adjusting) contrast of a 3D image with respect to the inputted 3D image for enhancing depth sense of the 3D image. Here, the 3D image indicates a 2D image for allowing a viewer to perceive the 3D image. 
         [0039]    The image input unit  11  receives the 3D image from the outside and supplies the inputted 3D image to the depth information extraction unit  12  and the luminance extraction unit  13 . There are various types of data formats in the 3D image inputted from the outside, however, the data format does not matter. As data formats for the 3D image, for example, there are a first data format in which the image is supplied as a stereoscopic image including an image for a left eye and an image for a right eye, a second data format in which the image is supplied as a format of a multi-viewpoint image including three or more plural viewpoint images, a third data format in which the image is supplied as a format of a 2D image and depth information thereof and so on. In the following description, when a word of “an image” or “a luminance image” is used as a processing target, the word means respective images for the left eye and the right eye in the first data format, respective plural viewpoint images in the second data format and the 2D image supplied with depth information in the third data format. 
         [0040]    The depth information extraction unit  12  extracts depth information from the 3D image supplied from the image input unit  11 . Specifically, when the 3D image is inputted in the first data format, the depth information extraction unit  12  calculates pixel misalignment of corresponding points in stereoscopic images, namely, binocular parallax, and approximately calculates depth information based on the calculated binocular information. The binocular parallax can be calculated by using methods such as a block matching method and a DP matching method. 
         [0041]    When the 3D image is inputted in the second data format, the depth information extraction unit  12  calculates binocular parallax with respect to corresponding two viewpoint images in three or more viewpoint images and approximately calculates depth information from the calculated binocular parallax. 
         [0042]    Furthermore, when the 3D image is inputted in the third data format, the depth information extraction unit  12  extracts the supplied depth information as the depth information is directly supplied. 
         [0043]    The depth information extraction unit  12  supplies the depth information extracted from the 3D image to the contrast adjustment unit  17 . The depth information is used as information for specifying a processing region in which contrast is adjusted. 
         [0044]    In the present embodiment, the 3D image as the processing target from which depth information is extracted is supplied from the image input unit  11  to the depth information extraction unit  12  as described above, however, it is also preferable that the 3D image as a processing result of the luminance extraction unit  13  is supplied to the depth information extraction unit  12 . 
         [0045]    The luminance extraction unit  13  extracts luminance components of the 3D image supplied from the image input unit  11 . For example, when the supplied image is represented by linear RGB values in the RGB color system, the luminance extraction unit  13  converts the values into a luminance value Y by the following equation (1) prescribed by ITU-R BT709 to thereby extract luminance components of the 3D image. 
         [0000]        Y= 0.2126 R+ 0.7152 G+ 0.0722 B    (1)
 
         [0046]    The image formed by luminance values Y of respective pixels is referred to as a luminance image. It is not always necessary that the image is represented by the format including RGB values (RGB signals), and when the image is represented by XYZ values in the CIE XYZ color system, the image formed by luminance values Y is referred to as the luminance image. The luminance value can be calculated (extracted) by methods other than the method of using the equation (1). 
         [0047]    The spatial frequency extraction unit  14  extracts given spatial frequency components of the 3D image. For the extraction of spatial frequency components, for example, a method of using a Gabor filter can be applied. The Gabor filter approximates signal response characteristics in the visual system, and a function of the filter g(x, y, λ, θ, Ψ, σ and γ) is represented by an equation (2). 
         [0000]    
       
         
           
             
               
                 
                   
                     g 
                      
                     
                       ( 
                       
                         x 
                         , 
                         y 
                         , 
                         λ 
                         , 
                         θ 
                         , 
                         ψ 
                         , 
                         σ 
                         , 
                         γ 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       exp 
                        
                       
                         ( 
                         
                           - 
                           
                             
                               
                                 
                                   ( 
                                   
                                     
                                       x 
                                        
                                       
                                           
                                       
                                        
                                       cos 
                                        
                                       
                                           
                                       
                                        
                                       θ 
                                     
                                     + 
                                     
                                       y 
                                        
                                       
                                           
                                       
                                        
                                       sin 
                                        
                                       
                                           
                                       
                                        
                                       θ 
                                     
                                   
                                   ) 
                                 
                                 2 
                               
                               + 
                               
                                 
                                   
                                     γ 
                                     2 
                                   
                                    
                                   
                                     ( 
                                     
                                       
                                         
                                           - 
                                           x 
                                         
                                          
                                         
                                             
                                         
                                          
                                         sin 
                                          
                                         
                                             
                                         
                                          
                                         θ 
                                       
                                       + 
                                       
                                         y 
                                          
                                         
                                             
                                         
                                          
                                         cos 
                                          
                                         
                                             
                                         
                                          
                                         θ 
                                       
                                     
                                     ) 
                                   
                                 
                                 2 
                               
                             
                             
                               2 
                                
                               
                                 σ 
                                 2 
                               
                             
                           
                         
                         ) 
                       
                     
                      
                     
                       cos 
                        
                       
                         ( 
                         
                           
                             2 
                              
                             π 
                              
                             
                               
                                 
                                   x 
                                    
                                   
                                       
                                   
                                    
                                   cos 
                                    
                                   
                                       
                                   
                                    
                                   θ 
                                 
                                 + 
                                 
                                   y 
                                    
                                   
                                       
                                   
                                    
                                   sin 
                                    
                                   
                                       
                                   
                                    
                                   θ 
                                 
                               
                               λ 
                             
                           
                           + 
                           ψ 
                         
                         ) 
                       
                     
                   
                 
               
               
                 
                   ( 
                   2 
                   ) 
                 
               
             
           
         
       
     
         [0048]    In the equation (2), (x, y) represent coordinate values of a luminance image, λ represents a wavelength corresponding to a spatial frequency, θ represents an orientation (direction), Ψ represents a phase, σ represents dispersion of Gaussian distribution, and γ represents an aspect ratio, respectively. The spatial frequency in this case is defined by tint variation (contrast) of white and black entering into a viewing angle of 1 degree of human eyes, and a unit thereof is “cpd (cycle per degree)”. 
         [0049]    For example, the spatial frequency extraction unit  14  extracts a region having the spatial frequency component of 1 cpd in the luminance image by convoluting the Gabor filter function g(x, y, λ, θ, Ψ, σ and γ) of the equation (2) in which λ is the wavelength of 1 cpd with the luminance values Y of the luminance image extracted by the luminance extraction unit  13 . When spatial frequency components of 2 cpd and 4 cpd in the luminance image are extracted, regions can be calculated by convoluting the Gabor filter function g(x, y, λ, θ, Ψ, σ and γ) in which λ is the wavelength of 2 cpd or 4 cpd with the luminance values Y of the luminance image. 
         [0050]    That is, it is found that which spatial frequency component is included in which region of the luminance image by convoluting the Gabor filter function g(x, y, λ, θ, Ψ, σ and γ) of the equation (2) in which λ is a given wavelength of the spatial frequency with the luminance values Y of the luminance image extracted by the luminance extraction unit  13 . 
         [0051]    As the method of extracting the region having a given spatial frequency component of the luminance image, other methods other than the above can be applied as long as which component of the spatial frequency is included in which region of the luminance image can be found by the method. For example, the spatial frequency component may be extracted by using Fourier transform and the like. However, the spatial frequency components of the whole (region) of the luminance image to be transformed can be obtained in Fourier transform, therefore, it is difficult to extract the spatial frequency components in respective regions unless Fourier transform is performed by dividing the luminance image into given regions. On the other hand, it is found which spatial frequency component is included in which region all at once with respect to the whole luminance image to be processed when using the Gabor filter. 
         [0052]    The processing of extracting the spatial frequency by the spatial frequency extraction unit  14  is necessary when a performance function to be applied in the contrast adjustment unit  17  is changed according to given spatial frequencies. Therefore, when the same performance function is applied to the whole luminance image in the contrast adjustment unit  17 , the spatial frequency extraction unit  14  can be omitted. 
         [0053]    The contrast extraction unit  15  extracts contrast components of the 3D image by using the luminance component of the 3D image extracted in the luminance extraction unit  13 . 
         [0054]    Specifically, the contrast extraction unit  15  determines a region of n×m pixel (n, m≧2) in horizontal×vertical as a unit for processing of extracting the contrast components. Then, the contrast extraction unit  15  moves the processing unit region from the upper left end of the luminance image in the Raster scan direction by the given number of pixels to thereby calculate Michelson contrasts C of plural processing unit regions. 
         [0055]    The Michelson contrast C is defined by an equation ( 3 ). 
         [0000]    
       
         
           
             
               
                 
                   C 
                   = 
                   
                     
                       
                         L 
                         max 
                       
                       - 
                       
                         L 
                         min 
                       
                     
                     
                       
                         L 
                         max 
                       
                       + 
                       
                         L 
                         min 
                       
                     
                   
                 
               
               
                 
                   ( 
                   3 
                   ) 
                 
               
             
           
         
       
     
         [0056]    In the equation (3), L max  represents the maximum value of the luminance values Y in the processing unit region and L min  represents the minimum value of the luminance values Y in the processing unit region. 
         [0057]    The size of the processing unit region is not particularly limited, however, the optimum size can be determined from the relation between the viewing angle and the number of pixels. 
         [0058]    The movement amount (number of pixels) at the time of moving the processing unit region is not also particularly limited and can be optionally determined. Respective processing unit regions may be set so as to be overlapped at parts thereof or may be set in tiled patterns so as not to be overlapped. In the case of giving weight on the accuracy, that is, in the case of adjusting contrast to obtain smoother images, the processing unit region may be moved pixel by pixel. 
         [0059]    The contrast extraction unit  15  supplies the Michelson contrasts C of respective processing unit regions calculated as contrast components of the 3D image to the contrast adjustment unit  17  with the luminance image. 
         [0060]    The memory unit  16  stores performance functions obtained by quantifying the relation between the Michelson contrasts C and depth amounts D (also referred to as subjective depth amounts D) perceived subjectively by the contrast which have been obtained by visual experiments. 
       Relation Between Michelson Contrasts C and Subjective Depth Amounts D  
       [0061]      FIG. 2  shows performance functions obtained by quantifying the relation between the Michelson contrasts C obtained by visual experiments and the subjective depth amounts D obtained at that time, which are plotted with a logarithm axis of Michelson contrasts as the horizontal axis and subjective depth amounts D as the vertical axis. A unit of the Michelson contrast C is [%] and a unit of the subjective depth amount D is (arcmin: minute of angle). 
         [0062]    In  FIG. 2 , squares ( ) represent the relation between Michelson contrasts C and the subjective depth amounts D in luminance images spatial frequencies of which are 0.5 cpd, 1 cpd and 2 cpd. Rhombuses represent the relation between Michelson contrasts C and the subjective depth amounts D in luminance images spatial frequencies of which are 4 cpd and 8 cpd. 
         [0063]    In the subjective depth amounts D, when a viewer feels that an object displayed on the display exists on the display, the value is 0 [arcmin]. It is shown that, when the subjective depth amount D is a positive value, the viewer feels that the object exists at a front position of the display by the value, and when the subject depth amount D is a negative value, the viewer feels that the object exists at a deep position of the display. 
         [0064]    For example, a plot of the square ( ) exists at a position where the Michelson contrast C is 5[%] and the subjective depth amount D is approximately 0 [arcmin]. A plot of the square ( ) also exists at a position where the Michelson contrast C is approximately 25[%] and the subjective depth amount D is approximately 30 [arcmin]. The example of these values express that the subjective depth amount D of the viewer is changed from approximately 0 [arcmin] to approximately 30 [arcmin] when the object the Michelson contrast C of which is 5[%] is changed to the object the Michelson contrast C of which is approximately 25[%]. That is, it is shown that the viewer perceives that the object in the image exist at a position approximately 30 [arcmin] nearer as compared with the position before the change when the Michelson contrast C of the object is changed from 5[%] to 25[%]. 
         [0065]    There is a monotone increasing relation between the Michelson contrast C and the subjective depth amount D, in which the subjective depth amount D is increased as the Michelson contrast C is increased as shown in  FIG. 2 . In other words, there is the relation in which the subjective depth amounts D are almost in proportion to logarithms of the Michelson contrasts C. 
         [0066]    Accordingly, the relation between the Michelson contrast 
         [0067]    C and the subjective depth amount D can be represented by performing approximation with the performance function using logarithms D=A×log(C)+B (A, B are constant numbers). Specifically, when parameters A, B of D=A×log(C)+B in which a residual will be the minimum are calculated with respect to data of all spatial frequency components of 0.5 cpd, 1 cpd, 2 cpd, 4 cpd and 8 cpd, they can be represented by an equation (4). 
         [0000]        D= 18.04×log( C )−29.07   (4)
 
         [0068]    That is, in the equation (4), A=18.04 and B=−29.07. In  FIG. 2 , the equation (4) is represented by a dotted line written as a “log function”. 
         [0069]    The relation between the Michelson contrast C and the subjective depth amount D can be expressed by being applied to the Naka-Rushton equation (performance function) which is used with respect to the response of a visual system. The Naka-Rushton equation can be expressed by the following equation (5). 
         [0000]    
       
         
           
             
               
                 
                   D 
                   = 
                   
                     
                       
                         D 
                         amp 
                       
                       × 
                       
                         
                           C 
                           n 
                         
                         
                           
                             C 
                             n 
                           
                           + 
                           
                             C 
                             50 
                             n 
                           
                         
                       
                     
                     + 
                     
                       D 
                       min 
                     
                   
                 
               
               
                 
                   ( 
                   5 
                   ) 
                 
               
             
           
         
       
     
         [0070]    In the equation (5), D amp , D min , C 50  and “n” are given constant numbers, and D amp  represents the maximum minimum width of the depth amount, D min  represents the minimum value of the depth amount and C 50  represents a contrast value obtained when the depth amount is at the central value between the maximum value and the minimum value. 
         [0071]    When the parameters D amp , D min , C 50  and “n” of the Naka-Rushton equation are calculated so that the residual will be the minimum with respect to data of the all spatial frequencies of 0.5 cpd, 1 cpd, 2 cpd, 4 cpd and 8 cpd obtained by the visual experiments, an equation (6) is obtained. 
         [0000]    
       
         
           
             
               
                 
                   D 
                   = 
                   
                     
                       77.9 
                       × 
                       
                         
                           C 
                           1.09 
                         
                         
                           
                             C 
                             1.09 
                           
                           × 
                           
                             7.74 
                             1.09 
                           
                         
                       
                     
                     - 
                     30.5 
                   
                 
               
               
                 
                   ( 
                   6 
                   ) 
                 
               
             
           
         
       
     
         [0072]    That is, in the equation (6), D amp =77.9 m, D min =−30.5 C 50 =7.74 and “n”=1.09. In  FIG. 2 , the equation (6) represents by a chain line. 
         [0073]    For example, in the case that the Michelson contrast C of a certain luminance image is 10[%], when C=10 is substituted in the equation (6), the subjective depth amount D is 13.9 [arcmin]. Then, in order to double the subjective depth amount D, namely, in order to make the value be 27.8 [arcmin], reverse operation of the equation (6) is performed to make the Michelson contrast C of the luminance image be 20.9[%]. 
         [0074]    The performance functions to be applied can be distinguished according to given spatial frequencies. For example, the Naka-Rushton equation is applied as the performance function in  FIG. 2 , and when the performance functions are distinguished with respect to luminance images having spatial frequencies of 2 cpd or less and with respect to luminance images having spatial frequencies higher than 2 cpd, D amp =78.5, D min =−30.5, C 50 =9.93 and n=1.23 can be obtained with respect to data of spatial frequency components of 2 cpd or less. Additionally, D amp =58.5, D min =−30.5, C 50 =3.45 and n=2.05 can be obtained with respect to data of spatial frequency components higher than 2 cpd. 
         [0075]    That is, the performance function of an equation (7) can be applied to luminance images having spatial frequencies of 2 cpd or less, and the performance function of an equation (8) can be applied to luminance images having spatial frequencies higher than 2 cpd. 
         [0000]    
       
         
           
             
               
                 
                   D 
                   = 
                   
                     
                       78.5 
                       × 
                       
                         
                           C 
                           1.23 
                         
                         
                           
                             C 
                             1.23 
                           
                           × 
                           
                             9.33 
                             1.23 
                           
                         
                       
                     
                     - 
                     30.5 
                   
                 
               
               
                 
                   ( 
                   7 
                   ) 
                 
               
             
             
               
                 
                   D 
                   = 
                   
                     
                       58.5 
                       × 
                       
                         
                           C 
                           2.05 
                         
                         
                           
                             C 
                             2.05 
                           
                           + 
                           
                             3.45 
                             2.05 
                           
                         
                       
                     
                     - 
                     30.5 
                   
                 
               
               
                 
                   ( 
                   8 
                   ) 
                 
               
             
           
         
       
     
         [0076]    Return to  FIG. 1 , the memory unit  16  stores part or all of the equation (4), the equation (6) and a pair of the equation (7) and the equation (8) obtained by visual experiments. That is, all of the equation (4), the equation (6) and a pair of the equation (7) and the equation (8) are stored in the memory  16  and may be used according to need or, only the performance functions determined to be applied in advance may be stored. When the calculation is performed by a computer, it is easy to perform calculation when using the equation (4) which is a logarithmic function. Additionally, the memory unit  16  may store equations of the performance functions directly as well as may store the performance functions in a form of a LUT (Look Up Table). 
         [0077]    To the contrast adjustment unit  17 , depth information of the 3D image is supplied from the depth information extraction unit  12 , contrast components of the 3D image are supplied from the contrast extraction unit  15  and spatial frequency components of the 3D image is supplied from the spatial frequency extraction unit  14 , respectively. 
         [0078]    The contrast adjustment unit  17  changes (adjusts) the Michelson contrasts C of the luminance image to change (adjust) the depth sense of the 3D image. As explained with reference to  FIG. 2 , there is the monotone increasing relation between the Michelson contrast C and the subjective depth amount D, therefore, the contrast components of the luminance image may be adjusted so that the Michelson contrast C is increased when enhancing the depth sense of the 3D image. 
         [0079]    A case in which the contrast adjustment unit  17  changes (adjusts) the Michelson contrasts C of the luminance image by using one performance function, for example, the performance function of the equation ( 6 ) with respect to the whole luminance image regardless of the spatial frequency will be explained. 
         [0080]    For example, in the case that the Michelson contrast C of a certain one processing unit region of the luminance image is 10[%], when C=10 is substituted in the equation (6), the subjective depth amount D is 13.9 [arcmin]. Then, in order to double the subjective depth amount D, namely, in order to make the value be 27.8 [arcmin], the contrast adjustment unit  17  may change (adjust) the Michelson contrast C in the processing unit region to 20.9[%], which is 2.09 times of the 10[%]. 
         [0081]    A depth adjustment amount for determining by what value the subjective depth amount D is multiplied is set in the contrast adjustment unit  17  in advance. In order to double the subjective depth amount D, at least one of a process of changing a region existing at a near side in the luminance image to be nearer and a process of changing a region existing at a deep side in the luminance image to be deeper is necessary. That is, the direction of changing the contrast differs in the near side region and in the deep side region. The depth information supplied from the depth information extraction unit  12  supplied from the depth information extraction unit  12  is used for separating the luminance image to the deep side region and the near side region. 
         [0082]    The contrast adjustment unit  17  determines the deep side region and the nearside region of the 3D luminance image based on the depth information supplied from the depth information extraction unit  12 . Here, the minimum unit of the region obtained by dividing the image into the deep side region and the near side region will be substantially equal to the processing unit region obtained by the contrast extraction unit  15  which calculates the Michelson contrasts C. 
         [0083]    Next, the contrast adjustment unit  17  reads the performance function of the equation ( 6 ) stored in the memory unit  16 . Then, the contrast adjustment unit  17  calculates the present subjective depth amounts D concerning all processing unit regions included in the deep side region and the near side region from the Michelson contrasts C. The subjective depth amount D with respect to the processing region after adjusting the contrast is determined from the calculated subjective depth amount D and the depth adjustment amount which has been previously set, therefore, the Michelson contrast C to be set can be calculated based on the performance function of the equation (6). That is, the contrast adjustment unit  17  calculates by what value the present Michelson contrast C is multiplied with respect to all processing unit regions based on the present subjective depth amount D and the depth information of the image. Here, assume that the adjustment amount of the calculated Michelson contrast C is M-times (M&gt;0) , when the depth amount perceived subjectively from the adjusted image is intended to be larger than the present image, the adjustment value is M&lt;1 in the deep side region and M&gt;1 in the near side region. When the depth among perceived substantially from the adjusted image is intended to be smaller than the present image, the adjustment value is M&gt;1 in the deep side region and M&lt;1 in the near side region. 
         [0084]    In the above example, the present subjective depth amount D in the given processing unit region in the image at the near side region is calculated to be 13.9 [arcmin], and it is found that the Michelson contrast C is preferably approximately doubled (M=2.09) for changing the subjective depth amount D to be doubled, namely, to be 27.8 [arcmin]. 
         [0085]    Next, the contrast adjustment unit  17  adjusts contrast components of the 3D image so that the Michelson contrasts C are changed to values of M-times as calculated with respect to all processing unit regions included in the deep side region and the near side region. 
         [0086]    Specifically, the contrast adjustment unit  17  performs Fourier transform in each processing unit region of the luminance image and calculates spectrum intensity of frequency components included in each processing unit region. Then, the contrast adjustment unit  17  adjusts spectrum intensity of respective frequency components in each processing unit region so that the Michelson contrasts C of each processing unit region after adjustment are changed to values of M-times. The spectrum intensity of respective frequency components in each processing unit region after adjustment is supplied to the image processing unit  18 . 
         [0087]    The image processing unit  18  generates the luminance image obtained after adjusting contrast based on the adjustment result by the contrast adjustment unit  17 . Specifically, the image processing unit  18  performs inverse Fourier transform to the spectrum intensity of respective frequency components in each processing unit region after adjustment to thereby calculate the luminance image obtained after adjusting each processing unit region. Furthermore, the image processing unit  18  generates the luminance image after adjusting contrast from the luminance image in respective processing unit regions after adjustment. That is, when respective processing unit regions are set so as to be overlapped at parts thereof, plural luminance values after adjustment may be calculated with respect to each pixel of the luminance image. Accordingly, the image processing unit  18  generates the luminance image after adjusting contrast by applying an average value of plural luminance values after adjustment as the luminance value of the pixel after adjustment. 
         [0088]    The image output unit  19  converts the luminance image generated by the image processing unit  18  into the 3D image which is the same as the image inputted to the image input unit  11 , outputting the image to a device of a subsequent stage (a display device and the like). In the case of changing the luminance image represented by XYZ values in the CIE XYZ color system into the 3D image represented by RGB values in the RGB color system, conversion can be made by the following equations (9) to (11). 
         [0000]        R= 3.2410 X− 1.5374 Y− 0.4986 Z    (9)
 
         [0000]        G=− 0.9692 X+ 1.8760 Y+ 0.0416 Z    (10)
 
         [0000]        B= 0.0556 X− 0.2040 Y+ 1.05702   (11)
 
         [0089]    When the data format at the time of outputting the 3D image is designated, the image output unit  19  may output the image after converting the data format of the 3D image into the designated format. 
         [0090]    The image processing apparatus  1  of  FIG. 1  is configured as described above. 
         [0091]    In the above example, the Michelson contrast C of the nearside region in the 3D luminance image is increased as well as the Michelson contrast C of the deep side region is reduced to thereby enhance the deep sense. However, it is also possible to enhance the deep sense by increasing only the Michelson contrast C of the near side region without changing the 
         [0092]    Michelson contrast C of the deep side region. Conversely, it is possible to enhance the deep sense by reducing only the Michelson contrast C of the deep side region without changing the Michelson contrast C of the near side region. 
         [0093]    In the above example, the case in which the contrast adjustment unit  17  adjusts Michelson contrasts C of the luminance image by using one performance function of the equation (6) with respect to the whole luminance image has been explained, however, the case of making an adjustment by using the performance function of the equation (4) is the same as the above. 
       Explanation of a Case in Which Plural Performance Functions are Applied According to Given Spatial Frequency Components 
       [0094]    Next, a case in which the contrast adjustment unit  17  adjusts the Michelson contrasts C of the luminance image by applying two performance functions of the equations (7) and the formula (8) will be explained only concerning a point different from the above case in which one performance function is applied. 
         [0095]    The contrast adjustment unit  17  determines which spatial frequency component is included at high rate in each processing unit region based on spatial frequency components of the 3D image extracted by the spatial frequency extraction unit  14 . 
         [0096]    When spatial frequency components of 2 cpd or less are included in the processing unit region at high rate, the contrast adjustment unit  17  reads the performance function of the equation (7) from the memory unit  16  and makes an adjustment of the Michelson contrast C in the same manner as in the case of applying the performance function of the equation (6) with respect to the processing unit region. 
         [0097]    On the other hand, when spatial frequency components larger than 2 cd are included at high rate in the processing unit region, the contrast adjustment unit  17  reads the performance function of the equation (8) from the memory unit  16  and makes an adjustment of the Michelson contrast C in the same manner as in the case of applying the performance function of the equation ( 6 ) with respect to the processing unit region. 
         [0098]    As described above, when the adjustment of the Michelson contrast C is made by applying plural performance functions, the performance function to be applied is selected in accordance with the spatial frequency components included in respective processing unit regions of the luminance image. 
         [0099]    In the above example, the image is converted into the image having deeper depth to enhance the depth sense, however, it is naturally possible to convert the 3D luminance image so as to reduce the depth sense. 
       Flowchart of Contrast Adjustment Processing 
       [0100]    Next, contrast adjustment processing performed by the image processing apparatus  1  will be explained with reference to a flowchart of  FIG. 3 . On the explanation of respective steps of  FIG. 3 , explanation will be made also with reference to  FIG. 4  to  FIG. 8  according to need. 
         [0101]    First, in Step S 11 , the image input unit  11  receives input of a 3D image from the outside and supplies the image to the depth information extraction unit  12  and the luminance extraction unit  13 . For example, the 3D image is inputted to the image input unit  11  from the outside in the above first to third data formats. 
         [0102]      FIG. 4  shows an example of the 3D image when supplied in the first data format. That is, in the first data format, a 3D image  31  including an image for a left eye  31 L and an image for a right eye  31 R is inputted to the image input unit  11 . The binocular parallax is set between the image for the left eye  31 L and the image for the right eye  31 R. The 3D image  31  is the 3D image obtained by recording a situation in which a woman seats herself on a big stone against a background of an artificial waterfall. 
         [0103]    In Step S 12 , the depth information extraction unit  12  extracts depth information from the 3D image supplied from the image input unit  11 . As described above, the depth information may be extracted from a 3D luminance image obtained by extracting luminance components by the luminance extraction unit  13 . 
         [0104]    When data of the 3D image is supplied in the first or the second data format, the depth information extraction unit  12  calculates pixel misalignment of corresponding points in stereoscopic images or viewpoint images, namely, the binocular parallax by using the methods such as the block matching method and the DP matching method, and approximately calculates the depth information based on the calculated binocular parallax. 
         [0105]    On the other hand, when the 3D image is supplied in the third data format, the depth information extraction unit  12  extracts the supplied depth information as the depth information is directly supplied. The depth information extraction unit  12  supplies the extracted depth information to the contrast adjustment unit  17 . 
         [0106]      FIG. 5  shows a depth image  32  obtained by visualizing depth information extracted with respect to the 3D image  31  including the image for the left eye  31 L and the image for the right eye  31 R shown in  FIG. 4 . 
         [0107]    In the depth image  32  of  FIG. 5 , the depth information is represented by  8 -bit values, and an object positioned at the deep side in the 3D image  31  is represented by small pixels value and an object positioned at a near side is represented by large pixel values. The depth image  32  shown in  FIG. 5  is for explaining extraction processing of depth information in step S 12  and the depth image  32  is not directly used in the contrast adjustment processing of  FIG. 3 . 
         [0108]    When referring to the depth image  32  of  FIG. 5 , pixels of a woman and the stone on which the woman sits are brighter than pixels of the artificial waterfall of the background (pixel values are larger). Therefore, the depth information accurately expresses that the artificial waterfall is the background and that the woman and the big stone are the foreground. 
         [0109]    In Step S 13 , the luminance extraction unit  13  extracts luminance components of the 3D image supplied from the image input unit  11 . For example, when the supplied 3D image is expressed by linear RGB values in the RGB color system, the luminance extraction unit  13  extracts luminance components of the 3D image by converting the RGB values of the 3D image into luminance values Y by using the above equation (1). 
         [0110]      FIG. 6  shows a luminance image  33  including a luminance image for a left eye  33 L and a luminance image for a right eye  33 R generated by extracting luminance components from the image for the left eye  31 L and the image for the right eye  31 R shown in  FIG. 4  respectively. In the drawing, the difference between the 3D image  31  and the luminance image  33  does not appear because of constraints thereof, however, the 3D mage  31  is a color image and the luminance image  33  is a gray image. 
         [0111]    In Step S 14 , the spatial frequency extraction unit  14  extracts given spatial frequency components of the 3D image. In other words, the spatial frequency extraction unit  14  detects which spatial frequency component is included in which region of the 3D image. 
         [0112]      FIG. 7  shows spatial frequency component images obtained by visualizing the extraction results at the time of extracting respective spatial frequency components of 1 cpd, 2 cpd, 4 cpd and 8 cpd from the luminance image for the left eye  33 L shown in  FIG. 6 . 
         [0113]    The spatial frequency is defined by tint variation (contrast) of white and black entering into a viewing angle of 1 degree of human eyes as described above, therefore, the spatial frequency depends on the distance between the user who views the 3D image and the display and the size of (the 3D image displayed on) the display. In the example, the spatial frequency is calculated under a condition that the user views the display having the size of 40-inch and resolution of 1920×1080 at the distance of 3 H (H is the display height). 
         [0114]    A spatial frequency component image  41  of  FIG. 7  is a spatial frequency component image obtained by visualizing the extraction result when the spatial frequency component of 1 cpd was extracted with respect to the luminance image for the left eye  33 L. 
         [0115]    A spatial frequency component image  42  of  FIG. 7  is a spatial frequency component image obtained by visualizing the extraction result when the spatial frequency component of 2 cpd was extracted with respect to the luminance image for the left eye  33 L. 
         [0116]    A spatial frequency component image  43  of  FIG. 7  is a spatial frequency component image obtained by visualizing the extraction result when the spatial frequency component of 4 cpd was extracted with respect to the luminance image for the left eye  33 L. 
         [0117]    A spatial frequency component image  44  of  FIG. 7  is a spatial frequency component image obtained by visualizing the extraction result when the spatial frequency component of 8 cpd was extracted with respect to the luminance image for the left eye  33 L. 
         [0118]    In the spatial frequency component images  41  to  44 , the higher the intensity of each spatial frequency component is, the brighter (higher the pixel values) the pixels are. 
         [0119]    The processing of Step S 14  can be omitted when the Michelson contrasts C of the luminance image are adjusted by using one function performance with respect to the whole luminance image. 
         [0120]    In Step S 15 , the contrast extraction unit  15  extracts contrast components of the 3D image by using luminance components of the 3D image extracted by the luminance extraction unit  13 . Specifically, the the contrast extraction unit  15  calculates the Michelson contrasts C of respective processing unit regions while moving the processing unit region by a given amount with respect to the luminance image, thereby calculating the Michelson contrast C over the whole luminance image. 
         [0121]    In Step S 16 , the contrast adjustment unit  17  determines a deep side region and a near side region based on depth information supplied from the deep information extraction unit  12 . 
         [0122]    In Step S 17 , the contrast adjustment unit  17  reads the performance function from the memory unit  16 . When the contrast components are adjusted by applying one performance function with respect to the whole luminance image, the performance function of the equation (4) or the equation (6) is read out. When the contrast components are adjusted by applying two performance functions with respect to the whole luminance image, the performance functions of the equation (7) and the equation (8) are read out. 
         [0123]    In Step S 18 , the contrast adjustment unit  17  calculates the present subjective depth amounts D from the Michelson contrasts C with respect to the whole processing unit regions. The subjective depth amounts D with respect to the processing regions after adjusting the contrast are determined by the calculated present subjective depth amounts D, the Michelson contrasts C which should be set can be calculated based on the performance function read from the memory unit  16 . That is, the contrast adjustment unit  17  calculates by what value the present Michelson contrast C is multiplied based on the present subjective depth amount D and depth information of the image with respect to all processing unit regions. Assume that the adjustment value of the calculated Michelson contrast C is M-times. 
         [0124]    Here, plural performance functions are applied according to given spatial frequency components, the contrast adjustment unit  17  determines which spatial frequency component is included at high rate in the processing unit region of the luminance image based on the spatial frequency components of the 3D image extracted in Step S 14 . Then, the contrast adjustment unit  17  calculates the Michelson contrast C to be set in each processing unit region by using the performance function corresponding to the spatial frequency component determined at high rate in performance functions read from the memory unit  16  in Step S 17 . 
         [0125]    On the other hand, when one performance function such as the equation (4) or the equation (6) is applied with respect to the whole luminance image, the contrast adjustment unit  17  calculates the Michelson contrast C to be set in each processing unit region by using one performance function read from the memory unit  16  in Step S 17 . 
         [0126]    In Step S 19 , the contrast adjustment unit  17  adjusts the contrast components C so that the Michelson contrasts C are changed to values of M-times as calculated with respect to all processing unit regions included in the deep side region and the near side region. Specifically, the contrast adjustment unit  17  performs Fourier transform in each processing unit region of the luminance image and calculates frequency components and spectrum intensity included in each processing unit region. Then, the contrast adjustment unit  17  adjusts the spectrum intensity of respective frequency components in each processing unit region so that the Michelson contrasts C of each processing unit region after adjustment are changed to values of M-times. The spectrum intensity of respective frequency components of each processing unit region after adjustment is supplied to the image processing unit  18 . 
         [0127]    In Step S 20 , the image processing unit  18  generates the luminance image after adjusting contrast based on the adjustment result by the contrast adjustment unit  17 . Specifically, the image processing unit  18  performs inverse Fourier transform to the spectrum intensity of respective frequency components in each processing unit region after adjustment to thereby calculate the luminance image obtained after adjusting each processing unit region. Then, the image processing unit  18  generates the luminance image after adjusting contrast from the luminance image obtained after adjusting each processing unit region. 
         [0128]    In Step S 21 , the image output unit  19  outputs the 3D image obtained after adjusting contrast to a device of a subsequent stage such as a display device. That is, the image output unit converts the luminance image generated by the image processing unit  18  to the 3D image which is the same as the image inputted in the pixel input unit  11  and outputs the image to the subsequent device. The image output unit  19  may convert the data format of the 3D image generated by the image processing unit  18  to another format and output the image according to need. 
         [0129]    The processing from Step S 11  to Step S 21  is executed repeatedly every time the 3D image is inputted to the image input unit  11 . 
         [0130]    The order of executing respective processing of Steps S 11  to S 21  is not limited to the above example and can be changed if necessary. For example, Step S 12  and Step S 13  can be executed in parallel in the processing of Steps S 11  to S 21 . Step S 14  and Step S 15  can be also executed in parallel. 
       2. Second Embodiment 
     Configuration Block Diagram of the Image Processing Apparatus  
       [0131]      FIG. 8  shows a configuration example of the image processing apparatus according to a second embodiment of the invention. 
         [0132]    In  FIG. 8 , the same numerals are given to portions corresponding to the first embodiment and explanation thereof will be omitted. 
         [0133]    The image processing apparatus  1  is configured in the same manner as  FIG. 1  except that a user input unit  20  is newly provided. 
         [0134]    In the second embodiment, the image processing result by Michelson contrasts C automatically adjusted (without input by the user) in the same manner as the first embodiment is outputted at first. Then, after confirming the image processing result by the automatic adjustment, the user himself/herself can change the Michelson contrasts C according to need. 
         [0135]    The user input unit  20  receives input of the Michelson contrast C as the depth adjustment amount set by the user and supplies the value to the contrast adjustment unit  17 . 
         [0136]    The contrast adjustment unit  17  allows the image output unit  19  to output an image for confirming whether the Michelson contrast C is changed or not after the 3D image to which the contrast adjustment processing has been performed based on the predetermined depth adjustment amount is outputted from the image output unit  19 . According to the processing, a confirmation screen for allowing the user to confirm whether the Michelson contrast C is changed or not is displayed on the subsequent display device and the like. The confirmation screen may be displayed by ODS on the 3D image to which the contrast adjustment processing has been performed based on the automatic adjustment. 
         [0137]    The user confirms the 3D image obtained after the contrast adjustment processing based on the automatic adjustment and inputs a changed value of the Michelson contrast C by the user input unit  20  when determining to change the Michelson contrast C. The user input unit  20  supplies the changed value of the Michelson contrast C inputted by the user to the contrast adjustment unit  17 . 
         [0138]    When the changed value of the Michelson contrast C is supplied from the user input unit  20 , the contrast adjustment unit  17  applies the changed value of the Michelson contrast C in preference to the Michelson contrast C which has been automatically adjusted. That is, the contrast adjustment unit  17  adjusts contrast components of the 3D luminance image based on the changed value of the supplied Michelson contrast C, not based on the adjustment amount of the Michelson contrast C based on the predetermined depth adjustment amount. 
       Flowchart of Contrast Adjustment Processing 
       [0139]    The contrast adjustment processing of the image processing apparatus  1  according to the second embodiment will be explained with reference to a flowchart of  FIG. 9 . 
         [0140]    Processing from Step S 41  to Step S 51  is the same as the above processing from Step S 11  to S 21  of  FIG. 3 , therefore, explanation thereof is omitted. That is, the 3D image in which luminance values have been changed by the Michelson contrasts C determined by the contrast adjustment unit  17  is displayed on the subsequent display device and the like at first. 
         [0141]    Then, in Step S 52 , the contrast adjustment unit  17  allows the image output unit  19  to output an image to be confirmed whether the Michelson contrast C is changed or not and displays the confirmation screen for confirming whether the Michelson contrast C is changed or not on the subsequent display device and the like. 
         [0142]    In Step S 53 , the contrast adjustment unit  17  determines whether the change of the Michelson contrast C has been selected or not by the user input unit  20 . The selection information by the user concerning the presence of change of the Michelson contrast C is supplied from the user input unit  20  to the contrast adjustment unit  17 . 
         [0143]    When the change of the Michelson contrast C is selected, the changed value of the Michelson contrast C is also supplied from the user input unit  20  to the contrast adjustment unit  17 . 
         [0144]    When the change of the Michelson contrast C is not selected in Step S 53 , the processing is ended. 
         [0145]    On the other hand, when the change of the Michelson contrast C is selected in Step S 53 , the processing proceeds to Step S 54 . In Step S 54 , the user input unit  20  supplies the changed value of the Michelson contrast C which has been inputted by the user to the contrast adjustment unit  17 . 
         [0146]    After Step S 54 , the processing returns to Step S 49 . In Step S 49 , the contrast adjustment unit  17  adjusts contrast components so that the Michelson contrasts C are changed to be changed values supplied from the user input unit  20  with respect all processing unit regions included in the deep side region and the near side region. The processing after Step S 50  is the same. 
         [0147]    According to the contrast adjustment processing as described above, after confirming the image processing result by the Michelson contrasts C which has been automatically adjusted, the user himself/herself can further change the Michelson contrast C according to need. 
         [0148]    Accordingly, it is possible to adjust contrast components for enhancing the depth sense of the 3D image in which user&#39;s taste is reflected. 
         [0149]    It is also preferable to allow the user to select items such as “to increase the depth sense” and “to reduce the depth sense” and to apply the amount previously set so as to correspond to the item (for example, 1.5 times of the value determined by the automatic adjustment) as the changed value of the Michelson contrast C. 
         [0150]    According to the image processing apparatus  1  to which the invention is applied, the depth sense of the 3D image can be enhanced by using the performance function obtained by quantifying visual sense characteristics of human beings by visual experiments. Specifically, the depth sense of the 3D image can be enhanced by using the performance function obtained by quantifying the relation between the Michelson contrast C and the depth amount D perceived subjectively by contrast. Contrast belongs to monocular 3D information in binocular 3D information and monocular 3D information for allowing a human being to perceive stereoscopic effect and depth of an object. Therefore, it is possible to enhance the depth sense of the 3D image by adjusting parameters of contrast which is one of monocular 3D information based on visual sense characteristics of human beings according to the image processing apparatus  1 . 
         [0151]    Also according to the image processing apparatus  1 , the depth sense of the 3D image can be enhanced by changing contrast, therefore, it is possible to reduce binocular parallax which is one of binocular 3D information due to the change. In the case, the binocular parallax is small when comparing with a 3D image allowing the user to perceive the same depth sense only by binocular parallax without changing contrast, therefore, “the convergence position and the adjustment position of eyeballs” explained in the column of “Description of related art” come close to each other. Therefore, it is possible to reduce the viewer&#39;s perception of artificiality, discomfort or visual fatigue. That is, the 3D image with lesser sense of discomfort or uncomfortable feeling for human beings can be provided by adjusting parameters of contrast and enhancing the depth sense of the 3D image. In other words, it is possible to provide the 3D image with lesser sense of discomfort or uncomfortable feeling for human beings by combining monocular 3D information with binocular 3D information. 
         [0152]    The above series of processing can be executed by hardware as well as by software. When the series of processing is executed by software, programs included in the software are installed in a computer. Here, the computer includes a computer incorporated in dedicated hardware, a general-purpose personal computer which can execute various functions by installing various types of programs and the like. 
         [0153]      FIG. 10  is a block diagram showing a configuration example of hardware of a computer executing the above series of processing by programs. 
         [0154]    In the computer, a CPU (Central Processing Unit)  101 , a ROM (Read Only Memory)  102  and a RAM (Random Access Memory)  103  are mutually connected by a bus  104 . 
         [0155]    An input/output interface  105  is further connected to the bus  104 . To the input/output interface  105 , an input unit  106 , an output unit  107 , a storage unit  108 , a communication unit  109  and a drive  110  are connected. 
         [0156]    The input unit  106  includes a keyboard, a mouse, a microphone and the like. The output unit  107  includes a display, a speaker and the like. The storage unit  108  includes a hard disk, a nonvolatile memory and the like. The communication unit  109  includes a network interface and the like. The drive  110  drives removal recording media  111  such as a magnetic disk, an optical disk, an magneto-optical disk or a semiconductor memory. 
         [0157]    In the computer configured as described above, the CPU  101  loads programs stored in, for example, the storage unit  108  to the RAM  103  through the input/output interface  105  and the bus  104  and executes the programs, thereby performing the above series of processing. 
         [0158]    The programs executed by the computer (CPU  101 ) can be provided by being recorded in the removal recording media  111  as packaged media. The programs can be also provided through wired or wireless transmission media such as a local area network, Internet, digital satellite broadcasting and so on. 
         [0159]    In the computer, programs can be installed in the storage unit  108  through the input/output interface  105  by mounting the removal recording media  111  on the drive  110 . Programs can be received by the communication unit  109  and installed in the storage unit  108  through wired or wireless transmission media. Additionally, programs can be previously installed in the RAM  102  or the storage unit  108 . 
         [0160]    Programs executed by the computer may be programs processed in time series along the order explained by the present specification, or maybe programs processed in parallel or processed at necessary timing such as when calling is performed. 
         [0161]    The embodiment of the invention is not limited to the above embodiments and can be variously changed within a scope not departing from the gist of the invention. 
         [0162]    The present application contains subject matter related to that disclosed in Japanese Priority Patent Applications JP 2009-270077 filed in the Japan Patent Office on Nov. 27, 2009, the entire contents of which is hereby incorporated by reference.