Patent ID: 11902492
Assignee: KOREA ATOMIC ENERGY RESEARCH INSTITUTE
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  G | IPC G  H

Claim 5:
6. An image processing apparatus for processing a stereo image to impart a three-dimensional effect on a nearby object in a stereoscopic image system using a stereo camera of a parallel axis type including a left camera and a right camera, the method comprising:
an input unit configured to input the stereo image captured by the stereo camera;
an image processing unit configured to adjust vertical parallax and horizontal parallax of the stereo image, the horizontal parallax including a first horizontal parallax of a left image obtained by the left camera and a second horizontal parallax of a right image obtained by the right camera; and
an output unit configured to output the stereo image in which the vertical parallax and the horizontal parallax are adjusted by the image processing unit,
wherein the image processing unit is configured to:
calculate a vertical rotation matrix for eliminating vertical parallax of the stereo image by using the following equation,, R
    rect
   
   =
   
    [
    
     
      
       
        e
        x
        T
       
      
     
     
      
       
        e
        y
        T
       
      
     
     
      
       
        e
        z
        T
       
      
     
    
    ]
   
  
  ,
 

wherein, e
    x
   
   =
   
    
     t
     LR
    
    
     
      ❘
      "\[LeftBracketingBar]"
     
     
      t
      LR
     
     
      ❘
      "\[RightBracketingBar]"
     
    
   
  
  ,
 

wherein, e
    y
   
   =
   
    
     
      1
      
       
        
         t
         x
         2
        
        +
        
         t
         y
         2
        
       
      
     
     [
     
      
       
        
         -
         
          t
          y
         
        
       
       
        
         t
         x
        
       
       
        0
       
      
     
     ]
    
    T
   
  
  ,
 

wherein ez=ex×ey, and
wherein
tLR=[txtytz]T indicates a translation vector from a left camera coordinate system to a right camera coordinate system,
ex indicates a unit vector in the x-axis direction of a new left camera coordinate system,
ey indicates a unit vector in the y-axis direction of the new left camera coordinate system, and
ez indicates a unit vector in the z-axis direction of the new left camera coordinate system, and

wherein the stereo image includes a left image obtained by the left camera and a right image obtained by the right camera;

calculate a first horizontal rotation matrix for adjusting the first horizontal parallax of the left image and a second horizontal rotation matrix for adjusting the second horizontal parallax of the right image;
calculate a geometric transformation matrix for the stereo image based on each camera characteristic matrix representing lens characteristics of the stereo camera, the vertical rotation matrix, the first horizontal rotation matrix, and the second horizontal rotation matrix; and
generate a new stereo image in which the vertical parallax is eliminated and the first horizontal parallax and the second horizontal parallax are is adjusted by performing image warping for the stereo image captured by the stereo camera based on the calculated geometric transformation matrix to provide to the output unit.