An image processing apparatus, comprising: a ray reproduction section configured to generate virtual rays to be incident to a virtual lens, the virtual lens having a synthetic aperture with a size that is dependent upon real space positions of a plurality of respective real image capture sections each configured to capture one or more images in a real space, wherein for a real space point in the images, the virtual rays are generated to be incident to the virtual lens in dependence upon rays emitted from the real space point in the images captured by the plurality of respective real image capture sections; and a light condensing processing section configured to perform a light condensing process to obtain an emulation image in dependence upon the virtual rays generated by the ray reproduction section and emulation lens information, the emulation lens information comprising information defining a Point Spread Function intensity distribution of an emulation lens and image plane shift information for the emulation lens, the emulation lens to be used instead of the virtual lens to obtain the emulation image, in which the emulation lens is arranged with respect to the virtual rays at a location different from a location of the virtual lens, the displacement between the location of the emulation lens and the location of the virtual lens is dependent upon the image plane shift information and the emulation lens is configured to condense the virtual rays on a virtual sensor to obtain the emulation image, in which a position at which the virtual rays generated by the ray reproduction section are condensed on the virtual sensor by the emulation lens is controlled depending upon the image plane shift information, in which the light condensing processing section performs the light condensing process in which respective image formation values corresponding to respective virtual rays are added on the virtual sensor, in which the light condensing processing section performs the light condensing process in which the position on the virtual sensor at which the respective image formation values are added is dependent upon the image plane shift position, and in which the light condensing processing section determines the respective image formation values to be added using the respective virtual rays and the Point Spread Function (Point Spread Function) intensity distribution of the emulation lens representative of a response of the emulation lens to a virtual ray emitted from a point light source. a ray reproduction section configured to generate virtual rays to be incident to a virtual lens, the virtual lens having a synthetic aperture with a size that is dependent upon real space positions of a plurality of respective real image capture sections each configured to capture one or more images in a real space, wherein for a real space point in the images, the virtual rays are generated to be incident to the virtual lens in dependence upon rays emitted from the real space point in the images captured by the plurality of respective real image capture sections; and a light condensing processing section configured to perform a light condensing process to obtain an emulation image in dependence upon the virtual rays generated by the ray reproduction section and emulation lens information, the emulation lens information comprising information defining a Point Spread Function intensity distribution of an emulation lens and image plane shift information for the emulation lens, the emulation lens to be used instead of the virtual lens to obtain the emulation image, in which the emulation lens is arranged with respect to the virtual rays at a location different from a location of the virtual lens, the displacement between the location of the emulation lens and the location of the virtual lens is dependent upon the image plane shift information and the emulation lens is configured to condense the virtual rays on a virtual sensor to obtain the emulation image, in which a position at which the virtual rays generated by the ray reproduction section are condensed on the virtual sensor by the emulation lens is controlled depending upon the image plane shift information, in which the light condensing processing section performs the light condensing process in which respective image formation values corresponding to respective virtual rays are added on the virtual sensor, in which the light condensing processing section performs the light condensing process in which the position on the virtual sensor at which the respective image formation values are added is dependent upon the image plane shift position, and in which the light condensing processing section determines the respective image formation values to be added using the respective virtual rays and the Point Spread Function (Point Spread Function) intensity distribution of the emulation lens representative of a response of the emulation lens to a virtual ray emitted from a point light source.