Patent Description:
There has recently been proposed a method for estimating a leaf color index using the remote sensing technology for efficient and labor-saving agricultural work. For example, Patent Document <NUM> discloses a method of estimating a SPAD (Soil & Plant Analyzer Development) value from a spectral measurement result of light reflected by a plant.

<NPL>, paper no. <NUM>-<NUM>, discloses an image processing method comprising acquiring a spectral image obtained of a crop canopy by a multi-spectral imaging sensor comprising a <NUM>-CCD RGB camera and ambient light data obtained by an ambient illumination sensor, estimating from the spectral image and the ambient light data a compensated spectral reflectance that accounts for variations in ambient light, and estimating a nitrogen content in the crop from the compensated spectral reflectance.

The method disclosed in Patent Document <NUM> presumes that the light that has reached a light receiver is only the light reflected by the plant. However, the leaf of the plant is a semitransparent object and thus transmitting light transmitting through the leaf of the plant also reaches the light receiver as well as the reflected light reflected by the leaf of the plant. In addition, a mixture ratio of the reflected light and the transmitting light changes according to the weather (sunny, cloudy, etc.) and the position of the sun (altitude and azimuth). Therefore, the method disclosed in Patent Document <NUM> has difficulty in highly accurately estimate the concentration of the material (leaf color, that is, the SPAD value), because the mixture ratio of the reflected light and the transmitting light changes as the weather or the sun position changes.

Accordingly, it is an object of the present invention to provide an image processing method, an image processing apparatus, an imaging system, and a program, each of which can highly accurately estimate a concentration of a material contained in an object from a spectral image.

An image processing method according to one aspect of the present invention is defined in claim <NUM>.

An image processing apparatus according to another aspect of the present invention is defined in claim <NUM>.

An imaging system according to another aspect of the present invention is defined in claim <NUM>.

A program according to another aspect of the present invention that causes a computer to execute the image processing method is defined in claim <NUM>.

Other objects and features of the invention will be described in the following embodiments.

The present invention can provide an image processing method, an image processing apparatus, an imaging system, and a program, each of which can highly accurately estimate a concentration of a material contained in an object from a spectral image.

Referring now to the accompanying drawings, a description will be given of embodiments according to the present invention. Corresponding elements in respective figures will be designated by the same reference numerals, and a duplicate description thereof will be omitted.

Referring now to <FIG>, a description will be given of a camera captured model according to a first embodiment of the present invention. <FIG> is an explanatory diagram of a camera captured model according to this embodiment. <FIG> illustrates an object <NUM> to be captured by a camera (image pickup apparatus) <NUM>. The object <NUM> is illuminated by ambient light incident on the object <NUM> from each position on a hemispherical space in which the object <NUM> is placed. In <FIG>, the ambient light is divided into ambient light <NUM> that illuminates the back surface of the object <NUM> and ambient light <NUM> that illuminates the front surface of the object <NUM>.

The object <NUM> is a semitransparent object, the ambient light <NUM> is diffused and absorbed inside the object <NUM>, and part of transmitting light (transmitting light <NUM>) reaches the camera <NUM>. On the other hand, the ambient light <NUM> is diffused and absorbed inside the object <NUM>, and part of the reflected light (reflected light <NUM>) reaches the camera <NUM>. In this embodiment, the so-called diffuse reflected light reflected by such a process will be simply referred to as reflected light, and is distinguished from regular reflection light reflected on the surface of the object <NUM>.

Therefore, the image of the object <NUM> captured by the camera <NUM> is formed by a mixture of transmitting light (transmitting light component) <NUM> and reflected light (reflected light component) <NUM> at a specific ratio. The mixture ratio of the transmitting light <NUM> and the reflected light <NUM> changes as the ambient lights <NUM> and <NUM> fluctuate. In particular, in imaging under outdoor ambient light, the mixture ratio of the transmitting light <NUM> and the reflected light <NUM> changes depending on the weather (sunny, cloudy, etc.) and the sun position (altitude and azimuth).

When the image is captured under the outdoor ambient light in this way, the mixture ratio of the transmitting light <NUM> and the reflected light <NUM> is unknown and changes depending on the illumination environment during imaging. Therefore, it is difficult to quantitatively estimate the concentration of the material (chlorophyll or the like) contained in the object from the image captured in such a state. This embodiment can quantitatively estimate the concentration of the material contained in the object by separating the transmitting light <NUM> and the reflected light <NUM> (separation processing) from the spectral image captured under such ambient light. Hereinafter, the separation processing will be described in detail.

First, this embodiment formulates the camera captured model illustrated in <FIG>, for example, as in the expression (<NUM>). [Expression <NUM>] <MAT>.

In the expression (<NUM>), In represents a luminance value of an image (spectral image) captured by the camera <NUM>, and a subscript n represents a wavelength number of the spectral image. For example, when the camera <NUM> is an RGB camera, n = {<NUM>, <NUM>, <NUM>}, and I<NUM>, I<NUM>, and I<NUM> each indicate RGB luminance values. IR, n, and IT, n represent luminance values when the reflected light <NUM> and the transmitting light <NUM> are acquired independently. IR0, n and IT0, n represent the illuminances of the ambient lights <NUM> and <NUM> that illuminate the object <NUM>, respectively. Rn(c) and Tn(c) represent spectral reflection characteristics (reflection characteristic data) and spectral transmission characteristics (transmission characteristic data), respectively, depending on the concentration c of the material contained in the object <NUM>. In this embodiment, each of the spectral reflection characteristic Rn(c) and the spectral transmission characteristic Tn(c) has previously been stored as known library data in a storage device such as a memory. kR represents a ratio of the ambient light <NUM> reflected by the object <NUM> and reaching the camera <NUM>, and kT represents a ratio of the ambient light <NUM> passing through the object <NUM> and reaching the camera <NUM>.

The illuminance information IR0, n, and the illuminance information IT0, n of the ambient lights <NUM> and <NUM> during imaging are known and acquired, for example, by the ambient light information acquirer (detector) <NUM> illustrated in <FIG>. In this embodiment, the ambient light information acquirer <NUM> includes an ambient light sensor (first ambient light sensor) <NUM> and an ambient light sensor (second ambient light sensor) <NUM> installed in two different directions. The ambient light sensor <NUM> acquires the illuminance information IT0, n of the ambient light <NUM>. The ambient light sensor <NUM> acquires the illuminance information IR0, n of the ambient light <NUM>.

This embodiment acquires the ratio kR of the reflected light (reflected light component), the ratio kT of the transmitting light (transmitting light component), and the concentration c of the material contained in the object <NUM> by performing the optimization (optimization calculation) represented by the following expression (<NUM>) using the camera captured model formulated in this way. [Expression <NUM>] <MAT>.

In this expression (<NUM>), "|| || <NUM>" represents the L2 norm. The separation processing according to this embodiment means the execution of the optimization calculation of the expression (<NUM>), but the present invention is not limited to this example. With kR, kT, and c obtained by the optimization, the reflected light (reflected light component) and the transmitting light (transmitting light component) are separated and expressed as illustrated in the following expressions (<NUM>) and (<NUM>), respectively.

Therefore, this embodiment can separate the transmitting light <NUM> and the reflected light <NUM> from the spectral image in which the transmitting light <NUM> and the reflected light <NUM> are mixed at an unknown mixture ratio. Further, this embodiment can quantitatively estimate the concentration of the material contained in the object <NUM>.

This embodiment relates to an image processing system (imaging system) that estimates the concentration of the object (paddy rice leaf) <NUM> from the image (spectral image) acquired by the camera (RGB camera) <NUM>. In this embodiment, the concentration c in the expression (<NUM>) corresponds to the SPAD value.

Referring now to <FIG>, a description will be given of the configuration of the image processing system <NUM> according to this embodiment. <FIG> is a block diagram of the image processing system <NUM>. The image processing system <NUM> includes an image capturer <NUM>, an image processor (image processing apparatus) <NUM>, a controller <NUM>, a memory <NUM>, a communicator <NUM>, a display unit <NUM>, and an ambient light information acquirer <NUM>. The image capturer <NUM> includes an imaging optical system 101a and an image sensor 101b. The image sensor 101b photoelectrically converts an optical image (object image) formed via the imaging optical system 101a and outputs an image (image data) to the image processor <NUM>. The image processor <NUM> has an acquiring means 102a and a separating means 102b.

The image processing system <NUM> can be provided inside the camera <NUM>. Alternatively, some functions such as the image processor <NUM> of the image processing system <NUM> may be implemented in a computer (user PC) away from the camera <NUM> or on cloud computing. In this case, the camera <NUM> has only part of the image processing system <NUM> including the image capturer <NUM>.

<FIG> illustrates the object <NUM> that is imaged under outdoor ambient light using the image processing system <NUM>. As illustrated in <FIG>, the ambient light information acquirer <NUM> of the image processing system <NUM> includes an ambient light sensor <NUM> configured to acquire the illuminance incident on the back surface of the object <NUM>, and an ambient light sensor <NUM> configured to acquire the illuminance incident on the front surface of the object <NUM>.

Referring now to <FIG>, a description will be given of an image processing method according to this embodiment. <FIG> is a flowchart of the image processing method according to this embodiment. Each step in <FIG> is mainly executed by the acquiring means 102a or the separating means 102b in the image processor <NUM>.

First, in the step S201, the image capturer <NUM> in the image processing system <NUM> images the object <NUM> by the signal from the controller <NUM> and acquires an RGB image (spectral image). Then, the acquiring means 102a in the image processor <NUM> acquires the image captured by the image capturer <NUM>. At the same time as the step S201, in the step S202, the ambient light information acquirer <NUM> (ambient light sensors <NUM> and <NUM>) acquires (detects), based on the signal from the controller <NUM>, the ambient light information (ambient light data) IR0, n and IT0, n. In this embodiment, the ambient light information is information on the tint. Then, the acquiring means 102a acquires the ambient light information IR0, n and IT0, n detected by the ambient light information acquirer <NUM>.

The ambient light sensors <NUM> and <NUM> is made by disposing a diffuser on a sensor having the same spectral sensitivity characteristic as that of the image capturer <NUM>, and acquire ambient light information having the same spectral wavelength as that of the image capturer <NUM>. The ambient light sensors <NUM> and <NUM> may include a spectroradiometer, and acquire the ambient light information IR0, n and IT0, n using the following expressions (<NUM>) and (<NUM>) with an acquired spectral irradiance E(λ), a spectral transmittance characteristic L(λ) of the imaging optical system, and a spectral sensitivity characteristic Sn(λ) of the image sensor.

In the expressions (<NUM>) and (<NUM>), ET(λ) is the illuminance of the ambient light <NUM>, ER(λ) is the illuminance of the ambient light <NUM>, and λn, <NUM> and λn, <NUM> are the shortest wavelength and the longest wavelength, respectively, in the wavelength band in which the image sensor 101b having the spectral sensitivity characteristic Sn(λ) has sensitivity.

Next, in the step S210, the separating means 102b in the image processor <NUM> performs separation processing based on the expression (<NUM>). Referring now to <FIG>, a description will be given of the separation processing according to this embodiment. <FIG> is a flowchart of the separation processing according to this embodiment. Each step in <FIG> is mainly executed by the separating means 102b in the image processor <NUM>.

First, in the step S211 the separating means 102b performs an optimization calculation based on the expression (<NUM>). Next, in the step S212, the separating means 102b calculates the reflected light component and transmitting light component of the expressions (<NUM>) and (<NUM>). In the steps S211 and S212, the separating means 102b utilizes the reflection characteristic data and the transmission characteristic data of the object that have been previously stored.

Referring now to <FIG>, a description will be given of the reflection characteristic data and the transmission characteristic data in this embodiment. <FIG> is an explanatory diagram of reflection characteristic data and transmission characteristic data. <FIG> is data showing SPAD value dependencies on the RGB reflectance and the RGB transmittance that have been acquired in advance. A dot plotted point represents the RGB reflectance, a triangularly plotted point represents the RGB transmittance, and a filled color corresponds to the SPAD value. This embodiment separates, as illustrated in <FIG>, the reflected light and the transmitting light utilizing the fact that the spectral reflection characteristic and the spectral transmission characteristic have different characteristics from each other.

<FIG> plots the results of fitting the RGB reflectance and RGB transmittance of <FIG> into the following expressions (<NUM>) and (<NUM>) by the least squares method using the SPAD value c as a parameter.

In expressions (<NUM>) and (<NUM>), an, i and bn, i are constants determined by the least squares method. In <FIG>, similar to <FIG>, a dot plotted point represents the RGB reflectance, and a triangularly plotted point represents the RGB transmittance.

This embodiment has stored information on the expressions (<NUM>) and (<NUM>) as the reflection characteristic data and the transmission characteristic data of the object, respectively. The reflection characteristic data and the transmission characteristic data are not limited to the above data. For example, as illustrated in <FIG>, the reflectance characteristic Rfl(c, λ) and the transmittance characteristic Trs(c, λ) of the object may be used. <FIG> is an explanatory diagram of other reflection characteristic data and transmission characteristic data according to this embodiment. <FIG> illustrates a spectral reflectance characteristic of the paddy rice leaf, where the abscissa axis represents a wavelength and the ordinate axis represents a reflectance. The color of each line corresponds to the SPAD value shown on the color bar. Similarly, <FIG> illustrates the transmittance characteristic of paddy rice, where the abscissa axis represents a wavelength and the ordinate axis illustrates a transmittance.

When the reflection characteristic data and the transmission characteristic data as illustrated in <FIG> are used, Rn(c) and Tn(c) are preferably calculated using the following expressions (<NUM>) and (<NUM>) with the spectral transmittance characteristic L(λ) of the imaging optical system 101a and the spectral sensitivity characteristic Sn(λ) of the image sensor 101b.

In expressions (<NUM>) and (<NUM>), λn, <NUM> and λn, <NUM> are the shortest wavelength and the longest wavelength, respectively, in the wavelength band in which the image sensor 101b having the spectral sensitivity characteristic Sn(λ) has sensitivity.

In the step S211 the separating means 102b performs the optimization calculation of the expression (<NUM>) using the spectral image, the ambient light information, and the reflection characteristic data and the transmission characteristic data of the object <NUM> stored in the memory <NUM>. The optimization calculation can use a known optimization method, such as a gradient method. As illustrated in the expressions (<NUM>) and (<NUM>), when Rn(c) and Tn(c) are differentiable functions, the expression (<NUM>) is also a differentiable function and thus a faster optimization calculation method such as the Newton method and the trust region method can be used.

Referring now to <FIG>, a description will be given of the result of the separation processing by the optimization calculation. <FIG> is a diagram showing the result of the separation processing according to this embodiment and the result of performing the optimization calculation using a trust region method in the step S211 in <FIG>. <FIG> is an image made by converting an RGB image of paddy rice captured by an RGB camera into a grayscale image. <FIG> are diagrams showing the results of optimizing calculations for the ratio kR of the reflected light, the ratio kT of the transmitting light, and the concentration c of the material for each pixel of the paddy rise leaf. <FIG> is a diagram showing a value f of the optimization evaluation function of the expression (<NUM>) on a logarithmic scale.

In the step S212 in <FIG>, the separating means 102b calculates the reflected light component and the transmitting light component based on the expressions (<NUM>), (<NUM>), (<NUM>), and (<NUM>) from the ratio kR of the reflected light, the ratio kT of the transmitting light, and the material concentration c obtained in the step S211. As described above, this embodiment can separate the reflected light component and the transmitting light component from the spectral image of the object. In the processing of calculating the expression (<NUM>), the material concentration c of the object <NUM> can be estimated.

Next follows a description of a second embodiment according to the present invention. This embodiment estimates a SPAD value of a rice leaf from the spectral image acquired by the RGB camera in the same manner as in the first embodiment.

Referring now to <FIG> and <FIG>, a description will be given of a configuration of an image processing system <NUM> and the camera captured model according to this embodiment.

<FIG> is a block diagram of the image processing system <NUM>. <FIG> is an explanatory diagram of the camera captured model, and illustrates the object <NUM> that is captured under outdoor ambient light using the image processing system <NUM>. The image processing system <NUM> according to this embodiment is different from the image processing system <NUM> according to the first embodiment having an ambient light information acquirer <NUM> in that the image processing system <NUM> includes an ambient light information acquirer (detector) <NUM>. As illustrated in <FIG> and <FIG>, the ambient light information acquirer <NUM> exclusively includes a single ambient light sensor <NUM>. Since the other configuration of the image processing system <NUM> is the same as that of the image processing system <NUM>, a description thereof will be omitted.

Next follows a description of the reason for using only one ambient light sensor <NUM> in this embodiment. <FIG> is an explanatory diagram of the ambient light information acquiring model in this embodiment, and illustrates the arrangement of the ambient light sensor <NUM> arranged westward and the ambient light sensor <NUM> arranged eastward. The ambient light sensors <NUM> and <NUM> have a configuration in which a diffuser plate is attached to an RGB color sensor.

<FIG> is an explanatory diagram of a time change of the ambient light information, and plots the ambient light information acquired by the ambient light sensors <NUM> and <NUM>. In <FIG>, WBR, b, WBR, r, WBT, b, and WBT, r are white balance correction coefficients calculated using the following expressions (<NUM>) to (<NUM>) with the illuminance information IR0, n acquired by the ambient light sensor <NUM> and the illuminance information IT0, n acquired by the ambient light sensor <NUM>. n = {<NUM>, <NUM>, <NUM>}, indicating that the values are acquired by the color sensors of R, G, and B in this order.

<FIG> is a diagram that plots the time change of the white balance correction coefficient when it is cloudy. A black dot represents WBR, b, a white dot represents WBT, b, a black square represents WBR, r, and a white square represents WBT, r. As illustrated in <FIG>, when it is cloudy, WBR, b and WBT, b are equal to each other and WBR, r and WBT, r are equal to each other regardless of the arrangement orientation of the ambient light sensor. <FIG> is a diagram that plots the time change of the white balance correction coefficient when it is sunny in the same manner as in <FIG>. When it is sunny, WBR, b and WBT, b are equal to each other and WBR, r and WBT, r are equal to each other at only around midday when the sun crosses the meridian.

Accordingly, this embodiment captures a spectral image when the white balance correction coefficient does not depend on the arrangement orientation of the ambient light sensor (such as within <NUM> hours before and after the sun crosses the meridian). Thereby, even the single ambient light sensor <NUM> can execute the separation processing of the reflected light and the transmitting light.

At such a time (such as within <NUM> hours before and after the sun crosses the meridian), the white balance correction coefficient does not depend on the orientation of the ambient light sensor. Therefore, the ambient light sensor <NUM> according to this embodiment is installed upwardly, for example, as illustrated in <FIG>, and can acquire the ambient light information. Where IR0, n is the ambient light information acquired by the ambient light sensor <NUM> and IT0, c = m·IR0, c (m is a proportional constant), the expression (<NUM>) for the optimization calculation can be transformed as in the expression (<NUM>). [Expression <NUM>] <MAT>.

In the expression (<NUM>), k'T = m·kT, and Rn(c) and Tn(c) use the data of the expressions (<NUM>) and (<NUM>). The method of acquiring the ambient light information IR0, n is not limited to the above method, and as illustrated in <FIG>, a standard reflective plate <NUM> is imaged by the camera <NUM>, and the ambient light information IR<NUM>, n may be acquired from the pixel values of the image of the captured standard reflective plate. <FIG> is an explanatory diagram of a method of acquiring ambient light information using the standard reflective plate <NUM>.

Referring now to <FIG>, a description will be given of the image processing method according to this embodiment. <FIG> is a flowchart of the image processing method (SPAD value estimating method) according to this embodiment. Each step in <FIG> is mainly executed by the acquiring means 102a or the separating means 102b in the image processor <NUM>.

First, in the step S401, the image capturer <NUM> in the image processing system <NUM> images the object <NUM> in response to the signal from the controller <NUM> and acquires an RGB image (spectral image). Then, the acquiring means 102a in the image processor <NUM> acquires the image captured by the image capturer <NUM>. At the same time as the step S401, in the step S402, the ambient light information acquirer <NUM> (ambient light sensor <NUM>) acquires (detects) the ambient light information (ambient light data) IR0, n when the image is captured in response to the signal from the controller <NUM>. Then, the acquiring means 102a acquires the ambient light information IR0, n detected by the ambient light information acquirer <NUM>.

Next, in the step S403, the image processor <NUM> extracts the captured area (object area) of the paddy rice as the object <NUM>. As a method for extracting the paddy rice area, for example, an image may be generated by converting an RGB image into an HSV color space, and pixels within a range of hue angles that can be taken by the paddy rice leaves may be extracted as the paddy rice area.

Next, in the steps S405 and S406, the separating means 102b in the image processor <NUM> performs the separation processing. First, in the step S404, the separating means 102b performs an optimization calculation based on the expression (<NUM>) for each pixel of the paddy rice area extracted in the step S403. Next, in the step S405, the separating means 102b calculates the reflected light component I'R, n whose ambient light component is corrected, using the following expression (<NUM>) with the ratio kR of the reflected light and the concentration c calculated in the step S404. [Expression <NUM>] <MAT>.

Next, in the step S406, the image processor <NUM> calculates NGRDI (Normalized Green Red Difference Index) as an index (growth index) that correlates with the SPAD value. NGRDI is calculated based on the following expression (<NUM>) using the reflected light component calculated in the step S405. [Expression <NUM>] <MAT>.

Finally, in the step S407, the image processor <NUM> converts NGRDI into a SPAD value using the following expression (<NUM>), which is a correlation expression between NGRDI and the SPAD value. [Expression <NUM>] <MAT>.

In the expression (<NUM>), di is a constant representing a correlation between NGRDI and the SPAD value.

In the separation processing according to this embodiment, the material concentration c (corresponding to the SPAD value) is calculated by the optimization calculation of the expression (<NUM>), but the calculated material concentration c and the ratio kR of the reflected light contain errors. Therefore, this embodiment performs processes of the steps S405 to S407 in order to estimate the material concentration with more redundancy.

The method according to this embodiment can improve the estimation accuracy of the SPAD value by using to estimate the SPAD value the optimization calculation result of only pixels having values f of the optimization evaluation function of the expression (<NUM>) are equal to or less than a threshold fcn. <FIG> is an explanatory diagram of a difference in estimation accuracy of the SPAD value (material concentration) with respect to the threshold fcn. In <FIG>, the abscissa axis represents the threshold fcn, and the ordinate axis represents the root mean square error RMSE between the average value and the correct value of the SPAD value estimation results of the pixels equal to or smaller than the threshold fcn. As illustrated in <FIG>, the estimation accuracy of the SPAD value can be improved by properly setting the threshold fth.

<FIG> is an explanatory diagram of the SPAD value estimation result, and illustrates the result of estimating the daily change of the SPAD value from the RGB image captured by a fixed-point camera. In <FIG>, the abscissa axis represents the date and the ordinate axis represents the SPAD value. In <FIG>, a squarely plotted point represents an estimation result when the separation processing according to this embodiment is not performed in the steps S404 and S405, and a dot plotted point represents an estimation result when the separation processing is performed. An asterisk plotted point represents a correct value, and an average value of the results measured by the SPAD meter is adopted as the correct value for <NUM> strains of paddy rice in the image estimation area. An error bar represents the standard deviation. Therefore, as illustrated in <FIG>, the separation processing according to this embodiment can quantitatively estimate the material concentration.

The present invention can supply a program that implements one or more functions of the above embodiments to a system or apparatus via a network or a storage medium, and can be implemented by one or more processors in a computer of the system or apparatus configured to read and execute the program. It can also be implemented by a circuit (e.g., an ASIC) that implements one or more functions.

Thus, in each embodiment, the image processing apparatus (image processor <NUM>) has the acquiring means 102a and the separating means 102b. The acquiring means acquires the image of the object (spectral image), the ambient light data (information on the tint) when the object is imaged, and the reflection characteristic data (Rn(c)) and transmission characteristic data (Tn(c)) that depend on the concentration (SPAD value) of the material (chlorophyll, etc.) contained in the object. The separating means separates the reflected light component (IR, n) and the transmitting light component (IT, n) from the image using the image, the ambient light data, the reflection characteristic data, and the transmission characteristic data. Thereby, the image processing apparatus according to each embodiment can separate the reflected light component and the transmitting light component from the spectral image obtained by imaging the semitransparent object. Therefore, each embodiment can provide an image processing method, an image processing apparatus, an imaging system, and a program, each of which can highly accurately estimate the concentration of a material contained in an object from a spectral image.

Although preferable embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the invention as defined by the appended claims.

Claim 1:
An image processing method comprising:
an acquiring step (S201, S202) of acquiring a spectral image obtained by imaging of an object (<NUM>), ambient light data during the imaging, and reflection characteristic data and transmission characteristic data which depend on a concentration of a material contained in the object; and
a separating step (S210) of separating a reflected light component (<NUM>) and a transmitting light component (<NUM>) in the spectral image using the ambient light data, the reflection characteristic data, and the transmission characteristic data.