# Patent

## Title
Color characteristic measurement apparatus, color characteristic measurement method, and picked up image data storage medium

## Abstract

It is an object of the invention to measure the precise color characteristic of an image pickup machine and accurately reproduce a subject in an image display unit.
A color characteristic measurement apparatus which has a test chart (1) as a subject of an image pickup machine (6), a hole (2) made in the test chart (1), a black box (3) placed on a rear face of the test chart (1) and formed on an inner surface in black, and a light output section (4) placed in the black box (3) at a position where the light output section (4) can be observed through the hole (2) from the outside.

## Background
This application is a divisional of application Ser. No. 09/319,872, filed on Jun. 14, 1999, now U.S. Pat. No. 6,633,330 and for which priority is claimed under 35 U.S.C. § 120. Application Ser. No. 09/319,872 is the national phase of PCT International Application No. PCT/JP97/04669 filed on Dec. 18, 1997 under 35 U.S.C. § 371. The entire contents of each of the above-identified applications are hereby incorporated by reference. This application also claims priority of Application No. HEI 8-343498 filed in Japan on Dec. 24, 1996 under 35 U.S.C. § 119.


TECHNICAL FIELD
This invention relates to a color characteristic measurement apparatus, a color characteristic measurement method, and an image pickup data storage medium and in particular to an apparatus and a method for measuring the color characteristic of an image pickup machine such as a digital video camera or a digital still camera or measuring and correcting the color characteristic and a storage medium for storing image data picked up by an image pickup machine.
BACKGROUND OF THE INVENTION
A typical color characteristic measurement apparatus and method of an image pickup machine in a related art are shown in Section 3, Clause 18 of “International Standard IEC 1146-1 Video cameras (PAL/SECAM/NTSC)—Method of Measurement—Part 1: Non-broadcasting single sensor cameras” published in May 1994 by IEC (International Electrotechnical Commission) as international standard.
FIG. 48 is a drawing to show the configuration of an apparatus for measuring color and gradation characteristics of a digital still camera which is used as an example of an image pickup machine, as application of such a measurement apparatus and method in the related art. In the figure, numeral 6 denotes an image pickup machine such as a digital still camera whose color characteristic is to be measured, numeral 1 denotes a test chart of a subject of the image pickup machine 6, numeral 5 denotes an illumination light source having stable illumination intensity and color temperature for illuminating the test chart 1, and numeral 19 denotes a computer for receiving data output from the image pickup machine 6.
FIG. 49 is a format drawing of the test chart 1 containing white, black, a gray scale 200 changing gradually from white to black, and several color charts 210 of red, green, blue, etc., as reference colors. As examples of these color charts, the characteristics are defined in Annex A and Annex B of the above-mentioned international standard.
First, the R, G, and B values of the color charts 210 of the test chart 1 shown in FIG. 49 are assumed to be already known and are adopted as theoretical values. For example, if data consists of eight bits, ideally R=255 and G=B=0 for red, G=255 and R=B=0 for green, and B=255 and R=B=0 for blue.
Next, the differences between the R, G, and B values corresponding to the color charts 210 measured when an image of the test chart 1 is picked up by the image pickup machine 6 and the theoretical R, G, and B values (color differences) are found, whereby the color reproducibility of the image pickup machine 6 can be evaluated.
The gradation characteristic of the image pickup machine 6 can be found from the measurement values provided when the gray scale 200 changing gradually from white to black is imaged by the image pickup machine 6.
However, the illumination intensity and chromaticity on the face of the test chart illuminated by the illumination light source vary from one position to another. Thus, if a photograph of the same color chart is taken, the measurement value varies depending on the position on the test chart and unless illumination intensity and chromaticity inconsistencies are corrected, precise values cannot be provided.
If a photograph of the same color chart is taken even under ideal uniform illumination, the measurement value varies depending on the characteristics of the image pickup optical system of the image pickup machine, for example, because of the light quantity difference between the center and peripheral portions. Thus, unless the characteristics of the image pickup optical system of the image pickup machine are already known and are used to correct the measurement values, precise values cannot be provided.
To take a photograph of the test chart at a place where the characteristics of the image pickup optical system of the image pickup machine are the same, the test chart must be moved or replaced or the image pickup machine must be moved.
Some image pickup machines have automatic correction functions of an automatic exposure function, an automatic gain correction function, an automatic white balance correction function, etc. If a subject changes, a correction is made according to the setting responsive to the subject, thus a photograph of a different subject cannot be taken under the same setup conditions.
Although the color differences between the measurement values of the R, G, and B values corresponding to the color charts on the test chart and the theoretical R, G, and B values can be found, the spectral sensitivity characteristic of the image pickup machine as the basis of color management cannot be measured.
The test chart used as a subject usually is printed matter and it is difficult to generate black with reflectivity close to 0% and white with reflectivity close to 100%, thus the maximum value and minimum value of measurement data cannot be corrected.
Since the test chart is printed matter, change with time, such as color deterioration or color change, is involved, thus measurement with high reproducibility is hard to execute.
Only with limited types of images picked up by the image pickup machine, the color difference from any other general subject is not seen.
Only with information provided from limited types of images picked up by the image pickup machine, a highly accurate color correction cannot be made to the image of any other general subject.
To relate measurement data of color characteristic measurement apparatus to the images picked up by the image pickup machine, work such as preparation of an additional correspondence table becomes necessary.
If the type of illumination light source (spectral distribution characteristic) changes, the data corresponding to each color chart imaged by the image pickup machine also changes. However, means for accurately reflecting the characteristic of each illumination light source is not provided in related art, thus color management of the image pickup machine containing the illumination light source is hard to accomplish. Particularly, there is not a method of correctly measuring the spectral sensitivity characteristic of the image pickup machine for the reason as described above, thus if the spectral sensitivity characteristic of a light source, etc., is measured accurately, it does not lead to color management making the effective use of the spectral sensitivity characteristic.
DISCLOSURE OF THE INVENTION
According to the invention, there is provided a color characteristic measurement apparatus comprising a test chart as a subject, a hole being made in the test chart, a black box being placed on a rear face of the test chart and formed on an inner surface in black, and a light output section being placed in the black box at a position where the light output section can be observed through the hole from the front of the test chart.
The test chart occupies most of the photograph taking range of an image pickup machine as compared with the hole made in the test chart. Thus, output light of the light output section can be changed while automatic correction functions are fixed.
If applied light from an illumination light source of the test chart is incident on the black box through the hole, it is absorbed in the black box and is not reflected; it is not emitted again through the hole. Thus, output light from the light output section can be observed without being affected by the external environments.
According to the invention, there is provided a color characteristic measurement method comprising the steps of providing a color characteristic measurement apparatus and an illumination light source, placing the color characteristic measurement apparatus and the illumination light source so that light applied from the illumination light source is not applied to a light output section in a black box, imaging a test chart of the color characteristic measurement apparatus by an image pickup machine, and finding a color characteristic of the image pickup machine based on first data corresponding to the area of the light output section, extracted from picked up image data or second data provided by performing operation on the first data.
Thus, output light from the light output section not affected by the external illumination light source can be observed while automatic correction functions are fixed.
According to the invention, there is provided a picked up image data storage medium for adding to image data provided by an image pickup machine the gradation characteristic and the spectral sensitivity characteristic of the image pickup machine or the data provided by performing operation on the gradation and spectral sensitivity characteristics and storing the image data.
Thus, the subject can be reproduced precisely in an image display unit without being affected by the color characteristic of the image pickup machine.



BRIEF DESCRIPTION OF THE DRAWINGS
In the accompanying drawings:
FIG. 1 is an external view of an example of a color characteristic measurement apparatus of a first embodiment of the invention;
FIG. 2 is a sectional view of the color characteristic measurement apparatus in FIG. 1 taken on a plane perpendicular to a test chart 1 containing a dashed line AB;
FIG. 3 is a sectional view to show a configuration example of a color characteristic measurement apparatus of a second embodiment of the invention;
FIG. 4 is a sectional view to show a configuration example of a color characteristic measurement apparatus of a third embodiment of the invention;
FIG. 5 is a drawing to show an example of the spectral characteristic of the color characteristic measurement apparatus of the third embodiment of the invention;
FIG. 6 is a sectional view to show a configuration example of a color characteristic measurement apparatus of a fourth embodiment of the invention;
FIG. 7 is a sectional view to show a configuration example of a color characteristic measurement apparatus of a fifth embodiment of the invention;
FIG. 8 is a sectional view to show a configuration example of a color characteristic measurement apparatus of a sixth embodiment of the invention;
FIG. 9 is a drawing to show image data provided when a diffuser panel is not placed in the sixth embodiment of the invention;
FIG. 10 is a drawing to show image data provided when a diffuser panel is placed in the sixth embodiment of the invention;
FIG. 11 is a drawing to show a configuration example of a color characteristic measurement apparatus of a seventh embodiment of the invention;
FIG. 12 is a drawing to show another configuration example of the color characteristic measurement apparatus of the seventh embodiment of the invention;
FIG. 13 is a drawing to show an example of the measurement result of spectral sensitivity containing an offset;
FIG. 14 is a drawing to show an example of the spectral sensitivity characteristic of an image pickup machine found by subtracting the offset from the measurement result shown in FIG. 13;
FIGS. 15 and 16 are drawings to show configuration examples of the color characteristic measurement apparatus of the seventh embodiment of the invention, applied to the apparatus comprising a spectral filter in front of a light output section shown in FIG. 6;
FIGS. 17 and 18 are drawings to show configuration examples of the color characteristic measurement apparatus of the seventh embodiment of the invention, applied to the apparatus comprising a diffuser panel in front of a light output section shown in FIG. 8;
FIG. 19 is a drawing to show an example of the main part of a color characteristic measurement apparatus of an eighth embodiment of the invention, wherein gray scales are placed on a test chart;
FIG. 20 is a drawing to show an example of the main part of a color characteristic measurement apparatus of a ninth embodiment of the invention, wherein color charts are placed on a test chart;
FIG. 21 is a drawing to show an example of the main part of a color characteristic measurement apparatus of a tenth embodiment of the invention;
FIG. 22 is a drawing to show an example of the main part of a color characteristic measurement apparatus of an eleventh embodiment of the invention;
FIG. 23 is a drawing to show an example of a test chart of a color characteristic measurement apparatus of a fourteenth embodiment of the invention;
FIG. 24 is a drawing to show the relationships among image data values output by an image pickup machine;
FIG. 25 is a drawing to show examples of color charts inserted into a hole in a color characteristic measurement apparatus of a fifteenth embodiment of the invention;
FIG. 26 is a drawing to show examples of image data output by an image pickup machine;
FIG. 27 is a drawing to show an example of the found gradation characteristic of the image pickup machine;
FIG. 28 is a drawing to show an example of a picked up image with a color chart inserted into the test chart;
FIG. 29 is a drawing to show another example of a picked up image with a color chart inserted into the test chart;
FIG. 30 is a drawing to show the relationships among image data values output by the image pickup machine;
FIG. 31 is a table to list the correspondences between the wavlengths and image data output by an image pickup machine at the wavelengths in a sixteenth embodiment of the invention;
FIG. 32 is a drawing to show the spectral sensitivity characteristic of the image pickup machine;
FIG. 33 is a drawing to show an example applied when one single-wavelength light is output from a light output section;
FIG. 34 is a drawing to show another example applied when one single-wavelength light is output from a light output section;
FIG. 35 is a drawing to show the relationships among image data values output by the image pickup machine;
FIG. 36 is a drawing to describe a color characteristic measurement method of a seventeenth embodiment of the invention;
FIG. 37 is a drawing to describe correction of a spectral sensitivity characteristic using a gradation characteristic;
FIG. 38 is a drawing to describe the color characteristic measurement method of the seventeenth embodiment of the invention and is a drawing to show the gradation characteristic of an image pickup machine;
FIG. 39 is a drawing to show the spectral sensitivity characteristic of the image pickup machine measured;
FIG. 40 is a drawing to show the spectral sensitivity characteristic of the image pickup machine with the excluded effect of the gradation characteristic thereof;
FIG. 41 is a drawing to show data formats according to a nineteenth embodiment of the invention;
FIG. 42 is a block diagram to show a configuration example of a color characteristic measurement apparatus of a twelfth embodiment of the invention;
FIG. 43 is a drawing to describe a color management method according to a twenty-first embodiment of the invention;
FIG. 44 is a drawing to describe the color management method according to the twenty-first embodiment of the invention;
FIG. 45 is a drawing to describe a color characteristic measurement method of a twenty-second embodiment of the invention;
FIG. 46 is a drawing to show data format examples of image files in the twenty-second embodiment of the invention;
FIG. 47 is a drawing to show data format examples of image files in a twenty-third embodiment of the invention;
FIG. 48 is a drawing to show a configuration example of a color characteristic measurement apparatus in a related art; and
FIG. 49 is a drawing to show an example of a test chart of the color characteristic measurement apparatus shown in FIG. 48.



BEST MODE FOR CARRYING OUT THE INVENTION
Referring now to the accompanying drawings, there are shown preferred embodiments of the invention.
First Embodiment
As a first embodiment of the invention, a color characteristic measurement apparatus for fixing the action of the automatic correction function of an image pickup machine and measuring the color characteristic thereof will be discussed.
FIG. 1 is an external view of an example of the color characteristic measurement apparatus of the first embodiment of the invention. FIG. 2 is a sectional view of the color characteristic measurement apparatus in FIG. 1 taken on a plane perpendicular to a test chart 1 containing a dashed line AB.
In the figures, numeral 1 denotes a test chart used as a subject, numeral 2 denotes a hole which is made in the test chart 1 and is sufficiently small relative to the area of the test chart 1, numeral 3 denotes a black box whose inside is painted in black, numeral 4 denotes a light output section that can be observed through the hole 2, numeral 5 denotes an illumination light source having a stable color temperature, numeral 6 denotes an image pickup machine of a test specimen whose color characteristic is to be measured, and numeral 7 denotes applied light incident on the black box 3 through the hole 2. The light output section 4 is formed of a light source in the embodiment, but may be a light emission end for emitting light from an external light source.
The inner walls of the black box 3 are set to sufficiently low reflectivity and the applied light 7 incident on the black box 3 through the hole 2 from the outside is absorbed on the inner walls and is not reflected; it is not emitted again through the hole 2. Thus, if the light source 4 is not provided in the black box 3 and the hole 2 is observed from the outside, a state close to optically complete black can be observed. Therefore, the light source 4 is placed at a position where observation can be made through the hole 2 from the outside, whereby only output light of the light source 4 not affected by the applied light 7 can be observed.
The image pickup machine 6 picks up the test chart 1 containing light of the light source 4 peeped from the hole 2. At this time, for example, if the image pickup machine 6 is a digital still camera, the color characteristic of the image pickup machine 6 can be measured by obtaining the pixel value at the position corresponding to the light source 4 on the picked up image when the light source 4 is changed.
Generally, the image pickup machine 6 has automatic correction functions of an automatic exposure function, an automatic gain correction function, an automatic white balance correction function, etc. Thus, if light source light whose characteristic changes is imaged as a subject, the automatic correction functions operate and the exposure conditions, etc., change; it is difficult to measure the precise color characteristic of the image pickup machine 6 using the image data.
Then, in the embodiment, the color characteristic measurement apparatus is provided with the test chart 1 occupying most of the photograph taking range of the image pickup machine 6 as compared with the hole 2. Thus, the automatic correction functions work only for the test chart 1 and can be fixed without being affected by change in the light source 4. That is, the test chart 1 and the illumination light sources 5 for applying light to the test chart 1 as external environments are fixed, whereby the automatic correction functions can be excluded.
Using the color characteristic measurement apparatus, the light source 4 can be used as a measurement object of the image pickup machine and the measurement position can be fixed. Thus, the characteristics of the optical system of the image pickup machine such as illumination inconsistencies and light quantity nonuniformity depending on the image pickup area position like a cosine fourth-power law, for example, need not be considered. Particularly, for a consumer-oriented image pickup machine which has various automatic correction functions, but not a function of invalidating or fixing the automatic correction functions, subjects of various characteristics can be set without changing the automatic correction functions.
Second Embodiment
As a second embodiment of the invention, a color characteristic measurement apparatus for measuring the gradation characteristic of an image pickup machine will be discussed.
FIG. 3 is a sectional view to show a configuration example of the color characteristic measurement apparatus of the second embodiment of the invention. In the color characteristic measurement apparatus, an attenuator is mounted preceding a light output section 4 so that output light of the light output section 4 can be changed in specific light quantity steps. According to the second embodiment, the attenuator 9 is adjusted, whereby light of any desired light quantity can be observed through a hole 2.
Thus, if a test chart 1 containing the hole 2 is imaged by an image pickup machine 6 as in the first embodiment, the color characteristic of the image pickup machine 6 in any desired light quantity can be measured. That is, the light quantity of output light of the light output section 4 is changed to any desired value by the attenuator 9 and the characteristics of the image pickup machine 6 at the time are measured, whereby the gradation characteristic of the image pickup machine 6 can be measured precisely and easily.
A neutral-density filter, etc., is preferred as the attenuator 9 for measuring the gradation characteristic of the image pickup machine. In the second embodiment, the attenuator 9 is provided preceding the light output section 4, but if the light output section 4 is an emission end of light, a similar advantage is also provided if the attenuator 9 is placed at a point between a light source and the emission end of light. A similar advantage is also provided if the light quantity is changed by a light source with a dimmer function.
Third Embodiment
As a third embodiment of the invention, a color characteristic measurement apparatus for measuring the spectral sensitivity characteristic of an image pickup machine using a spectral light source will be discussed.
FIG. 4 is a sectional view to show a configuration example of the color characteristic measurement apparatus of the third embodiment of the invention. In the color characteristic measurement apparatus, a spectral light source 8 is attached to a light output section 4 for emitting a spectrum of output light of the light source. According to the third embodiment, the wavelength of light output from the spectral light source 8 is set, whereby spectrum of any desired wavelength can be observed through a hole 2. The spectral light source 8 generally is made up of a lamp such as a halogen lamp and a spectroscope.
According to the third embodiment, a test chart 1 containing the hole 2 is imaged by an image pickup machine 6 as in the first embodiment, whereby the characteristics of the image pickup machine 6 relative to light of any desired wavelength can be measured without being affected by various automatic functions. Thus, the wavelength of light output from the light output section 4 is changed by the spectral light source 8 and the characteristics of the image pickup machine 6 at the time are measured, whereby the spectral sensitivity characteristic of the image pickup machine 6 can be measured precisely and easily. The wavelength may be represented as barycentric wavelength.
If the color characteristic measurement apparatus is configured so that output light of the light output section 4 can be changed in specific wavelength steps with respect to a specific wavelength range by the spectral light source 8, the spectral sensitivity characteristic of the image pickup machine 6 can be provided with higher practicality.
If the spectral wavelength range of the spectral light source 8 is set to a visible light range, the spectral sensitivity characteristic of the image pickup machine 6 fitted to the visual characteristics of human beings can be provided.
The wavelength range is set in the range of 380 nm to 780 nm, whereby the spectral sensitivity characteristic of the image pickup machine 6 can be provided matching a first-kind spectral measuring instrument conforming to Japanese Industrial Standard JIS Z 8722, for example.
Further, if the wavelength steps are set so that half-value widths of spectral light become equal, namely, width C in B which is one-half a wave height A in FIG. 5 and wavelength step R become equal as shown in a waveform chart of FIG. 5, the wavelength components overlap almost the same. Thus, the spectral sensitivity characteristic of the image pickup machine 6 can be provided with less lost information and less overlapped information relative to the measurement wavelength range. The half-value width may be represented as effective wavelength width.
Fourth Embodiment
As a fourth embodiment of the invention, a color characteristic measurement apparatus for measuring the spectral sensitivity characteristic of an image pickup machine using a spectral filter will be discussed.
FIG. 6 is a sectional view to show a configuration example of the color characteristic measurement apparatus of the fourth embodiment of the invention. The color characteristic measurement apparatus comprises a filter 10 having a specific spectral transmission factor characteristic placed in front of a light output section 4.
Light that can be observed through a hole 2 is only light of output light of the light output section 4 passing through the filter 10. The spectral transmission factor characteristic of the filter 10 can be changed by replacing the filter 10. Therefore, light observed through the hole 2 can be made light of any desired spectral distribution characteristic.
Fifth Embodiment
As a fifth embodiment of the invention, a color characteristic measurement apparatus using an external light source will be discussed.
FIG. 7 is a sectional view to show a configuration example of the color characteristic measurement apparatus of the fifth embodiment of the invention. In the figure, numeral 11 denotes an optical fiber and numeral 12 denotes a light source unit such as a lamp house. The color characteristic measurement apparatus has the light source unit 12 separated from a black box 3. According to the fifth embodiment, light of the light source unit 12 at an outside position distant from the apparatus is guided through the optical fiber 11 into the equipment and can be measured as output light from a light output section 4. Silica glass, etc., is preferred as a material of the optical fiber 11 if wavelength light of 400 nm or less is to be measured.
The configuration of the color characteristic measurement apparatus is useful if the light source is of large size as compared with the black box 3 or requires heat radiation. In FIG. 7, the optical fiber is shown as a typical optical waveguide device, but a similar advantage can be provided if any other optical waveguide device is used.
Sixth Embodiment
As a sixth embodiment of the invention, a color characteristic measurement apparatus using a diffuser panel for decreasing a measurement error will be discussed.
FIG. 8 is a sectional view to show a configuration example of the color characteristic measurement apparatus of the sixth embodiment of the invention. In the figure, numeral 13 denotes a diffuser panel, which is placed in front of a light output section 4 for diffusing light.
FIG. 9 is an enlarged view of the portion of the light output section 4 with respect to image data picked up by an image pickup machine 6 with the diffuser panel 13 not placed. Generally, in the color characteristic measurement apparatus for packing up an image of a light source or an optical fiber emission end, the pixel values of image data of the light output section 4 vary, as shown in FIG. 9, due to the effects of change in the optical axis, the light quantity difference in minute areas of the light source, etc.; resultantly, the measurement values contain many errors.
However, output light of the light source 4 can be diffused by placing the diffuser panel 13 in front of light of the light output section 4, so that light of the light output section 4 observed through a hole 2 becomes averaged light as shown in FIG. 10 with the error causes excluded. That is, the light output section 4 observed through the hole 2 can be made a uniform surface light source and measurement accuracy can be enhanced.
Seventh Embodiment
As a seventh embodiment of the invention, a color characteristic measurement apparatus for adding an offset to the output light quantity of a light output section 4 and measuring the spectral sensitivity of an image pickup machine will be discussed.
FIG. 11 is a drawing to show a configuration example of the color characteristic measurement apparatus of the seventh embodiment of the invention. The color characteristic measurement apparatus is the same as that shown in FIG. 2 for emitting light from a spectral light source (not shown) through the light output section 4 except that the light output section 4 is placed nearer to a hole 2 in a test chart 1 so that illumination light sources 5 illuminate the light output section 4 in a black box 3.
The inner walls of the black box 3 are set to sufficiently low reflectivity and most of applied light 7 incident on the black box 3 from the illumination light sources 5 is absorbed on the inner walls of the black box 3 and is not reflected; it is not emitted again through the hole 2. Therefore, an offset as much as the reflected light quantity of the applied light 7 reflected on the light output section 4 is added to the output light quantity from the light output section 4.
FIG. 13 shows the spectral sensitivity characteristic of an image pickup machine 6 measured by the color characteristic measurement apparatus. Offset A in the figure denotes the offset applied from the illumination light sources 5. After the spectral sensitivity characteristic shown in FIG. 13 is provided, the offset is subtracted therefrom, whereby the spectral sensitivity characteristic of the image pickup machine 6 is provided as shown in FIG. 14.
The spectral sensitivity characteristic shown in FIG. 14 contains a negative component. Formerly, it was difficult to precisely measure such a characteristic of the image pickup machine. Using the color characteristic measurement apparatus, an offset is added to the output light quantity from the light output section 4 and the spectral sensitivity characteristic of the image pickup machine is measured, whereby precise measurement can also be made on the negative component contained in such a spectral sensitivity characteristic.
The offset shown in FIG. 13, offset A, is a value corresponding to the light quantity found by observing the light output section 4 with no light output therefrom.
FIG. 12 is a drawing to show another configuration example of the color characteristic measurement apparatus of the seventh embodiment of the invention. The color characteristic measurement apparatus is provided by adding one or more additional illumination light sources 30 to the apparatus shown in FIG. 2.
The illumination light sources 5 are placed at positions where applied light is not applied to the light output section 4 as in FIG. 2, whereas the illumination light sources 30 are placed at positions where applied light is applied to the light output section 4, and applied light from the illumination light sources 30 is reflected on the light output section 4 and becomes an offset. Thus, the illumination intensity of a test chart is controlled by means of the illumination light sources 5 and the offset can be controlled by means of the illumination light sources 30.
FIGS. 15 to 18 are drawings to show other configuration examples of the color characteristic measurement apparatus of the seventh embodiment of the invention.
The configuration examples of the color characteristic measurement apparatus shown in FIGS. 15 and 16 are applied to the apparatus comprising the spectral filter 10 in front of the light output section 4 previously described with reference to FIG. 6. The color characteristic measurement apparatus shown in FIG. 15 comprises the illumination light sources 5 for illuminating the spectral filter 10 and the apparatus shown in FIG. 16 comprises the illumination light sources 30 for illuminating the spectral filter 10 rather than the illumination light sources 5. Thus, the color characteristic measurement apparatus comprising the spectral filter can also measure output light to which an offset is added.
The configuration examples of the color characteristic measurement apparatus shown in FIGS. 17 and 18 are applied to the apparatus comprising the diffuser panel 13 in front of the light output section 4 previously described with reference to FIG. 8. The color characteristic measurement apparatus shown in FIG. 17 comprises the illumination light sources 5 for illuminating the diffuser panel 13 and the apparatus shown in FIG. 18 comprises the illumination light sources 30 for illuminating the diffuser panel 13 rather than the illumination light sources 5. Thus, the color characteristic measurement apparatus comprising the diffuser panel can also measure output light to which an offset is added.
Eighth Embodiment
As an eighth embodiment of the invention, a color characteristic measurement apparatus using a gray scale for correcting a gradation characteristic will be discussed.
FIG. 19 is a drawing to show an example of the main part of the color characteristic measurement apparatus of the eighth embodiment of the invention; it provides a front view of a test chart 1. In FIG. 19, gray scales 14 each comprising an arrangement of color charts different in reflectivity are placed on the test chart 1.
As previously described in the first embodiment, most image pickup machines have automatic correction functions, which include functions of automatically controlling the incident light quantity, the storage time, a gamma correction characteristic, setup level, knee-point, etc., affecting the gradation characteristic of the image pickup machine 6.
Then, the gray scales 14 are placed on the test chart 1 and a hole 2 and the gray scales 14 are imaged by the image pickup machine 6 at the same time, whereby if any change occurs in the automatic correction functions of the image pickup machine 6, the effects of the gradation characteristic correction functions of the image pickup machine 6 can be canceled out on the data in the area of the hole 2 in the picked up image data.
That is, when the characteristic of output light from a light output section 4 is changed in various manners and is observed with the image pickup machine 6, the hole 2 and the gray scales 14 are imaged by the image pickup machine 6 at the same time, whereby the characteristics of the automatic correction functions concerning the gradation characteristic that the image pickup machine 6 has at each observation time are found from the data corresponding to the color charts different in reflectivity in the gray scales 14.
Thus, correction processing can be easily performed for canceling out the effects of the gradation characteristic correction functions of the image pickup machine 6 on the data in the area of the light output section 4 in the picked up image data; precise measurement can be made with the automatic correction function effects excluded.
If the gray scales 14 each consisting of a larger number of color charts different in reflectivity are placed on the test chart 1, more precise characteristics of the automatic correction functions can be provided. However, if one color chart is placed, the characteristics of the automatic correction functions concerning the gradation characteristic can be provided.
Ninth Embodiment
As a ninth embodiment of the invention, a color characteristic measurement apparatus using color charts for correcting a color characteristic will be discussed.
FIG. 20 is a drawing to show an example of the main part of the color characteristic measurement apparatus of the ninth embodiment of the invention; it provides a front view of a test chart 1. In FIG. 20, color charts 15 different in chromaticity are placed on the test chart 1.
Most image pickup machines have automatic correction functions as previously described in the first embodiment and may comprise automatic correction functions concerning a color characteristic such as black balance correction, white balance correction, and color matrix correction.
Then, the color charts 15 are placed on the test chart 1 and a hole 2 and the color charts 15 are imaged by the image pickup machine 6 at the same time, whereby if any change occurs in the automatic correction functions of the image pickup machine 6, the effects of the color characteristic correction functions of the image pickup machine 6 can be canceled out on the data in the area of the hole 2 in the picked up image data.
That is, when the characteristic of output light from a light output section 4 is changed in various manners and is observed with the image pickup machine 6, the hole 2 and the color charts 15 are imaged by the image pickup machine 6 at the same time, whereby the characteristics of the automatic correction functions concerning the color characteristic that the image pickup machine 6 has at each observation time are found from the data corresponding to the color charts 15 different in chromaticity.
Thus, correction processing can be easily performed for canceling out the effects of the color characteristic correction functions of the image pickup machine 6 on the data in the area of the light output section 4 in the picked up image data; precise measurement can be made with the automatic correction function effects excluded.
If a larger number of the color charts 15 different in chromaticity are placed on the test chart 1, more precise characteristics of the automatic correction functions can be provided. However, if one color chart is placed, the characteristics of the automatic correction functions concerning the color characteristic can be provided.
Tenth Embodiment
As a tenth embodiment of the invention, a color characteristic measurement apparatus for precisely measuring the gradation characteristic in a low-brightness area will be discussed.
FIG. 21 is a drawing to show an example of the main part of the color characteristic measurement apparatus of the tenth embodiment of the invention; it provides a front view of a test chart 1. In FIG. 21, in addition to a hole 2, two holes 16 are made in the test chart 1. These holes 16 are of sizes and are made at positions such that output light from a light output section 4 is not observed on an image pickup machine 6 through the holes 16 and that light from an illumination light source 5 is not applied to the light output section 4 through the holes 16.
The holes 16 are made, whereby an optically almost complete black portion in a black box 3, namely, black with reflectivity close to 0% can be observed through the holes 16, so that zero-level correction on the test chart 1 and the light source 4 can be made. The hole 16 is provided as a black color chart of the gray scale previously described in the eighth embodiment, whereby a precise gradation characteristic can be provided particularly concerning a low-brightness area.
Eleventh Embodiment
As an eleventh embodiment of the invention, a color characteristic measurement apparatus for precisely measuring the gradation characteristic in a high-brightness area will be discussed.
FIG. 22 is a drawing to show an example of the main part of the color characteristic measurement apparatus of the eleventh embodiment of the invention; it provides a front view of a test chart 1. In FIG. 22, reference white color charts 17 are placed on the test chart 1 in the proximity of a hole 2 made therein.
When the test chart 1 is imaged by an image pickup machine 6 and a light output section 4 is changed in various manners, if the reflectivities of other color charts of the test chart 1 and a background are set so that the image data corresponding to the reference white color charts 17 becomes almost the maximum in the dynamic range of the image pickup machine 6 and if output light of the light output section 4 is changed so that the image data in the area of the light output section 4 observed through the hole 2 becomes the maximum in a range not exceeding the image data in the reference white areas, it is made possible to execute high-resolution measurement making the effective use of the dynamic range of the image pickup machine 6 in which image data is not saturated with respect to high-brightness input.
If the image pickup machine 6 has channels for a number of colors, output light of the light output section 4 may be changed so that image data is not saturated with respect to any channels.
To set the image pickup machine 6 of the type wherein the automatic correction function state cannot be set from the outside so that the image data in the reference white areas becomes almost the maximum in the dynamic range of the image pickup machine 6, a method of placing a white or black flat plate in the surroundings of the test chart 1 and changing the image pickup view angle of the image pickup machine 6 or the like is available; placement of the reference white color charts 17 in the proximity of the hole 2 is also effective for the method.
As another effect of placing the reference white color charts 17 in the proximity of the hole 2 in the test chart 1, when various characteristics based on the light source 4 observed through the hole 2 are measured, change in the image data in the reference white areas in the proximity of the hole 2 can be observed at the same time, so that it is made possible to detect delicate change in the gradation characteristic particularly in a high-brightness area and correct the above-mentioned various characteristics in response to the change.
Twelfth Embodiment
As a twelfth embodiment of the invention, a color characteristic measurement method of an image pickup machine using the above-described color characteristic measurement apparatus will be discussed.
First, to image a test chart 1 by the image pickup machine 6, light is applied to the test chart 1 from the illumination light sources 5. At this time, light is also applied to the inside of the black box 3 through the hole 2 from the illumination light sources 5. The application range of the applied light 7 is determined by the size of the hole 2 and the positions of the illumination light sources 5. Then, the illumination light sources 5 and the test chart 1 are placed as shown in FIG. 1 so as not to apply light to the light output section 4 observed through the hole 2 directly from the illumination light sources 5, and the test chart 1 containing output light of the light output section 4 oberved through the hole 2 is imaged by the image pickup machine 6.
If the image pickup machine 6 is, for example, a digital still camera, data corresponding to the area of the light output section 4 can be provided from the image data output after an image is picked up. This is first data. Color characteristic measurement of the image pickup machine 6 can be executed by observing the first data.
The image pickup machine 6 is connected to, for example, a personal computer, etc., and application software, etc., is used to input image data from the image pickup machine 6 to the personal computer, then the data corresponding to the light output section 4 can also be provided from the input image data. This is second data.
Generally, the image data input to the personal computer is provided by performing gradation characteristic conversion operation, color space conversion operation, operation for making good color considering the visual characteristics of human beings, or the like on the first data. Thus, color characteristic measurement of the image pickup machine 6 containing the application software can be executed by observing the second data.
The manufacturers or dealers of the image pickup machines 6 often manufacture and sell the image pickup machine 6 and application software in combination, in which case color characteristic measurement of the image pickup machine 6 can be executed based on the first data and in addition, comprehensive color characteristic measurement of the image pickup machine 6 containing the characteristics of the application software, etc., can also be executed based on the second data.
The application software may be called any other representation such as driver software. If application software, etc., for inputting image data from the image pickup machine 6 to any other machine or system and application software, etc., for performing various conversion operations on the input image data to prepare the second data are separate software products rather than one piece, a similar advantage is also provided, of course.
Thirteenth Embodiment
As a thirteenth embodiment of the invention, a color characteristic measurement method using the color characteristic measurement apparatus previously described with reference to FIG. 20 with the color charts 15 placed on the test chart 1 as a subject of an image pickup image 6 will be discussed. The first or second data provided by the method of the twelfth embodiment described above is corrected from color change in the portions of the color charts 15 in the image data picked up by the image pickup machine 6.
According to the method of the thirteenth embodiment, if the color characteristic is changed due to the effects of automatic correction functions, etc., it can be corrected to provide the first or second data.
Fourteenth Embodiment
As a fourteenth embodiment of the invention, a color characteristic measurement method using the above-described color characteristic measurement apparatus-for measuring the precise gradation characteristic of an image pickup machine 6 will be discussed.
If the above-described color characteristic measurement apparatus is used, the automatic correction functions of the image pickup machine 6 work only for the test chart 1 and are not affected by change in output light of the light output section 4. However, the automatic functions of the image pickup machine 6, for example, the automatic exposure control function may work because of change in the illumination intensity of the illumination light source 5 illuminating the test chart 1. If the image pickup machine 6 is a digital camera, etc., often the exposure control operation is repeated within a short time each time an image is picked up, thus the iris, electronic shutter speed, signal processing gain, and the like are not necessarily the same whenever an image is picked up.
Change in the illumination intensity of the illumination light source 5 can be suppressed by using a stabilized power supply for supply power to the illumination light source 5. Change of the automatic functions of the image pickup machine 6 is minute because the subject is the same except for output light through the hole 2. However, to measure the precise gradation characteristic of the image pickup machine 6, the effect of the minute change needs also to be corrected.
As an example, a case will be examined where the light quantity of output light of the light output section 4 is changed continuously or gradually from 0% to 100% of the maximum light quantity. The light output section 4 does not output light and light entered through the hole 2 is not output either through the hole 2 to the outside, whereby the light quantity of 0% can be realized.
Then, the output light quantity of the light output section 4 is adjusted in the range of 0% to 100% and the test chart 1 is imaged by the image pickup machine 6 in each adjusted light quantity. At this time, as shown in FIG. 23, the test chart 1 is provided with gray scales 14 each consisting of color charts 14C different in reflectivity and the image pickup machine 6 also images the color charts 14C at the same time as outupt light from the light output section 4.
When the automatic functions of the image pickup machine 6 do not change, if the output light quantity of the light output section 4 is changed gradually and an image is picked up each time, the image data values of the gray scales 14 become the same in every image. However, if the image data values of the gray scales 14 change for some factor, the image data values of the light output section 4, namely, the hole 2 for measuring the gradation characteristic of the image pickup machine 6 also change likewise, thus the precise gradation characteristic cannot be provided.
Then, a chart applied when the output light quantity of the light output section 4 is adjusted to a specific light quantity (for example, 50% of the maximum light quantity) is adopted as a reference chart and the image data values of the gray scale 14 provided when the output light quantity is changed are compared with those of the gray scale 14 of the reference chart. If they differ, the image data value of the light output section 4 is corrected linearly as much as the image data value difference between the gray scales 14.
Let the image data values of the color charts 14C imaged with output light of the light output section 4 set to one light quantity be Y0, Y1, . . . , Y14 and Y15 and the image data value of the light output section 4 at the time be Xi. Assume that the relation between the image data values Y0 to Y15 of the color charts 14C and the image data value Xi satisfies the following expression (1):

Y0, Y1, . . . <Yi<Xi<Yi+1 . . . , Y14, Y15  (1)

Let the image data values of the color charts 14C on the reference chart be Ystd0, Ystd1, . . . , Ystd14, and Ystd15.

At this time, if the image data value Yi or Yi+1 of the color chart differs from the image data value Ystdi or Ystdi+1 of the corresponding color chart 14C on the reference chart (Yi≠Ystdi or Yi+1≠Ystdi+1), the image data value Xi is corrected according to the following expression, namely, post-corrected image data value X′i is found according to the following expression (2):

X′i=(Xi−Yi)(Ystdi+1−Ystdi)/(Yi+1−Yi)+Ystdi  (2)

The correction shown in expression (2) will be discussed with reference to FIG. 24, which is a drawing to show the relationships among the image data values. The image data values Yi, Xi, and Yi+1 provided when the light quantity is changed and the image data values Ystdi+1 and Ystdi of the reference chart are shown. In the image data of the reference chart, the true value of the image data Xi should be at the position of X′i shown in FIG. 24. Therefore, the true value of the image data Xi can be calculated according to the above-mentioned expression (2).
When output data of the image pickup machine 6 is R, G, and B, if the image data values of the color charts 14C change from those of the reference chart, a similar correction is made to R, G, and B data, whereby the true values of the image data in each image can be provided and the precise gradation characteristic of the image pickup machine 6 can be measured.
If the correction is made to the first data provided by the method of the twelfth embodiment, the gradation characterisic of the image pickup machine 6 can be found; if the correction is made to the second data, the comprehensive gradation characteristic of the image pickup machine 6 also containing application softrware can be found.
Fifteenth Embodiment
As a fifteenth embodiment of the invention, a color characteristic measurement method using the above-described color characteristic measurement apparatus for imaging a color chart inserted into the hole 2 in the test chart 1 by an image pickup machine 6 and measuring the precise gradation characteristic of the image pickup machine 6 will be discussed.
As in the fourteenth embodiment, the automatic correction functions of the image pickup machine 6 work only for the test chart 1 and are not affected by change in the color chart inserted into the hole 2, but may work because of the effect of disturbance or each time an image is picked up. Thus, to measure the precise gradation characteristic of the image pickup machine 6, the effects need to be corrected.
As an example, the reflectivities of color charts 2C are set to 0.0%, 2.0%, 4.0%, 6.0%, 8.0%, 10.3%, 14.7%, 19.8%, 25.8%, 32.5%, 39.9%, 48.1%, 57.0%, 66.6.%, 77.0%, and 88.1%. If it is difficult to prepare the color chart 2C of reflectivity 0.0%, no color chart is inserted into the hole 2 in the test chart 1 in a state in which light is not emitted from the light output section 4 and light entered through the hole 2 is not output again through the hole 2 to the outside, whereby the color chart 2C of reflectivity 0% can be realized.
The test chart 1 used is similar to that in FIG. 23. The color charts 2C different in reflectivity are placed in the hole 2 one at a time in order and an image is picked up by the image pickup machine 6. FIG. 25 shows the color charts 2C different in reflectivity each inserted into the hole 2 in the test chart 1.
The color charts 2C are inserted into the hole 2 in the test chart 1 one at a time in order and the test chart 1 is imaged by the image pickup machine 6 under the photograph taking conditions shown in FIG. 2. The pixel values of the color charts 2C in the picked up images are found, whereby the gradation characteristic of the image pickup machine 6 can be measured. For example, when output data of the image pickup machine 6 is R, G, and B and output data of the color charts 2C different in reflectivity is provided as shown in FIG. 26, the gradation characteristic of the image pickup machine 6 of the test specimen can be represented as shown in FIG. 27.
FIG. 28 shows an image picked up by the image pickup machine 6 with the color chart 2C of reflectivity 25.8% inserted into the test chart 1. FIG. 29 shows an image picked up by the image pickup machine 6 with the color chart 2C of reflectivity 77.0% inserted into the test chart 1. To measure the gradation characteristic of the image pickup machine 6, as many images as the number of the color charts 2C different in reflectivity are picked up as images shown in FIGS. 28 and 29.
Now, assume that the image shown in FIG. 28 is adopted as a reference chart. Gray scales 14 in FIG. 28 are each provided with color charts 14C different in reflectivity. The color charts 14C on the gray scales 14 may or may not be of the same reflectivities as the color charts 2C shown in FIG. 25.
When the automatic functions of the image pickup machine 6 do not change, if the color charts 2C different in reflectivity are inserted into the hole 2 in the test chart 1 one at a time in order and an image is picked up by the image pickup machine 6, the image data values of the gray scales 14 become the same in every image. However, if the image data values of the color charts of the gray scales 14 change for some factor, the image data values of the color charts 2C for measuring the gradation characteristic of the image pickup machine 6 also change likewise, thus the precise gradation characteristic cannot be provided.
If the provided image data values of the color charts of the gray scales 14 differ from the image data values of the gray scales 14 of the reference chart, the image data value of the color chart 2C is corrected linearly as much as the image data value difference.
Let the image data values of the color charts 14C of the gray scales 14 imaged with the color chart 2C of one reflectivity inserted into the hole 2 in the test chart 1 as shown in FIG. 29 be Y0, Y1, . . . , Y14 and Y15 and the image data value of the color chart 2C at the time be Xi. Assume that the relation between the image data value of the color chart 2C and the image data values of the color charts 14C of the gray scales 14 in FIG. 29 satisifes the following expression (3):

Y0, Y1, . . . <Yi<Xi<Yi+1 . . . , Y14, Y15  (3)

Let the image data values of the color charts 14C on the reference chart shown in FIG. 28 be Ystd0, Ystd1, . . . . , Ystd14, and Ystd15.

When the image data value Yi or Yi+1 of the color chart 14C differs from the image data value Ystdi or Ystdi+1 of the corresponding color chart 14C on the reference chart (Yi≠Ystdi or Yi+1≠Ystdi+1), the image data value Xi is corrected according to the following expression: (Assume that post-corrected image data value is X′i.)

X′i=(Xi−Yi)(Ystdi+1−Ystdi)/(Yi+1−Yi)+Ystdi  (4)

The correction shown in expression (4) will be discussed with reference to FIG. 30, which is a drawing to show the relationships among the image data values. The relationships among the image data values Yi, Xi, and Yi+1 shown in FIG. 28 are as shown in FIG. 30. When the values Ystdi+1 and Ystdi of the reference chart are the values shown in FIG. 30, the true value of the image data Xi should be at the position of X′i shown in FIG. 30. Therefore, the true value of the image data Xi can be calculated according to the above-mentioned expression (4).
When output data of the image pickup machine 6 is R, G, and B, a similar correction is made to each of R data, G data, and B data, whereby the true value of the image data of the color chart 2C in each image can be provided and the precise gradation characterisic of the image pickup machine 6 can be measured.
The embodiment uses the image with the color chart 2C of reflectivity 25.8% inserted in the hole 2 as the reference chart, but if an image with any other color chart 2C inserted in the hole 2 is used as the reference chart, a similar advantage can be provided, needless to say.
If the correction is made to the first data provided by the method of the twelfth embodiment, the gradation characteristic of the image pickup machine 6 can be found; if the correction is made to the second data, the comprehensive gradation characteristic of the image pickup machine 6 also containing application software can be found.
Sixteenth Embodiment
As a sixteenth embodiment of the invention, a color characteristic measurement method using the above-described color characteristic measurement apparatus for measuring the precise spectral sensitivity characteristic of an image pickup machine 6 will be discussed.
If the above-described color characteristic measurement apparatus is used, the automatic correction functions of the image pickup machine 6 work only for the test chart 1 and are not affected by change in the light output section 4, but may work because of the effect of disturbance or each time an image is picked up. To measure the precise spectral sensitivity characteristic of the image pickup machine 6, the effects need to be corrected.
In the above-described color characteristic measurement apparatus, output light from the light output section 4 is changed in specific wavelength steps in a specific wavelength range and the test chart 1 is imaged by the image pickup machine 6. In the picked up image, the pixel values of the light output section 4 are found for each specific wavelength, whereby the spectral sensitivity characteristic of the image pickup machine 6 can be measured. For example, when output data of the image pickup machine 6 is R, G, and B and output data at the wavelengths is provided as shown in FIG. 31, the spectral sensitivity characteristic of the image pickup machine 6 of the test specimen can be represented as shown in FIG. 32.
As an example, the wavelengths of output light of the light output section 4 are 380 nm, 385 nm, 390 nm, . . . , 770 nm, 775 nm, and 780 nm. FIG. 33 shows an image picked up by the image pickup machine 6 when single-color light of wavelength 580 nm is emitted. In FIG. 33, an image of the light output section 4 in the hole 2 is picked up. FIG. 34 shows an image picked up when light of wavelength λ nm is emitted. To measure the color characteristic of the image pickup machine 6, as many images as the number of the different wavelengths are picked up as images shown in FIGS. 33 and 34. If an image is thus picked up in 5-nm steps in the range of 380 nm to 780 nm, 81 images are picked up in total.
Now, assume that the image, shown in FIG. 33, picked up when the wavelength of output light through the hole 2 is 580 nm is adopted as a reference chart. Gray scales 14 in FIG. 33 are each provided with color charts 14C different in reflectivity.
When the automatic functions of the image pickup machine 6 do not change, if the wavelength of output light from the light output section 4 is changed and an image is picked up by the image pickup machine 6 each time, the image data values of the color charts 14C of the gray scales 14 are the same in every image. However, if the image data values of the color charts 14C of the gray scales 14 change for some factor, the image data values of the light output section 4 for measuring the spectral sensitivity characteristic of the image pickup machine 6 also change likewise, thus the precise color characteristic cannot be provided.
If the provided image data values of the color charts of the gray scales 14 differ from the image data values of the gray scales 14 of the reference chart, the image data value of the light output section 4 is corrected linearly as much as the image data value difference.
Let the image data values of the color charts 14C of the gray scales 14 of an image picked up when the wavelength of one output light of the light output section 4 is λ be Y0, Y1, . . . , Y14 and Y15, as shown in FIG. 34, and the image data value of the light output section 4 be Xλ. Assume that in FIG. 34, the relation between the image data value of the light output section 4 and the image data values of the color charts 14C of the gray scales 14 satisfies the following expression (5):

Y0, Y1, . . . <Yi<Xλ<Yi+1 . . . , Y14, Y15  (5)

Let the image data values of the color charts 14C of the gray scales 14 on the reference chart be Ystd0, Ystd1, . . . . Ystd14, and Ystd15, as shown in FIG. 33.

At this time, if the image data value Yi or Yi+1 of the color chart differs from the image data value Ystdi or Ystdi+1 of the corresponding color chart on the reference chart (Yi≠Ystdi or Yi+1≠Ystdi+1), the image data value Xλ is corrected according to the following expression (6): (Assume that post-corrected image data value is X′λ.)

X′λ=(Xλ−Yi)(Ystdi+1−Ystdi)/(Yi+1−Yi)+Ystdi  (6)

FIG. 35 shows the relationships among the image data values. The correction shown in expression (6) will be discussed with reference to FIG. 35. The relationships among the image data values Yi, Xλ, and Yi+1 shown in FIG. 34 are as shown in FIG. 35. When the values Ystdi+1 and Ystdi of the reference chart are the values shown in FIG. 35, the true value of the image data Xλ should be at the position of X′λ shown in FIG. 35. Therefore, the true value of the image data Xλ can be calculated according to the above-mentioned expression (6).
When output data of the image pickup machine 6 is R, G, and B, a similar correction is made to each of R data, G data, and B data, whereby the true value of the image data of the light output section 4 in each image can be provided and the precise color characteristic of the image pickup machine 6 can be measured.
The embodiment uses the image picked up when the wavelength of output light of the light output section 4 is 580 nm as the reference chart, but if an image picked up when the wavelength is any other than 580 nm or an image picked up with a color chart of any reflectivity inserted in the hole 2 in the test chart shown in the fifteenth embodiment is used as the reference chart and the correction based on the above-mentioned expression (6) is made, a similar advantage can be provided, needless to say.
If the correction is made to the first data provided by the method of the twelfth embodiment, the color characteristic of the image pickup machine 6 can be found; if the correction is made to the second data, the comprehensive color characteristic of the image pickup machine 6 also containing application software can be found.
Seventeenth Embodiment
As a seventeenth embodiment of the invention, a color characteristic measurement method using the above-described color characteristic measurement apparatus for measuring the spectral sensitivity characteristic of an image pickup machine 6 from which the effect of the gradation characteristic of the image pickup machine 6 is excluded will be discussed.
FIG. 36 is a drawing to an example of the gradation characteristic of an image pickup machine, wherein first data is indicated by the solid line and second data is indicated by the dashed line. As indicated by the solid line in the figure, often the gradation characteristic of the image pickup machine 6 is not linear; it is corrected by a characteristic inverse to the gradation characteristic, whereby a linear characteristic as indicated by the dashed line in the figure is provided.
FIG. 37 is a drawing to show a correction example. It shows a spectral sensitivity characteristic. If the gradation characteristic is not linear, namely, the spectral sensitivity characteristic having a characteristic as indicated by the solid line in FIG. 36 becomes a characteristic as indicated by the solid line in FIG. 37. However, it is corrected by the above-mentioned gradation characteristic, whereby the linear spectral sensitivity characteristic indicated by the dashed line in FIG. 37 can be provided.
The correction will be discussed in more detail. FIG. 38 shows the gradation characteristic of the image pickup machine 6 measured by the measurement method previously described in the fifteenth embodiment. FIG. 39 shows the spectral sensitivity characteristic of the image pickup machine 6 measured by the measurement method previously described in the sixteenth embodiment. The input/output characteristic of the image pickup machine is nonlinear and the corrected linear characteristic is indicated by dashed line D in FIG. 38. Spectral sensitivity measurement is made using output data of the image pickup machine 6 and thus is affected by the gradation characteristic of the image pickup machine 6. Then, to find a linear spectral sensitivity characteristic of the image pickup machine 6 with the excluded effect of the gradation characteristic thereof, the following correction needs to be made:
Gradation characteristic of the image pickup machine 6 shown in FIG. 38, Yc, is represented by the following expression:

Yc=fc(Li)  (7)

where c: R, G, B

fc(Li): Function of line indicated by solid line in FIG. 38
Li: Luminance of color chart at imaging time Letting the measured spectral sensitivity characteristic in FIG. 39 be Sc(λ), linear spectral sensitivity characteristic with the excluded effect of the gradation characteristic of the image pickup machine, Sc′(λ), is found by the following expression:

Sc′(λ)=fc−1(Sc(λ))  (8)

where c: R, G, B

Thus, a correction is made to each of R, G, and B image data provided in the sixteenth embodiment as indicated in the following expression:

Sc′(λ)=kfc−1(X′λ−X′0)  (9)

where k: Coefficient to set the maximum value of Sc(λ) to 100%

X′0: Image data value of color chart having the lowest luminance value provided in the fifteenth embodiment
The linear spectral sensitivity characteristic Sc′(λ) is provided by making the correction according to the expression (9).
To use the spectral sensitivity characteristic for color management of color space conversion, etc., it is assumed that the addition law in color metrology is true as a rule. Thus, the advantage in that the linear characteristic is provided as described above is large.
If the correction is made to the first data provided by the method of the twelfth embodiment, the linear spectral sensitivity characteristic of the image pickup machine 6 can be found; if the correction is made to the second data, the linear color characteristic of a system also containing application software can be found.
In the embodiment, the gradation characteristic measured with color chart 2C inserted (fifteenth embodiment) has been described, but the seventeenth embodiment is also applied to the gradation characteristic measured with the output light quantity of light output section 4 changed (fourteenth embodiment).
Measuring the precise spectral sensitivity characteristic of the image pickup machine requires that the light quantity of the spectral light source be constant and that the gradation characteristic of the image pickup machine be linear. Thus, gradation characteristic correction is made and if the light quantity for the spectrum wavelength is not constant, a similar correction is made using the light quantity characteristic relative to the wavelength, whereby the precise spectral sensitivity characteristic of the image pickup machine can be found.
Eighteenth Embodiment
The above-described color characteristic measurement apparatus can be used to find the gradation characteristic and spectral sensitivity characteristic of an image pickup machine 6 by the color characteristic measurement method of any of the twelfth to seventeenth embodiments.
Then, the gradation and spectral sensitivity characteristics are provided in a one-to-one correspondence with the image pickup machines 6 and are managed, whereby if the image pickup machines 6 are machines stable in aging, for example, good use of the gradation and spectral sensitivity characteristics can be made without measuring the color characteristic of each image pickup machine each time a photograph is taken.
To connect the image pickup machine 6 to any other machine to form a system, highly accurate color management in the system is enabled because the gradation and spectral sensitivity characteristics are obvious.
It is described that the gradation and spectral sensitivity characteristics are provided in a one-to-one correspondence with the image pickup machines 6 and are managed. However, if data provided by performing operation on from the gradation characteristic, such as setup level, gamma correction characteristic, and knee-point, and data provided by performing operation on the spectral sensitivity characteristic, such as wavelength at which sensitivity becomes the maximum, half-value wavelength width, and matrix coefficient for conversion to general color space such as XYZ color system, are provided in a one-to-one correspondence with the image pickup machines 6 and are managed in place of or together with the gradation and spectral sensitivity characteristics, it may be advantageous in the point of the data amount or the computation time of the apparatus for receiving an image from the image pickup machine 6 and processing the image; the main purpose and advantages are similar to those described above.
Nineteenth Embodiment
Next, FIG. 41 shows the data formats for adding the gradation and spectral sensitivity characteristics of an image pickup machine 6 to image data picked up by the image pickup machine 6.
In FIG. 41, the data format in Example 1 comprises the gradation characteristic added to image data; the data format in Example 2 comprises the spectral sensitivity characteristic added to image data; and the data format in Example 3 comprises the gradation and spectral sensitivity characteristics added to image data.
By using such a data format, what gradation characteristic or spectral sensitivity characteristic the image pickup machine picking up the provided image data has becomes obvious; highly accurate color management is enabled for each image data.
In the nineteenth embodiment, the data format examples for adding both or either of the gradation and spectral sensitivity characteristics to image data are shown. However, as previously described in the eighteenth embodiment, if data provided by performing operation on the gradation characteristic and data provided by performing operation on the spectral sensitivity characteristic are added in place of or together with the gradation and spectral sensitivity characteristics, it may be advantageous in the point of the data amount or the computation time of the apparatus for receiving an image from the image pickup machine 6 and processing the image; the main purpose and advantages are similar to those described above.
In the nineteenth embodiment, the data format examples for adding each characteristic to the top of image data are shown. However, a similar advantage is provided regardless of where the added characteristic is placed in the image data, needless to say.
Twentieth Embodiment
FIG. 42 is a block diagram to show a configuration example of a color characteristic measurement apparatus of a twelfth embodiment of the invention. In the figure, numeral 18 denotes a storage unit installed in an image pickup machine 6.
The storage unit 18 stores the gradation characteristic or spectral sensitivity characteristic of the image pickup machine 6 found using the color characteristic measurement apparatus by the above-described measurement method. According to such a configuration, the correspondence between the image pickup machines 6 and each characteristic previously described in the eighteenth embodiment becomes clearer and in addition, the data in the nineteenth embodiment can also be prepared easily.
A similar advantage is provided regardless of the type of storage unit 18, such as semiconductor memory, a magnetic disk unit, or an optical disk unit.
Twenty-First Embodiment
Let the spectral sensitivity characteristic of an image pickup machine having n channels (n is a natural number) found using the above-described color characteristic measurement apparatus by the above-described measurement method be Cn(λ). FIG. 43 shows Cn(λ) (n=1, 2, 3 corresponding to R, G, B respectively) of the image pickup machine having three channels of R, G, and B. Let the spectral distribution characteristic of an illumination light source when a subject is imaged by the image pickup machine be L(λ) as shown in FIG. 44.
The color characteristic of the image pickup machine 6 can be shown by the spectral sensitivity characteristic Cn(λ) (n=1, 2, 3) and the spectral distribution characteristic of the illumination light source, L(λ). The characteristic data is added to image data or image data is related to the characteristic data, whereby color management can be executed with the image data provided in a one-to-one correspondence with the color characteristics of the image pickup machines picking up the image data.
Further, color management of color space conversion, etc., can be executed according to the spectral characteristics of three channels provided by multiplying Cn(λ) by L(λ).
In the twenty-first embodiment, the color management method according to the spectral characteristic is described. However, if color management is executed according to data provided by performing operation on the spectral characteristic, such as wavelength at which the spectral characteristic value becomes the maximum, half-value wavelength width, and matrix coefficient for conversion to general color space such as XYZ color system, the main purpose and advantages are similar to those described above.
In the twenty-first embodiment, the image pickup machine having three color channels is described, but a similar advantage is provided if the number of color channels is changed. That is, with the image pickup machine having n color channels, n+1 characteristic data pieces consisting of spectral sensitivity characteristic C1(λ) to Cn(λ) and the spectral distribution characteristic of the illumination light source, L(X), are provided and n characteristic data pieces are provided by multiplying Cn(λ) by L(λ).
Twenty-Second Embodiment
In a twenty-second embodiment of the invention, a method of compensating for the difference between the gradation characteristic of an image pickup machine and that of an image output unit and the data format of an image file will be discussed.
FIG. 45A is a drawing to show a configuration example of a system for outputting image data picked up by an image pickup machine 6 to an image output unit 20. FIGS. 45A and 45B are drawings to show examples of y characteristics of the image output unit 20 and the image pickup machine 6 respectively.
The data of an image picked up by the image pickup machine 6 is transferred to the image output unit 20 as an image file for each image in serial/parallel communication over a cable 21 directly connecting the image pickup machine 6 and the image output unit 20 or via infrared communication 22, a storage medium 23, or the like.
The gradation characteristic of the image pickup machine 6 can be represented by γ coefficient γc as in the following expression:

Sout=(Lin)1/γc  (10)

where Sout is a signal level output from the image pickup machine 6 and Lin is a luminance level of a subject. The gradation characteristic of the image output unit 20 can be represented by γ coefficient γD as in the following expression:

Lout=(Sin)γD  (11)

where Lout is light emission luminance and Sin is an input signal level to the image output unit 20.

For the gradation characteristic of a subject and that of an output image of the image output unit 20 to match, namely, to set Lin=Lout, the γ coefficient γc of the image pickup machine 6 needs to equal the γ coefficient γD of the image output unit 20. Thus, when γc≠γD, if k·γc is set equal to γD by multiplying γc by coefficient k, Lin=Lout results. The coefficient k is added to the image data provided by the image pickup machine 6. FIG. 46 shows data format examples of image files. The data format in Example 1 comprises the coefficient k added to the top of image data. The data format in Example 2 comprises the coefficient k and the gradation characteristic of the image pickup machine 6 preceding the top of image data. Using such image data, the gradation characteristic difference between the image pickup machine 6 and the image output unit 20 can be compensated on a personal computer, etc., for example.
The data formats shown in FIG. 46 are examples and a similar effect is provided if the coefficient k is added to any part of image data, needless to say.
In the embodiment, a personal computer system containing a monitor is shown an example of the image output unit 20 in FIG. 45. However, the embodiment is also applied if the image output unit 20 is a printer, a projector, etc., rather than the monitor.
The gradation characteristic of the image pickup machine 6 can be found by the gradation characteristic measurement method previously described in the fourteenth or fifteenth embodiment. Using the gradation characteristic measured by the method described in the fourteenth or fifteenth embodiment, the precise coefficient k can be calculated and the gradation characteristic difference between the image pickup machine 6 and the image output unit 20 can be eliminated.
Twenty-Third Embodiment
In a twenty-third embodiment of the invention, a method of compensating for a color reproduction error and the image file data formats will be discussed.
FIG. 45 is a drawing to show that a subject is imaged by image pickup machine 6 as previously mentioned in the twenty-second embodiment. Assume that the image pickup machine 6 has an image pickup characteristic fitted to the color space of image output unit 20; for example, if the image output unit 20 is an NTSC monitor, the image pickup machine 6 has NTSC image pickup characteristic or if the image output unit 20 has an sRGB space, the image pickup machine 6 has an image pickup characteristic fitted to the sRGB space. A color chart of a known spectral distribution characteristic ρ(λ) is placed on a test chart 1. If an illumination light source 5 is reference white defined in the sRGB space, the signals of the color chart provided from the image pickup machine 6 are Rs, Gs, and Bs.
The signals of the color chart, Rc, Gc, and Bc, provided under illumination of spectral distribution characteristic L(λ) by the image pickup machine 6 having spectral distribution characteristic R(λ), G(λ), B(λ) are represented by the following expressions:

Rc=∫ρ(λ)×R(λ)×L(λ)dλ  (12)

Gc=∫ρ(λ)×G(λ)×L(λ)dλ  (13)

Bc=∫ρ(λ)×B(λ)×L(λ)dλ  (14)

In all color charts on the subject, if

Rs=Rc  (15)

Gs=Gc  (16)

Bs=Bc  (17)

are true, no error is included. If they are not true, a color reproducibility error occurs. To remove this error, the following 3×3 matrix coefficients 



  
    
      
        
          (
          
            
              
                Rs
              
            
            
              
                Gs
              
            
            
              
                Bs
              
            
          
          )
        
        =
        
          
            (
            
              
                
                  a11
                
                
                  a12
                
                
                  a13
                
              
              
                
                  a21
                
                
                  a22
                
                
                  a23
                
              
              
                
                  a31
                
                
                  a32
                
                
                  a33
                
              
            
            )
          
          ⁢
          
            (
            
              
                
                  Rc
                
              
              
                
                  Gc
                
              
              
                
                  Bc
                
              
            
            )
          
        
      
    
    
      
        (
        18
        )
      
    
  




may be determined. These coefficients can be found by at least three types of typical color charts. The nine matrix coefficients of all to a33 are added to the image data provided by the image pickup machine 6. FIG. 47 shows data format examples of image files. The data format in Example 1 comprises the matrix coefficients added to the top of image data. The data format in Example 2 comprises the matrix coefficients and the spectral sensitivity characteristic of the image pickup machine 6 preceding the top of image data. The nine matrix coefficients of a11 to a33 are added to image file, whereby a color reproduction error can be compensated on a personal computer, etc., for example.

The data formats shown in FIG. 47 are examples and a similar effect is provided if the matrix coefficients are added to any part of image data, needless to say.
The spectral sensitivity characteristic of the image pickup machine 6 can be measured by the measurement method previously described in the sixteenth embodiment. Using the spectral sensitivity characteristic corrected by the method described in the seventeenth or eighteenth embodiment, the precise matrix coefficients can be calculated and the color reproducibility error can be eliminated.
If the spectral distribution characteristic of a light source, L(λ), is a characteristic estimated from the light source type, correlated color temperature, etc., there is no problem on practical use. In this case, however, the standard spectral distribution characteristic corresponding to the light source type needs to be obvious, and a spectral distribution characteristic involving no problem on practical use is found by correcting the standard spectral distribution characteristic according to the correlated color temperature. Resultantly, for the spectral distribution characteristic of a light source, L(λ), highly accurate color management can be easily realized with less information.

## Claims

1. A storage medium storing information for accurately reproducing an image, said information comprising:
image data provided by an image pickup machine, and 
a gradation characteristic of the image pickup machine, a spectral sensitivity characteristic of the image pickup machine or data calculated based on the gradation characteristic or the spectral sensitivity characteristic of the image pickup machine, the gradation characteristic or the spectral sensitivity characteristic having been generated using a color characteristic measurement apparatus of an image pickup machine, comprising: 
a test chart as a subject to which applied light is applied from a front side; 
a black box being placed on a rear face of said test chart and formed on an inner surface in black; 
holes being made in said test chart and said black box; and 
a light output section being placed in said black box at a position where said light output section can be observed through said holes from the front of said test chart.

2. The storage medium according to claim 1, wherein the color characteristic measurement apparatus of an image pickup further comprises: means for changing a light quantity of light emitted from said light output.

3. The storage medium according to claim 1, wherein one color chart or a plurality of color charts different in reflectivity are placed on said test chart.

4. The storage medium according to claim 2, wherein the stored characteristic information is generated by:
placing a color characteristic measurement apparatus as set forth in claim 2 and a first illumination light source so that light applied from the first illumination light source is not applied to a light output section in a black box; 
changing the light quantity of light emitted through a hole in a test chart of the color characteristic measurement apparatus; 
imaging the test chart by the image pickup machine, and 
finding a gradation characteristic of the image pickup machine based on first data corresponding to the area of the light output section, extracted from picked up image data or second data provided by performing operation on the first data.

5. The storage medium according to claim 1, wherein the stored characteristic information is generated by:
placing a color characteristic measurement apparatus as set forth in claim 1 and a first illumination light source so that light applied from the first illumination light source is not applied to a light output section in a black box; 
changing the wavelength of a spectrum emitted through a hole in a test chart of the color characteristic measurement apparatus; 
imaging the test chart by the image pickup machine, and 
finding a spectral sensitivity characteristic of the image pickup machine based on first data corresponding to the area of the light output section, extracted from picked up image data or second data provided by performing operation on the first data.

6. The storage medium according to claim 3, wherein the stored characteristic information is generated by a method in which N color charts different in reflectivity (N is an integer of 2 or more) are placed on a test chart, to change the light quantity of emitted light, pick up images in sequence by an image pickup machine, and find a gradation characteristic of the image pickup machine, the stored characteristic information being generated by a method comprising the steps of:
adopting a first image picked up when the emitted light is of a specific light quantity as a reference image; 
adopting a part corresponding to an area of a light output section in a second image picked up when the emitted light is of any other light quantity as first data; 
finding a first color chart of the N color charts with data in the second image greater than and closest to the first data; 
finding a second color chart of the N color charts with data in the second image smaller than and closest to the first data; 
correcting the first data based on data of the parts corresponding to the first and second color charts in the first and second images to find second data; and 
finding the gradation characteristic of the image pickup machine from the second data at each image picking up time.

7. The storage medium according to claim 3, wherein the stored characteristic information is generated by a method in which N color charts different in reflectivity (N is an integer of 2 or more) are placed on a test chart, to insert the color charts into a hole in the test chart one at a time in order, pick up an image for each color chart by an image pickup machine, and find a gradation characteristic of the image pickup machine, the characteristic information being generated using a method comprising the steps of:
adopting a first image picked up when a specific color chart is inserted into the hole as a reference image; 
in a second image picked up when any other color chart is inserted into the hole, adopting a part corresponding to an area of the inserted color chart as first data; 
finding a first color chart of the N color charts with data in the second image greater than and closest to the first data; 
finding a second color chart of the N color charts with data in the second image smaller than and closest to the first data; 
correcting the first data based on data of the parts corresponding to the first and second color charts in the first and second images to find second data; and 
finding the gradation characteristic of the image pickup machine from the second data at each image picking up time.

8. A storage medium storing information for accurately reproducing an image, said information comprising:
image data provided by an image pickup machine having n color channels (n is a natural number), and 
n+1 types of characteristics including n types of spectral sensitivity characteristics of the image pickup machine and a spectral distribution characteristic of an illumination light source at photograph taking time, or n types of characteristics provided by multiplying each of said n types of spectral sensitivity characteristics of the image pickup machine by the spectral distribution characteristic of the illumination light source for each wavelength, or data provided by performing an operation on the characteristics, said characteristics having been generated using a color characteristic measurement apparatus of an image pickup machine, comprising: 
a test chart as a subject to which applied light is applied from a front side; 
a black box being placed on a rear face of said test chart and formed on an inner surface in black; 
holes being made in said test chart and said black box; and 
a light output section being placed in said black box at a position where said light output section can be observed through said holes from the front of said test chart.

9. The storage medium according to claim 8, wherein the stored characteristic information is generated by:
placing a color characteristic measurement apparatus as set forth in claim 8 and a first illumination light source so that light applied from the first illumination light source is not applied to a light output section in a black box; 
changing the wavelength of a spectrum emitted through a hole in a test chart of the color characteristic measurement apparatus; 
imaging the test chart by the image pickup machine, and 
finding a spectral sensitivity characteristic of the image pickup machine based on first data corresponding to the area of the light output section, extracted from picked up image data or second data provided by performing operation on the first data.

10. A storage medium storing information for accurately reproducing an image, said information comprising:
image data picked up by an image pickup machine, and 
a multiplication factor for transforming a γ coefficient representing a gradation characteristic of the image pickup machine into a γ coefficient of an image output unit to output the image data, the multiplication factor having been generated using a color characteristic measurement apparatus of an image pickup machine, comprising: 
a test chart as a subject to which applied light is applied from a front side; 
a black box being placed on a rear face of said test chart and formed on an inner surface in black; 
holes being made in said test chart and said black box; and 
light output section being placed in said black box at a position where said light output section can be observed through said holes from the front of said test chart.

11. The storage medium according to claim 10, wherein the color characteristic measurement apparatus of an_image pickup machine further comprises: means for changing a light quantity of light emitted from said light output.

12. The storage medium according to claim 10, wherein one color chart or a plurality of color charts different in reflectivity are placed on said test chart to generate the multiplication factor.

13. The storage medium according to claim 11, wherein characteristic information for calculating the multiplication factor is generated by:
placing a color characteristic measurement apparatus as set forth in claim 11 and a first illumination light source so that light applied from the first illumination light source is not applied to a light output section in a black box; 
changing the light quantity of light emitted through a hole in a test chart of the color characteristic measurement apparatus; 
imaging the test chart by the image pickup machine, and 
finding a gradation characteristic of the image pickup machine based on first data corresponding to the area of the light output section, extracted from picked up image data or second data provided by performing operation on the first data.

14. The storage medium according to claim 12, wherein characteristic information for calculating the multiplication factor is generated using a method in which N color charts different in reflectivity (N is an integer of 2 or more) are placed on a test chart, to change the light quantity of emitted light, pick up images in sequence by an image pickup machine, and find a gradation characteristic of the image pickup machine, the method comprising the steps of:
adopting a first image picked up when the emitted light is of a specific light quantity as a reference image; 
adopting a part corresponding to an area of a light output section in a second image picked up when the emitted light is of any other light quantity as first data; 
finding a first color chart of the N color charts with data in the second image greater than and closest to the first data; 
finding a second color chart of the N color charts with data in the second image smaller than and closest to the first data; 
correcting the first data based on data of the parts corresponding to the first and second color charts in the first and second images to find second data; and 
finding the gradation characteristic of the image pickup machine from the second data at each image picking up time.

15. The storage medium according to claim 12, wherein characteristic information for calculating the multiplication factor is generated using a method in which N color charts different in reflectivity (N is an integer of 2 or more) are placed on a test chart, to insert the color charts into a hole in the test chart one at a time in order, pick up an image for each color chart by an image pickup machine, and find a gradation characteristic of the image pickup machine, the method comprising the steps of:
adopting a first image picked up when a specific color chart is inserted into the hole as a reference image; 
in a second image picked up when any other color chart is inserted into the hole, adopting a part corresponding to an area of the inserted color chart as first data; 
finding a first color chart of the N color charts with data in the second image greater than and closest to the first data; 
finding a second color chart of the N color charts with data in the second image smaller than and closest to the first data; 
correcting the first data based on data of the parts corresponding to the first and second color charts in the first and second images to find second data; and 
finding the gradation characteristic of the image pickup machine from the second data at each image picking up time.

16. A storage medium storing information for accurately reproducing an image, said information comprising:
image data picked up by an image pickup machine, and 
a matrix coefficient calculated based on spectral sensitivity characteristic information of the image pickup machine, the spectral sensitivity characteristic information having been generated using a color characteristic measurement apparatus of an image pickup machine, comprising: 
a test chart as a subject to which applied light is applied from a front side; 
a black box being placed on a rear face of said test chart and formed on an inner surface in black; 
holes being made in said test chart and said black box; and 
a light output section being placed in said black box at a position where said light output section can be observed through said holes from the front of said test chart.