Source: http://www.google.com/patents/US20030058466?dq=U.S.+patent+number+7,325,728
Timestamp: 2016-07-30 09:15:12
Document Index: 530789639

Matched Legal Cases: ['art 103', 'art 203', 'art 303', 'art 103', 'art 103', 'art 103', 'art 103', 'art 203', 'art 203', 'art 203', 'art 103', 'art 303', 'art 303', 'art 203', 'art 303', 'art 203', 'art 303', 'art 303']

Patent US20030058466 - Signal processing unit - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsThe invention achieves giving high color reproducibility to a color signal with reliability without substantially increasing circuit scale. A signal processing unit of the invention includes a color transformation part which multiplies an inputted color signal by a transformation matrix and an element...http://www.google.com/patents/US20030058466?utm_source=gb-gplus-sharePatent US20030058466 - Signal processing unitAdvanced Patent SearchPublication numberUS20030058466 A1Publication typeApplicationApplication numberUS 10/242,356Publication dateMar 27, 2003Filing dateSep 13, 2002Priority dateSep 21, 2001Also published asUS7586640Publication number10242356, 242356, US 2003/0058466 A1, US 2003/058466 A1, US 20030058466 A1, US 20030058466A1, US 2003058466 A1, US 2003058466A1, US-A1-20030058466, US-A1-2003058466, US2003/0058466A1, US2003/058466A1, US20030058466 A1, US20030058466A1, US2003058466 A1, US2003058466A1InventorsHideo HoshuyamaOriginal AssigneeNikon CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (29), Referenced by (31), Classifications (13), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetSignal processing unit
US 20030058466 A1Abstract
The invention achieves giving high color reproducibility to a color signal with reliability without substantially increasing circuit scale. A signal processing unit of the invention includes a color transformation part which multiplies an inputted color signal by a transformation matrix and an element setting part setting an element group of the transformation matrix according to every inputted color signal. The element setting part comprises an identification unit identifying a color of the color signal, a storage unit storing in advance optimum element groups for a predetermined number of reference signals, and an interpolation unit. The interpolation unit performs interpolation computing based on the input signal, two optimum element groups for two of the reference signals of colors close to a color of the color signal, and color relation between the color signal and the two reference signals to determine an element group to be set. Images(12) Claims(12)
What is claimed is: 1. A signal processing unit comprising: a color transformation part for performing color transformation processing on an inputted color signal by multiplying the color signal by a transformation matrix; and an element setting part setting, every time a color signal is inputted, an element group of the transformation matrix according to the inputted color signal, wherein said element setting part comprises: an identification unit for identifying a color of the inputted color signal; a storage unit storing in advance an optimum element group for each of a predetermined number of color reference signals; and an interpolation unit for recognizing optimum element groups for two of the color reference signals of colors close to the color of the inputted color signal, in reference with said storage unit according to a result of the identification, and for performing interpolation computing based on a color relation between the inputted color signal and the two color reference signals and on the recognized optimum element groups, and for determining the element group to be set. 2. The signal processing unit according to claim 1, wherein: said storage unit has a lookup table; and an argument of the lookup table represents a color range to which the color signal belongs and a function of the lookup table represents optimum element groups for the two color reference signals located on borders of the color range. 3. The signal processing unit according to claim 1, wherein said element setting part uses hue as a physical value indicating the color of the inputted color signal. 4. The signal processing unit according to claim 2, wherein said element setting part uses hue as a physical value indicating the color of the inputted color signal. 5. The signal processing unit according to claim 3, wherein said element setting part arranges the predetermined number of color reference signals with uneven intervals in a hue space. 6. The signal processing unit according to claim 4, wherein said element setting part arranges the predetermined number of color reference signals with uneven intervals in a hue space. 7. A signal processing unit comprising: a brightness correction part for performing brightness correction processing on an inputted color signal; and a correction value setting part setting, every time a color signal is inputted, a correction value of the brightness correction processing according to the inputted color signal, wherein said correction value setting part comprises: an identification unit for identifying a color of the inputted color signal; a storage unit storing in advance an optimum correction value for each of a predetermined number of color reference signals; and an interpolation unit for recognizing optimum correction values for two of the color reference signals of colors close to a color of the inputted color signal, in reference with said storage unit according to a result of the identification, and for performing interpolation computing based on a color relation between the color signal and the two color reference signals and on the recognized optimum correction values, and for determining the correction value to be set. 8. The signal processing unit according to claim 7, wherein: said storage unit has a lookup table; and an argument of the lookup table represents a color range to which the color signal belongs, and a function of the lookup table represents the optimum correction values for the two color reference signals located on borders of the color range. 9. The signal processing unit according to claim 7, wherein said correction value setting part uses hue as a physical value indicating the color of the inputted color signal. 10. The signal processing unit according to claim 8, wherein said correction value setting part uses hue as a physical value indicating the color of the inputted color signal. 11. The signal processing unit according to claim 9, wherein said correction value setting part arranges the predetermined number of color reference signals with uneven intervals in a hue space. 12. The signal processing unit according to claim 10, wherein said correction value setting part arranges the predetermined number of color reference signals with uneven intervals in a hue space. Description
BACKGROUND OF THE INVENTION [0001] 1. Field of the Invention [0002] The present invention relates to a signal processing unit applied to a color image device such as an electronic camera, a video camera, a scanner, and a printer, and more particularly, to a signal processing unit for performing color transformation processing or brightness correction processing on each color signal obtained by the color image device. [0003] 2. Description of the Related Art [0004] A color transformation circuit is generally mounted on a color image device in order to give a good color reproducibility to a color signal. The color transformation circuit performs color transformation processing on the color signal according to an input/output characteristic peculiar to the color image device. [0005] Note that the word ‘color’ is used in this specification to mean information consisting of hue, brightness, and chroma. [0006] Incidentally, some of the color transformation circuits perform color system transformation of image data as well as color correction. [0007] The color transformation circuits are mainly classified into a lookup table circuit often used in scanners, printers, and the like and a color matrix circuit often used in electronic cameras, video cameras, and the like. [0008] The lookup table circuit stores color signals (R′, G′, B′) which are obtained after color signals (R, G, B) for respective colors are transformed. The lookup table circuit is able to perform not only linear color transformation processing (=first-order color transformation processing) but also nonlinear color transformation processing (=high-order color transformation processing) and is able to set a characteristic curve (color transformation characteristic curve) of the color transformation processing to an optimum one according to the input/output characteristic peculiar to the color image device. [0009] Therefore, the lookup table circuit gives a high color reproducibility to the color signal so that images on a reproduced image are expressed with optimum colors. The lookup table circuit, however, has a disadvantage that it has a large circuit scale due to a large amount of information stored therein. [0010] On the other hand, the color matrix circuit stores a transformation expression (generally, a first-order transformation matrix of 3�3) common to the color signals (R, G, B) for the respective colors. Therefore, the color matrix circuit is able to perform only the linear color transformation processing so that the color transformation characteristic curve can be set to an approximate line, but not to an optimum curve. [0011] Hence, the color matrix circuit cannot give the high color reproducibility to the color signal so that images on a reproduced image are not always expressed with the optimum colors. The color matrix circuit, however, has an advantage that its circuit scale is small owing to small amount of information stored therein and its simple arithmetic operation. [0012] It is possible to set the color transformation characteristic curve to a quadratic curve or a cubic curve by increasing the order of the color transformation processing of the color matrix circuit. The size of the transformation matrix, however, will become ‘3�9’ when the order of the color transformation processing is increased by, for example, one in order to set its color transformation characteristic curve to the quadratic curve. In addition, in this case generation of vectors (R2, G2, B2, RG, GB, BR, R, G, B) increases the necessary number of times of multiplications/divisions by as many as ‘24’ times. Accordingly, to set the color transformation characteristic curve to a high-order curve such as the cubic curve and a quartic curve by using the color matrix circuit, the circuit scale has to be greatly increased. [0013] To solve these problems, a color matrix circuit as disclosed in, for example, Japanese Unexamined Patent Publication Application Nos. Hei 6-6587 and Hei 5-300367 has been conventionally proposed. [0014] In this color matrix circuit, the order of the color transformation processing is ‘1’, but a plurality of element groups of the transformation matrix is prepared in advance. In the color matrix circuit, any of the element groups is selectively used in conformity with to a color range to which a color signal to be transformed belongs. This enables the color transformation characteristic curve to be a stair-shaped line. In other words, in this color matrix circuit the color transformation characteristic curve can approximate to the optimum with reduction in its circuit scale. [0015] According to this color matrix circuit, however, a contour which does not exist in an actual image (a pseudo-contour) and noise may occur on a reproduced image. The reason is as follows. [0016] In general, color change in a certain image is often continuous. If the image belongs to two different color ranges, however, this color matrix circuit performs two different color transformation processings between on a part of the image belonging to one of the two color ranges and on the other part of the image belonging to the other color range. As a result, originally continuous color change in the image becomes discontinuous in the reproduced image. [0017] This problem is not solved even when the number of the element groups prepared in the color matrix circuit is increased. This is because the increase in the number of the element groups increases the number of steps of the color transformation characteristic curve (here, a stair-shaped line), but a level difference between steps still remains. [0018] According to the color matrix circuit in Japanese Unexamined Patent Publication Application No. Hei 6-6587, this level difference among the steps of the color transformation characteristic curve is reduced so that the occurrence of the pseudo-contour can be prevented, but this color matrix circuit may possibly lower the color reproducibility of a certain color image device. [0019] For example, in a color image device using a CCD image sensor for complementary colors, a ‘steeply changing curve’ is the optimum color transformation characteristic curve. In this case, the reduction in the level difference among the steps of the color transformation characteristic curve will result in divergence from the optimum one. SUMMARY OF THE INVENTION [0020] In view of the above, it is an object of the present invention to provide a signal processing unit which can surely give high color reproducibility to a color signal without any great increase in its circuit scale. [0021] In order to attain this object, a signal processing unit of the present invention comprises: a color transformation part which performs color transformation processing on an inputted color signal by multiplying the color signal by a transformation matrix; and an element setting part which sets, every time a color signal is inputted, an element group of the transformation matrix according to the color signal. The element setting part comprises: an identification unit which identifies a color of the inputted color signal; a storage unit which stores in advance an optimum element group for each of a predetermined number of color reference signals, and an interpolation unit. The interpolation unit recognizes optimum element groups for two of the color reference signals of colors close to a color of the inputted color signal, referring to the storage unit according to an identification result, and performs interpolation computing based on a color relation between the inputted color signal and the two color reference signals and on the optimum element groups for the two color reference signals to determine the aforesaid element group to be set. [0022] A color transformation characteristic curve can approximate to optimum by this interpolation computing. In other words, the color signal is surely given high color reproducibility without substantial increase in the circuit scale. [0023] Preferably, in the signal processing unit, the storage unit has a lookup table in which an argument of the lookup table indicates a color range to which the color signal belongs and a function of the lookup table indicates optimum element groups for the two color reference signals located on borders of the color range. Further, in the signal processing unit, the element setting part preferably uses hue as a physical value indicating the aforesaid color. It is preferable that in the signal processing unit, the element setting part arranges the predetermined number of the color reference signals with uneven intervals in a hue space. [0024] Further, in order to attain the above-described object, a signal processing unit of the present invention comprises: a brightness correction part which performs brightness correction processing on an inputted color signal; and a correction value setting part which sets, every time a color signal is inputted, a correction value of the brightness correction processing according to the color signal. The correction value setting part comprises; an identification unit which identifies a color of the inputted color signal; a storage unit which stores in advance optimum correction values for a predetermined number of color reference signals, and an interpolation unit. The interpolation unit recognizes optimum correction values for two of the color reference signals of colors close to a color of the inputted color signal, referring to the storage unit according to a result of the identification, and performs interpolation computing based on a color relation between the inputted color signal and the two color reference signals and on the optimum correction values of the two color reference signals to determine the aforesaid correction value to be set. [0025] This allows a brightness correction characteristic curve to approximate to optimum. In other words, the color signal is surely given high color reproducibility without any great increase in the circuit scale. [0026] Preferably, in the signal processing unit, the storage unit has a lookup table in which an argument of the lookup table represents a color range to which the color signal belongs, and a function of the lookup table represents the optimum correction values for the two color reference signals located on borders of the color range. [0027] Further, in the signal processing unit, the correction value setting part preferably uses hue as a physical value indicating the aforesaid color. It is also preferable that in the signal processing unit, the correction value setting part arranges the predetermined number of color reference signals with uneven intervals in a hue space. [0028] According to the present invention described above, a signal processing unit which can surely give high color reproducibility to a color signal is realized without any great increase in its circuit scale.
BRIEF DESCRIPTION OF THE DRAWINGS [0029] The nature, principle, and utility of the invention will become more apparent from the following detailed description when read in conjunction with the accompanying drawings in which like parts are designated by identical reference numbers, in which: [0030] [0030]FIG. 1 is a circuit block diagram inside an electronic camera of a first embodiment; [0031] [0031]FIG. 2 is a circuit block diagram inside a color matrix circuit 29G; [0032] [0032]FIG. 3 is a circuit block diagram inside a parameter generating part 103; [0033] [0033]FIG. 4 is a view showing hues of respective color reference signals in a hue space and optimum element groups of the respective color reference signals; [0034] [0034]FIG. 5 is a view showing the contents of a lookup table 155; [0035] [0035]FIG. 6(a), FIG. 6(b), and FIG. 6(c) are views explaining interpolation computing by an interpolation circuit 158; [0036] [0036]FIG. 7 is a circuit block diagram inside a color matrix circuit 200; [0037] [0037]FIG. 8 is a circuit block diagram inside a parameter generating part 203; [0038] [0038]FIG. 9 is a view showing hues of respective color reference signals in a hue space and optimum element groups and optimum correction values of the respective color reference signals; [0039] [0039]FIG. 10 is a view showing the contents of a lookup table 255; and [0040] [0040]FIG. 11 is a circuit block diagram inside a parameter generating part 303.
DESCRIPTION OF THE PREFERRED EMBODIMENTS [0041] Embodiments of the present invention will be explained hereunder with reference to the drawings. [0042] <First Embodiment>
[0043] A first embodiment of the present invention will be explained with reference to FIG. 1, FIG. 2, FIG. 3, FIG. 4, FIG. 5, and FIG. 6. [0044] The inventor of the present invention has used a color matrix circuit in order to prevent a great increase in its circuit scale and prepared plural element groups for the color matrix circuit. [0045] The inventor of the present invention has thought of setting a color transformation characteristic curve not to be ‘a stair-shaped line’ but to be ‘a polygonal line’ through the use of this color matrix circuit. [0046] When the curve is a polygonal line, a pseudo-contour and noise occurring on a reproduced image are prevented. Moreover, the color transformation characteristic curve can approximate to optimum. [0047] Note that a signal processing unit of the present invention in a case when it is mounted inside an electronic camera as a part of its circuit will be explained in this embodiment. [0048] [0048]FIG. 1 is a circuit block diagram inside the electronic camera of this embodiment. [0049] The electronic camera is provided with a CPU 21, a CCD image sensor 26, a driver circuit 25, an analog signal processing circuit 27, an A-D converter 28, a signal processing circuit 29 (for example, constituted as ASIC), and so on. [0050] The driver circuit 25 drives the CCD image sensor 26 and the CCD image sensor 26 picks up an image of a photographic subject. Further, the analog signal processing circuit 27, the A-D converter 28, the signal processing circuit 29, and so on perform respective processings on a signal outputted from the CCD image sensor 26. [0051] The signal processing circuit 29 is provided with a defect correction circuit 29A, a digital clamp circuit 29B, a gain adjustment circuit 29C, a white balance adjustment circuit 29D, a γ correction circuit 29E, a color interpolation circuit 29F, and a color matrix circuit 29G (corresponding to a signal processing unit and a color transformation part in claims). [0052] The driver circuit 25, the analog signal processing circuit 27, and the A-D converter 28 are controlled by the CPU 21 via a timing generator 24. Further, the white balance adjustment circuit 29D, the γ correction circuit 29E, the color interpolation circuit 29F, and the color matrix circuit 29G inside the signal processing circuit 29 are also controlled by the CPU 21. [0053] The color signal outputted from the CCD image sensor 26 is converted to a digital signal via the analog signal processing circuit 27 and the A-D converter 28 and inputted to the signal processing circuit 29. [0054] The defect correction circuit 29A inside the signal processing circuit 29 generates a color signal corresponding to a defective color of the CCD image sensor 26 based on the color signal outputted by the A-D converter 28. [0055] Each color signal undergoes DC reproduction processing in the digital clamp circuit 29B, color (white level) balance adjustment in the white balance adjustment circuit 29D, predetermined tone conversion processing according to the characteristic of a monitor (an exterior or an interior monitor of the electronic camera) in the γ correction circuit 29E, color interpolation processing in the color interpolation circuit 29F, and color transformation processing (to be detailed later) in the color matrix circuit 29G. [0056] It should be noted that each of the above-described processing in the signal processing circuit 29 of this embodiment is not necessarily performed in the order mentioned above. But, at least the processing in the color matrix circuit 29G is performed on a stage subsequent at least to the processing in the color interpolation circuit 29F. [0057] [0057]FIG. 2 is a circuit block diagram inside the color matrix circuit 29G. [0058] The explanation hereunder will be made on the case where a color system of a color signal on an input side (hereinafter, referred to as an ‘input color signal’) is an ‘RGB color system’ and a color system of a color signal on an output side (hereinafter, referred to as an ‘output color signal’) is a ‘YCbCr color system’. Incidentally, other color systems may be used as the color system of the input color signal and the color system of the output color signal. [0059] Since the color system of the output color signal is the YCbCr color system, the color matrix circuit 29G is provided with a matrix circuit 101 for generating a brightness signal Y and a matrix circuit 102 for generating color difference signals (Cb, Cr). [0060] The matrix circuit 101 multiplies the inputted color signal (R, G, B) by a transformation matrix of 1�3 as in the following expression (1). Y = ( Mkg1   Mkb1   Mkr1 )  ( G B - G R - G ) ( 1 ) [0061] Note that elements (Mkg1, Mkb1, Mkr 1) are constants in this embodiment. [0062] The matrix circuit 102 multiplies the inputted color signal (R, G, B) by a transformation matrix of 2�2 as in the following expression (2). ( Cr Cb ) = ( Mkr2 Mkb2 Mkr3 Mkb3 )  ( R - G B - G ) ( 2 ) [0063] [0063]FIG. 2 shows that signals inputted to the matrix circuit 101 are G, (R−G), and (B−G), and signals inputted to the matrix circuit 102 are (R−G) and (B−G), but the differences (R−G) and (B−G) may be calculated either on a stage preceding to the color matrix circuit 29G or inside the color matrix circuit 29G. [0064] In the color matrix circuit 29G of this embodiment, an element group (Mkr2, Mkb2, Mkr3, Mkb3) of the transformation matrix is generated each time the input color signal (R, G, B) is inputted. This is generated by a parameter generating part 103 (corresponding to an element setting part in claims). [0065] [0065]FIG. 3 is a circuit block diagram inside the parameter generating part 103. [0066] The parameter generating part 103 is provided with an identification circuit 150 (corresponding to an identification unit in claims), a lookup table 155 (corresponding to a storage unit), and an interpolation circuit 158. [0067] The identification circuit 150 identifies the hue of the input color signal. [0068] The lookup table 155 stores in advance optimum element groups M(0), . . . , M(15) respectively for the predetermined number of color reference signals whose hues are different from one another. [0069] The interpolation circuit 158 refers to the identified hue and obtains from the lookup table 155 the optimum element groups M(i), M(i+1) for two of the color reference signals whose hues are close to that of the input color signal. Further, the interpolation circuit 158 performs interpolation computing based on the obtained optimum element groups M(i), M(i+1) to calculate the element group (Mkr2, Mkb2, Mkr3, Mkb3) to be set. [0070] Detailed explanation will be given below. [0071] The identification circuit 150 is composed of comparators 151, 152 and a hue angle arithmetic circuit 153. The comparators 151, 152 generate information indicating a quadrant, among four quadrants of a hue space as shown in FIG. 4, for example, to which the hue of the input color signal belongs (hereinafter, referred to as ‘hue quadrant information’ and expressed with 2 bits). The hue angle arithmetic circuit 153 generates information indicating a hue angle of the input color signal (hereinafter, referred to as ‘hue angle information’ and expressed with 6 bits). In short, the hue of the input color signal is expressed by the hue quadrant information of 2 bits and the hue angle information of 6 bits. [0072] Note that the hue angle arithmetic circuit 153 of this embodiment generates the hue angle information by the following expression (3).  R - G   R - G  +  B - G  ( 3 ) [0073] This expression (3) is an approximate expression of an expression for calculating the hue angle. This expression (3) is advantageous in that a great increase in the circuit scale of the parameter generating part 103 is not necessary since it includes only one multiplication/division (incidentally, an expression for calculating an accurate hue angle needs a trigonometric function). [0074] Then, this hue quadrant information (2 bits) and high-order 2 bits of the hue angle information (6 bits) are inputted to the lookup table 155. The high-order 2 bits of this hue angle information indicate a hue range to which the input color signal belongs, out of four different hue ranges in the quadrant shown in FIG. 4. Therefore, the high-order 2 bits of the hue angle information and the four bits of the hue quadrant information (i) indicate the hue range, among 16 different hue ranges R(i) (i=0, . . . , 15) of the hue space shown in FIG. 4, to which the input color signal belongs (hereinafter, information indicating the hue range R(i) to which this input color signal belongs is referred to as ‘hue range information’). [0075] As shown in FIG. 4, the optimum element groups M(0), . . . , M(15) which are stored in the lookup table 155 are the optimum element groups for the respective color reference signals located on the borders (hues H(0), . . . , H(15)) of these hue ranges R0, . . . , R15. Note that each of the optimum element groups M(0), . . . , M(15) can be obtained from an input/output characteristic or the like of the CCD image sensor 26. Further, each of the optimum element groups M(0), . . . , M(15) can be also obtained, for example, in the following manner. [0076] It is obtained by imaging color samples of the respective hues H(0), . . . , H(15) on trial with the electronic camera to evaluate on how much hues of obtained color signals differ from those of the color samples. [0077] Further, hereunder, out of the elements constituting the optimum element group M(i), one corresponding to the element Mkr2 of the transformation matrix (the expression (2)) is substituted by m11(i), one corresponding to the element Mkb2 is substituted by m12(i), one corresponding to the element Mkr3 is substituted by m21(i), and one corresponding to the element Mkb3 is substituted by m22(i). [0078] [0078]FIG. 5 is a view showing the contents of the lookup table 155. [0079] The optimum element group M(i) (i=0, . . . , 15) corresponds to the hue range information (i) (i=0, . . . , 15) in the lookup table 155. The elements of the optimum element group M(i) and the elements of its adjacent optimum element group M(i+1) correspond to each piece of the hue range information (i) (note that M(i+1)=M(0) when i=15). In other words, in the lookup table 155, 8 values, m11(i), m12(i), m21(i), m22(i), m11(i+1), m12(i+1), m21 (i+1), m22(i+1), are stored in correspondence with each piece of the hue range information (i) (i=0, . . . , 15) (note that m11(i+1)=m11(0), m12(i+1)=m12(0), m21(i+1)=m21(0), and m22(i+1)=m22(0) when i=15). [0080] [0080]FIG. 6(b) is a view explaining interpolation computing by the interpolation circuit 158. [0081] In FIG. 6(b), the horizontal axis indicates the hue of the input color signal and the vertical axis indicates a set value of the element Mkr2. Incidentally, the values on the vertical axis and the horizontal axis are not significant in FIG. 6(b). [0082] Further, ‘relation among the element Mkr2, an interpolation circuit 158 −11, and the element m11’, to be described later, also applies to ‘relation among the element Mkb2, an interpolation circuit 158 −12, and the element m12’, ‘relation among the element Mkr3, an interpolation circuit 158 −21, and the element m21’, and ‘relation among the element Mkb3, an interpolation circuit 158 −22, and the element m22’. [0083] When the interpolation circuit 158 −11 recognizes the hue range information (i) (indicating the hue range Ri to which the input color signal belongs), it refers to the optimum element groups M(i), M(i+1) which are stored in the lookup table 155 and correspond to this hue range information (i). Then, the interpolation circuit 158 −11 performs the interpolation computing based on the two elements corresponding to the element Mkr2 (namely, the elements m11(i) and m11(i+1)) out of the elements in the optimum element groups M(i), M(i+1), to calculate the element Mkr2. [0084] The interpolation circuit 158 −11 allows the relation between the hue of the input color signal and the hues H(i), H(i+1) of two color reference signals having close colors to the color signal (hereinafter, referred to as ‘hue relation information) to be reflected in this interpolation computing. This hue relation information (a) corresponds to low-order 4 bits of the aforesaid hue angle information (refer to FIG. 3). For example, the interpolation circuit 158 calculates a weighted average of m11(i) and m11(i+1) according to this hue relation information (a) as in the following expression (4). Mkr2 = m11  ( i ) � ( 16 - a ) + m11  ( i + 1 ) � a 16 ( 4 ) [0085] Therefore, in this embodiment, a color transformation characteristic curve approximates an optimum one. Incidentally, the above expression (4) is a linear interpolation expression which is the simplest among various kinds of interpolation computing. Using the interpolation circuit 158 −11 which performs such interpolation computing, the color transformation characteristic curve becomes a polygonal line as is apparent from FIG. 6(b). [0086] An expression (5), an expression (6), and an expression (7) can be used for the expressions for the interpolation computing in the interpolation circuit 158 −12 which calculates the element Mkb2, in the interpolation circuit 158 −21 which calculates the element Mkr3, and in the interpolation circuit 158 −22 which calculates the element Mkb3, respectively. Mkb2 = m12  ( i ) � ( 16 - a ) + m12  ( i + 1 ) � a 16 ( 5 ) Mkr3 = m21  ( i ) � ( 16 - a ) + m21  ( i + 1 ) � a 16 ( 6 ) Mkb3 = m22  ( i ) � ( 16 - a ) + m22  ( i + 1 ) � a 16 ( 7 ) [0087] [0087]FIG. 6(a) shows an optimum color transformation characteristic curve and FIG. 6(c) shows a color transformation characteristic curve set by the prior art (in which the element group is selectively used). In FIG. 6(a), FIG. 6(b), and FIG. 6(c), the number of the optimum element groups M(i) prepared in advance is assumed to be the same in this embodiment (FIG. 6(b)) as in the prior art (FIG. 6(c)) for simple comparison. [0088] It is seen that the color transformation characteristic curve set in this embodiment (FIG. 6(b)) approximates the optimum one (FIG. 6(a)) to a greater extent than the color transformation characteristic curve set in the prior art (FIG. 6(c)) does. [0089] Further, in this embodiment described above, circuits necessary for the interpolation computing are the hue angle arithmetic circuit 153 and the interpolation circuits 158 −11, 158 −12, 158 −21, and 158 −22. The increase in the circuit scale (the number of multiplication/division+9) in this embodiment is, however, remarkably small compared with the increase (the number of multiplication/division+24) in the circuit scale in the case where the order of the color transformation is increased to 2 in the prior art. [0090] Moreover, the color transformation characteristic curve can approximate a higher-order curve such as a cubic curve and a quartic curve to a greater extent when the color transformation characteristic curve becomes the polygonal line by performing the interpolation computing as in this embodiment than when the color transformation characteristic curve becomes a quadratic curve by increasing the order of the color transformation to 2 as in the prior art. Therefore, a color reproducibility obtained in this embodiment is made higher than that obtained in the prior art where the order of the color transformation is increased to 2. In conclusion, according to this embodiment, a high color reproducibility can be surely given to the color signal without any great increase in the circuit scale. [0091] The following expression (8) may replace the expression (3) as the arithmetic expression of the hue angle information used by the hue angle arithmetic circuit 153 in this embodiment. ( R - G ) 2 ( R - G ) 2 + ( B - G ) 2 ( 8 ) [0092] According to this expression (8), the division density of the hue space (namely, the size of the hue ranges R0, . . . , R15) shown in FIG. 4 and FIG. 6 becomes uneven depending on colors. Also, humans' color perception and the characteristics peculiar to the color image device naturally have unevenness depending on colors, therefore, the color transformation processing should have the unevenness, too. In other words the accuracy of the color transformation processing is required to be high or is allowed to be low, depending on a position in the hue space to which the input color signal belongs. [0093] Therefore, it is preferable that as a result of using this expression (8), the division density of an area in which the accuracy of the color transformation processing is required to be high is high and the division density of an area in which the accuracy of the color transformation processing is allowed to be low is low, in the hue space. In this case, a more appropriate color transformation characteristic curve can be set, thereby realizing an efficient circuit configuration. [0094] <Second Embodiment>
[0095] A second embodiment of the present invention will be explained with reference to FIG. 7, FIG. 8, FIG. 9, and FIG. 10. [0096] What is different from the first embodiment will only be explained below and explanation on what is common to them will be omitted. In FIG. 7 and FIG. 8, the same numerals and symbols are used to designate the same components as those in FIG. 2 and FIG. 3. An electronic camera of this embodiment is the same as the electronic camera of the first embodiment shown in FIG. 1 except that it is provided with a color matrix circuit 200 which will be explained below instead of the color matrix circuit 29G. [0097] [0097]FIG. 7 is a circuit block diagram inside the color matrix circuit 200. [0098] The color matrix circuit 200 is provided with a matrix circuit 101 for generating a brightness signal Y and a matrix circuit 102 for generating color difference signals (Cb, Cr) similarly to the color matrix circuit 29G. The brightness signal Y obtained in this embodiment is, however, corrected by a correction circuit 101′ provided inside the color matrix circuit 200. The correction circuit 101′ is composed of an adder (or a subtracter or a multiplier) and so on. A correction value of this correction circuit 101′ varies according to the hue of an input color signal. In order to realize this, a parameter generating part 203 (corresponding to an element setting part and a correction value setting part in claims) disposed in the color matrix circuit 200 of this embodiment generates a correction value dY as well as an element group (Mkr2, Mkb2, Mkr3, Mkb3). [0099] [0099]FIG. 8 is a circuit block diagram inside the parameter generating part 203. [0100] The parameter generating part 203 is the same as the parameter generating part 103 except that it is provided with a lookup table 255 instead of the lookup table 155 and additionally has an interpolation circuit 258 for calculating the correction value dY. [0101] The lookup table 255 stores in advance optimum correction values d(0), . . . , d(15) (refer to FIG. 9) for the predetermined number of color reference signals respectively whose hues are different from one another, together with optimum element groups M(0), . . . , M(15). [0102] Each of the color correction values d(0), . . . , d(15) can be determined according to, for example, a user's preference and the like. [0103] For example, when a manufacturer or a user of an electronic camera requests that the brightness of a color signal indicating the skin be higher than the brightness of color signals indicating other images, an optimum correction value d(k) for a color reference signal of the skin color is set at a larger value than optimum correction values d(k′) for color reference signals of the other colors. [0104] [0104]FIG. 10 is a view showing the contents of the lookup table 255. [0105] In the lookup table 255, the optimum element group M(i) (i=0, . . . , 15) and the optimum correction value d(i) (i=0, . . . , 15) correspond to hue range information (i) (i=0, . . . , 15). [0106] Elements of the optimum element group M(i) and the optimum correction value d(i) and elements of its adjacent optimum element group M(i+1) and the optimum correction value d(i+1) correspond to each piece of the hue range information (i) (note that M(i+1)=M(0) and d(i+1)=d(0) when i=15). [0107] When an interpolation circuit 258 recognizes the hue range information (i) (indicating a hue range Ri to which the input color signal belongs), it refers to the optimum element groups M(i), M(i+1) and the optimum correction values d(i), d(i+1) which are stored in the lookup table 255 and correspond to this hue range information (i). [0108] Then, the interpolation circuit 258 performs interpolation computing similar to that by the interpolation circuit 158 of the first embodiment (based on the optimum element groups M(i), M(i+1)) based on the optimum correction values d(i), d(i+1). The correction value dY is calculated by the latter interpolation computing. [0109] The interpolation circuit 258 has hue relation information (a) (low-order 4 bits of hue angle information) indicating the relation between the hue of the input color signal and two reference hues H(i), H(i+1) reflected in the interpolation computing. For example, the interpolation circuit 258 calculates a weighted average of d(i) and d(i+1) according to this hue relation information (a) as in the following expression (9). dY = d  ( i ) � ( 16 - a ) + d  ( i + 1 ) � a 16 ( 9 ) [0110] Consequently, a brightness correction characteristic curve approximates an optimum one in this embodiment. The above expression (9) is a linear interpolation expression which is the simplest among various kinds of interpolation computing. According to the interpolation circuit 258 which performs such interpolation computing, the brightness correction characteristic curve becomes a polygonal line. [0111] According to the above-described embodiment, a high color reproducibility can surely be given to a brightness component of the color signal without any great increase in the circuit scale. [0112] <Third Embodiment>
[0113] A third embodiment of the present invention will be explained with reference to FIG. 11. What is different from the second embodiment will only be explained below and explanation on what is common to them will be omitted. In FIG. 11, the same numerals and symbols are used to designate the same components as those in FIG. 8. [0114] [0114]FIG. 11 is a circuit block diagram inside a parameter generating part 303. [0115] An electronic camera of this embodiment is the same as the electronic camera of the second embodiment except that it is provided with the parameter generating part 303 instead of the parameter generating part 203. The parameter generating part 303 is provided with an identification circuit 350, a lookup table 255, and interpolation circuits 158, 258 similarly to the parameter generating part 203. [0116] In this embodiment a correction value dY, however, is determined not only by the hue of an input color signal but also by ‘chroma’ thereof. It is determined by a correction circuit 258′ such as a multiplier (or a subtracter or an adder) provided inside this parameter generating part 303. In order to realize this, an identification circuit 350 generates hue quadrant information, hue angle information, information indicating the chroma of the input color signal (hereinafter, referred to as ‘chroma information’) based on the input color signal (R, G, B). The identification circuit 350 of this embodiment extracts the chroma information by, for example, the following expression (10).
[0117] This expression (10) is an approximate expression of an expression for calculating the chroma. This expression (10) is advantageous in that a great increase in the circuit scale of the parameter generating part 303 is not necessary since it does not include any multiplication/division (an expression for calculating an accurate chroma needs a square root and multiplication/division). Moreover, in the calculation of this expression (10), the value of the denominator in the expression (3) (the expression for generating the hue angle information) is usable as it is. [0118] In FIG. 11, a circuit for calculating |R−G| is denoted by the numeral 353 −1, a circuit for calculating |R−G|+|B−G| is denoted by the numeral 353 −3, and a circuit for subtracting these values is denoted by the numeral 353 −2. In other words, an output of the circuit 353 −2 indicates the hue angle information and an output of the circuit 353 −3 indicates the chroma information. In this embodiment, to vary a correction value β by the correction circuit 258 according to the chroma of the input color signal, correction values β appropriate for different chromas are prepared in advance in a lookup table 355 or the like. [0119] Note that the number of the values prepared in the lookup table 355 (the circuit scale of the lookup table 355) is small since determined accuracy required for this correction value β(divergence from an optimum value) is not so high compared with determined accuracy required for the correction value dY and the elements Mkr2, . . . , Mkb3. [0120] As described above, not only the hue but also the chroma of the input color signal are reflected in the correction value dY in this embodiment so that a higher color reproducibility is obtainable than in the second embodiment. [0121] <Additional Remarks>
[0122] In each of the above-described embodiments, the number of the optimum element groups prepared in advance (the number of the optimum element groups and the number of the optimum correction values in the third embodiment) is ‘16’, but the number is not limited to this and preferably, is set to a number according to the accuracy to be set which is required for the elements Mkr2, . . . , Mkb 3, when necessary. [0123] Further, FIG. 3, FIG. 8, and FIG. 11 show the examples of the bit numbers expressing the respective information (the hue quadrant information, the hue angle information, and the hue relation information), and in these examples the bit numbers expressing the input color signal and the output color signal are both ‘9’. [0124] Further, in each of the embodiments explained above, the signal processing unit of the present invention is applied to the electronic camera, but it is applicable to other color image devices. [0125] To utilize each of the above-described advantages, it is more preferable that the signal processing unit of the present invention is applied particularly to color image devices such as an electronic camera, a video camera, a portable printer, and so on for which downsizing, price reduction, and weight reduction are highly demanded. [0126] The invention is not limited to the above embodiments and various modifications may be made without departing from the spirit and scope of the invention. Any improvement may be made in part or all of the components. Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5140408 *Feb 8, 1990Aug 18, 1992Sanyo Electric Co., Ltd.Color component signal converting apparatus having an input dependent switchable matrixUS5172224 *Dec 18, 1990Dec 15, 1992Eastman Kodak CompanyPrinter calibration method using electronically-decoupled color and tone scale adjustmentsUS5453853 *Mar 19, 1992Sep 26, 1995Sony CorporationColor video still image processing systemUS5604610 *Nov 3, 1994Feb 18, 1997Eastman Kodak CompanyTransforming color signal values for use by a particular deviceUS5659406 *Jun 20, 1996Aug 19, 1997Ricoh Company, Ltd.Color correction system for transforming color image from one color space to anotherUS5717783 *Apr 25, 1995Feb 10, 1998Fujitsu LimitedColor correction apparatus and method and color image processing system including the sameUS5805213 *Dec 8, 1995Sep 8, 1998Eastman Kodak CompanyMethod and apparatus for color-correcting multi-channel signals of a digital cameraUS5933256 *May 14, 1996Aug 3, 1999Xexox CorporationMethod for color correction within a color space using hue shifting of a region thereinUS5978554 *Aug 7, 1997Nov 2, 1999Riso Kagaru CorporationImage processing method and system with selection of threshold matrix, from group including matrix with thresholds interpolated from other matrixes, based on edge resemblance in reference areaUS5987167 *Mar 14, 1997Nov 16, 1999Nec CorporationColor image display method and apparatusUS6137494 *Sep 5, 1997Oct 24, 2000International Business Machines CorporationMethod and means for evaluating a tetrahedral linear interpolation functionUS6215561 *Dec 9, 1997Apr 10, 2001Seiko Epson CorporationImage processing apparatus and image processing methodUS6243059 *May 14, 1996Jun 5, 2001Rainbow Displays Inc.Color correction methods for electronic displaysUS6459449 *Dec 24, 1997Oct 1, 2002Nikon CorporationColor reproduction correction device and correction method for an imaging apparatusUS6657746 *Dec 22, 1999Dec 2, 2003Kabushiki Kaisha ToshibaLook-up table constructing method and color conversion apparatusUS6781595 *Oct 22, 2001Aug 24, 2004Sony CorporationImage processing apparatus and method, and recording medium thereforUS6788339 *Dec 21, 1998Sep 7, 2004Canon Kabushiki KaishaImage pickup apparatusUS6823083 *Nov 24, 2000Nov 23, 2004Fuji Photo Film Co., Ltd.Saturation correcting apparatus and methodUS6930809 *Oct 13, 2000Aug 16, 2005Mitsubishi Denki Kabushiki KaishaColor conversion device and method of manufacturing the sameUS6947594 *Nov 28, 2001Sep 20, 2005Fujitsu LimitedImage processing method and systemsUS6950109 *Sep 12, 2001Sep 27, 2005Sun Microsystems, Inc.Multi-spectral color correctionUS6995865 *Nov 13, 2000Feb 7, 2006Matsushita Electric Industrial Co., Ltd.Method of normalizing color information, method of exchanging color information using the same method and device using the same methodsUS7072510 *Aug 28, 2002Jul 4, 2006Autodesk Canada Co.Adjusting data representing image pixel colorUS7177465 *Jul 17, 2000Feb 13, 2007Fuji Photo Film Co., Ltd.Method of compressing/extending color reproducing space, color reproducing method and color reproducing apparatusUS20010015835 *Jan 19, 2001Aug 23, 2001Toru AokiElectro-optical apparatus, image processing circuit, image data correction method, and electronic apparatusUS20010026372 *Mar 14, 2001Oct 4, 2001Reiji MisawaImage forming apparatus, control apparatus and density correcting methodUS20010043368 *Mar 23, 2001Nov 22, 2001Seiichiro MorikawaMethod of processing imageUS20020025069 *May 11, 2001Feb 28, 2002Toshiaki EndoSignal processing apparatus and method for reducing generation of false color by adaptive luminance interpolationUS20030053095 *Feb 7, 2002Mar 20, 2003Yoshihiro NakamiApparatus and method for adjusting output image from image data* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS6972860 *Nov 24, 1999Dec 6, 2005Xerox CorporationEncoding of requests for sample copy output in document assembly treesUS6980219 *Oct 21, 2003Dec 27, 2005Clairvoyante, IncHue angle calculation system and methodsUS7176935Oct 21, 2003Feb 13, 2007Clairvoyante, Inc.Gamut conversion system and methodsUS7301543Apr 9, 2004Nov 27, 2007Clairvoyante, Inc.Systems and methods for selecting a white point for image displaysUS7589743Aug 2, 2005Sep 15, 2009Samsung Electronics Co., Ltd.Hue angle calculation system and methodsUS7592996May 18, 2007Sep 22, 2009Samsung Electronics Co., Ltd.Multiprimary color display with dynamic gamut mappingUS7598961Oct 21, 2003Oct 6, 2009Samsung Electronics Co., Ltd.method and apparatus for converting from a source color space to a target color spaceUS7619637Nov 17, 2009Samsung Electronics Co., Ltd.Systems and methods for improved gamut mapping from one image data set to anotherUS7671898 *Mar 2, 2010Hoya CorporationColor-space transformation-matrix calculating method and image processing deviceUS7864188Oct 16, 2007Jan 4, 2011Samsung Electronics Co., Ltd.Systems and methods for selecting a white point for image displaysUS7969456Feb 26, 2007Jun 28, 2011Samsung Electronics Co., Ltd.Methods and systems for sub-pixel rendering with adaptive filteringUS8013867Apr 4, 2006Sep 6, 2011Samsung Electronics Co., Ltd.Systems and methods for implementing improved gamut mapping algorithmsUS8031205Oct 4, 2011Samsung Electronics Co., Ltd.Image data set with embedded pre-subpixel rendered imageUS8259127Sep 25, 2007Sep 4, 2012Samsung Electronics Co., Ltd.Systems and methods for reducing desaturation of images rendered on high brightness displaysUS8421820Apr 16, 2013Samsung Display Co., Ltd.Methods and systems for sub-pixel rendering with adaptive filteringUS9355601Apr 16, 2013May 31, 2016Samsung Display Co., Ltd.Methods and systems for sub-pixel rendering with adaptive filteringUS20030085906 *Aug 8, 2002May 8, 2003Clairvoyante Laboratories, Inc.Methods and systems for sub-pixel rendering with adaptive filteringUS20040196297 *Apr 7, 2003Oct 7, 2004Elliott Candice Hellen BrownImage data set with embedded pre-subpixel rendered imageUS20050083344 *Oct 21, 2003Apr 21, 2005Higgins Michael F.Gamut conversion system and methodsUS20050083345 *Oct 21, 2003Apr 21, 2005Higgins Michael F.Hue angle calculation system and methodsUS20050083352 *Oct 21, 2003Apr 21, 2005Higgins Michael F.Method and apparatus for converting from a source color space to a target color spaceUS20050168645 *Jan 26, 2005Aug 4, 2005Canon Kabushiki KaishaAdjusting circuit and methodUS20050225562 *Apr 9, 2004Oct 13, 2005Clairvoyante, Inc.Systems and methods for improved gamut mapping from one image data set to anotherUS20050264580 *Aug 2, 2005Dec 1, 2005Clairvoyante, IncHue angle calculation system and methodsUS20060170942 *Jan 27, 2006Aug 3, 2006Pentax CorporationColor-space transformation-matrix calculating method and image processing deviceUS20060244686 *Apr 4, 2006Nov 2, 2006Clairvoyante, IncSystems And Methods For Implementing Improved Gamut Mapping AlgorithmsUS20070279372 *May 18, 2007Dec 6, 2007Clairvoyante, IncMultiprimary color display with dynamic gamut mappingUS20080030518 *Oct 16, 2007Feb 7, 2008Clairvoyante, IncSystems and Methods for Selecting a White Point for Image DisplaysUS20080094517 *Oct 19, 2007Apr 24, 2008Murata Machinery, Ltd.Image Processing Apparatus and Image Processing MethodUS20080158243 *Mar 13, 2008Jul 3, 2008Clairvoyante, IncImage Data Set With Embedded Pre-Subpixel Rendered ImageEP1531630A1 *Nov 12, 2004May 18, 2005Fujitsu General LimitedColor correction processing circuit* Cited by examinerClassifications U.S. Classification358/1.9, 358/520International ClassificationH04N1/60, H04N9/07, G03F3/08, H04N9/67, H04N1/46, H04N9/64, G06T1/00Cooperative ClassificationH04N1/60, H04N1/6075European ClassificationH04N1/60, H04N1/60KLegal EventsDateCodeEventDescriptionSep 13, 2002ASAssignmentOwner name: NIKON CORPORATION, JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HOSHUYAMA, HIDEO;REEL/FRAME:013303/0681Effective date: 20020909Feb 6, 2013FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services