Abstract:
A colour quality control device adapted for use in a system for colour correction of an image to be reproduced on at least one reproduction device that is calibrated by a reproduction forward transform. The system also comprises a colour correction device adapted to correct at least one colour in the image. The colour quality control device comprises a false contour detection unit that uses information from the reproduction forward transform to decide if a contour in the image is a false contour introduced by the transform. This facilitates the operator&#39;s work during colour correction. A system and a method are also provided.

Description:
FIELD OF THE INVENTION 
       [0001]    The invention relates generally to colour management, and more particularly to out-of-gamut detection and warnings in systems for managing colour. 
       BACKGROUND OF THE INVENTION 
       [0002]    In the age of introduction of digital film processing and digital cinema, multiple digital processing steps appear in the—classically analogue—cinematographic workflow. While digital special effect generation and post-production have been common for some time, digital cameras and new digital display devices and digital media now begin to be widespread. The digital equipment completely changes working habits during capture and post-processing and while digital technologies bring new features, they also represent a danger for artistic experience and heritage. It is thus necessary to transfer known artistic effects from conventional—analogue—cinematographic post-processing into digital cinema post-processing. Since the introduction of new equipment is expected to be gradual, technologies for co-existing analogue and digital processes have to be studied. This may for example concern a film captured by an analogue film camera and then displayed by a digital projector, or integration of digital special effects in an analogue film production chain. 
         [0003]    One of the artistic workflow tools is colour correction, which for example is applied to raw film material after production to compensate for illumination colour artefacts or, before film distribution, to fine-tune the colour tones in order to realize artistic intents for certain scenes. Apart from being an important step of cinematographic post-processing, colour correction is also applied to photographs, paintings or graphics before printing. 
         [0004]    Colour correction can be applied to a sequence of video frames, to a single video frame, to still images or even to parts of an image, such as an object therein. It is usually performed in cooperation between an artistic director and one or more skilled operators. The artistic director describes the intent of the colour correction while the operator transforms the intent into a colour transform applied to the visual content. Such colour transforms may for example include an increase of saturation, a change of colour hue, a decrease of red tones or an increase of contrast. Colour correction may be global to an image, to a set of images, to a specific region in one single image or even to all image regions in several images corresponding to a specific semantic unit. 
         [0005]    During colour correction, the artistic director and the operator have to keep in mind what the impact of the applied colour correction will be on the final reproduction medium. The following examples illustrate this problem. In a first example, a painting is scanned and colour corrected using a personal computer (PC). The operator verifies the applied colour correction on the display of the PC, but the final reproduction is done on paper printer. A second example is a film that is scanned, digitalized, and colour corrected using a dedicated high-resolution colour correction device. The operator verifies the applied colour correction on the screen of a high definition control monitor, but the final reproduction is done by a film printer followed by film projection. 
         [0006]    In both of these examples, the verified colour may be different from the reproduced colour, any differences between the proof viewing display device (for example the PC monitor screen or the high definition control monitor) and the final reproduction device (for example a paper printer or a film printer followed by film projection) should be taken into account during colour correction. These differences can include changes of hue, changes of saturation, changes of contrast, changes of luminance, changes of dynamic range, changes of colour gamut. 
         [0007]    A known, partial solution to this problem is colour management (CMM). For CMM, the characteristics of the proof viewing device and the final reproduction device are measured, mathematically modelled, and then compensated for, using a colour transformation. CMM takes into account the colour gamut, which describes the totality of reproducible colours of a display device, of the devices involved. When an image contains colours outside of the gamut of a display device or close to the border of the gamut, the applied colour transform may contain colour compression, colour clipping or other specific operations such that the transformed colours are inside of the gamut. 
         [0008]    It is easily realised that the difference between colour gamuts of display devices causes a problem for colour correction. It may happen that the operator applies a colour correction that generates an acceptable result on the proof-viewing device while the final reproduction device is not capable of reproducing some of the colours, since the colour gamut of the final reproduction device is different from that of the proof-viewing device. It may also happen that the operator wants to apply a specific colour correction which would generate acceptable results on the final reproduction device, while the correction cannot be sufficiently visualized on a proof-viewing device with limited colour gamut. 
         [0009]    A second problem of colour correction is caused by the colour transformations of CMM. These colour transforms transform input colour values to output colour values. The transforms may comprise several partial colour transforms, each defined for a specific range of valid input colours. On the borders between such ranges of valid input colour, the colour transform may change its slope or be discontinuous. This may generate false contours in the transformed image. What&#39;s more, colour transforms often use Look-Up Tables (LUTs) that contain a set of pairs of sample input and sample output colours. When colour is transformed in a LUT, colours in-between the sample colours must be interpolated. Colour interpolation may introduce discontinuous colours or discontinuous slopes of colours at sample colours, which may generate false contours in the transformed image. 
         [0010]    It is well-known in the art to detect colour values outside a colour gamut of a reproduction device, so-called “out of gamma alarm.” For example, US patent application US 2003/0016230 A1 teaches a system that indicates all colours from a colour palette that are outside the gamut of a reproduction device. 
         [0011]    The present invention intends to improve upon the prior art by providing a way for an operator to be informed of possible problems in a reproduced image caused by colour correction. 
       SUMMARY OF THE INVENTION 
       [0012]    In a first aspect, the invention is directed to a colour quality control device adapted for use in a system for colour correction of an image to be reproduced on at least one reproduction device that is calibrated by a reproduction forward transform. The transformed colours are called transformed reproduction colours. The system further comprises a colour correction device adapted to correct colours in the image. The output colours of the correction device are called corrected colours. The colour quality control device comprises a false contour detection unit adapted to use information from the reproduction forward transform to decide if a contour in the image is a false contour. 
         [0013]    In a preferred embodiment, the false contour detection unit is adapted to find contours in the image and use information about anomalies in the reproduction forward transform to decide if a found contour is a false contour. 
         [0014]    In an alternative preferred embodiment, the false contour detection unit is adapted to use information about anomalies in the reproduction forward transform to search in the image for contours between corrected colours around such anomalies and decide that any contour found in the image is a false contour. 
         [0015]    In another preferred embodiment, the false contour detection unit is adapted to search for contours in the image of transformed reproduction colours, search for contours in the image of corrected colours, and classify a detected contour in the image of transformed reproduction colours as a false contour if there is no corresponding contour in the image of corrected colours. 
         [0016]    In a further preferred embodiment, the reproduction forward transform is given by a piecewise defined function. 
         [0017]    In yet another preferred embodiment, the colour quality control device further comprises a visualisation unit adapted to provide information about false contours to a user. 
         [0018]    In a second aspect, the invention is directed to a system for colour correction of images. The system comprises a colour correction device adapted to correct colours in an image, a proof viewing device adapted to display the corrected image to a user, and a colour quality control unit according to the first aspect of the invention. 
         [0019]    In a third aspect, the invention is directed to a method for controlling colour quality in a colour correction system. At least one colour in an image to be reproduced on at least one reproduction device that is calibrated by a reproduction forward transform is corrected by a colour correction device. A colour quality control unit uses information from the reproduction forward transform to decide if a contour in the image is a false contour. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS  
         [0020]    Preferred features of the present invention will now be described, by way of example, with reference to the accompanying drawings, in which: 
           [0021]      FIG. 1  illustrates a colour correction environment in which the method according to the invention is used; 
           [0022]      FIG. 2  illustrates a colour quality control unit according to the invention; and 
           [0023]      FIG. 3  is an exemplary illustration of the origin of false contours in an image. 
       
    
    
     DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
       [0024]    In the following exemplary, non-limitative embodiment, the invention is described for the case of colour correction of a digitalized film using a dedicated colour correction device and final reproduction by film printing followed by film projection. 
         [0025]      FIG. 1  illustrates a colour correction environment  100  using colour management (CMM) for use with the invention. 
         [0026]    A colour correction device  110  receives as input  105  a film that was digitalized by a film scanner (not shown). The operator applies colour corrections to the film, using the proof-viewing device  130  for feedback, while the film is finally reproduced using a final reproduction device  120 , for example a film printer. While the exemplary embodiment comprises two devices (proof viewing device and reproduction device), the procedure can be extended to more than two devices. 
         [0027]    The proof-viewing device  130  is calibrated using a proof viewing forward transform  132  that compensates for any device characteristics, so the corrected colours  112  received from the colour correction device  110  are shown as correctly as possible. The proof viewing forward transform  132  may include several partial colour transforms, LUT-based interpolation techniques and gamut clipping or gamut compression. It will be appreciated that corrected colours and the like should, in fact, be read as information about corrected colours. 
         [0028]    The final reproduction device  120  is calibrated using a reproduction forward transform  122  that compensates for any device characteristics, so the corrected colours  112  received from the colour correction device  110  are reproduced as correctly as possible. The reproduction forward transform  122  may include several partial colour transforms, LUT-based interpolation techniques and gamut clipping or gamut compression. 
         [0029]    A colour quality control unit  140  continuously analyses the colours. To this end, the colours  112  corrected by colour correction, information  123 ,  133  on the forward transforms  122 ,  132 , and the colours  127 ,  137  transformed by inverse transforms  124 ,  134  of the reproduction device  120  and the proof-viewing device  130 —called transformed colours—are input to the colour quality control unit  140 . An inverse transform  124 ,  134  is usually intended to give the colours that are really displayed on a display  120 ,  130 ; and these colours may differ from the original colours  112 . 
         [0030]      FIG. 2  illustrates a colour quality control unit according to the invention. The colour quality control unit comprises three general units:
       a false contour detection unit  141 , for detecting false contours in the transformed reproduction colours  127  using corrected colours  112 , information  123 ,  133  on the forward transforms  122 ,  132 , transformed reproduction colours  127  and transformed proof viewing colours  137 ;   a transform artefact analysis unit  142 , for detecting transform artefacts using corrected colours  112 , transformed reproduction colours  127 ; transformed proof viewing colours  137 , and transform information  123 ,  133 ;   a visualisation unit  143 , for producing an output  146  that alerts the operator of the existence of false contours and transform artefacts, based on false contour information  145  and transform artefact information  144 .         
       False Contour Detection 
       [0034]    False contours, i.e. luminance or colour discontinuities in flat image regions, are quite visible to the human eye. These unwanted false contours may appear during colour correction as is illustrated in  FIG. 3 . 
         [0035]      FIG. 3  shows an exemplary transformation graph  300  in which e.g. colour values to be transformed, x 1  and x 2 , are transformed by the colour transform function  310  into corrected colour values, y 1  and y 2 . As long as the transform function is smooth (continuous in first and second order derivatives), false contours will normally not be produced by the transform, but false contours may appear as soon as it is not smooth, even though the transform is piecewise smooth (i.e. parts of the transform are smooth). In  FIG. 3 , the lack of smoothness is illustrated by two “knees”  312 ,  314 . 
         [0036]    Further illustrated in  FIG. 3  is part of an analogue film  320  of which only one frame  322  is shown. In this frame  322  there are two areas  324 ,  326  that after colour correction have colour values y 1  and y 2 , respectively. As the two colour values are close to each other, but on different sides of a knee  314 , this may produce a false contour  328  (prolonged to be easily seen in the Figure). It should be noted that the exact meaning of “close” may differ from one part of the transform to another, but that a person skilled in the art is able to decide in each particular case, depending on how strict an interpretation he desires. 
         [0037]    The false contour  328  was not part of the original image before colour correction, so the false contour  328  is most likely an unwanted phenomenon. 
         [0038]    It should be noted that false contours also may appear when using other transformation techniques, such as using look-up tables (LUTs). In brief, false contours may appear when the corrected colours appear around anomalies in the transform or entry values of the LUT. 
         [0039]    To analyse false contours, it is proposed to analyse a corrected image to detect contours and then to see if the corrected colours are on either side of an anomaly, in the present example a knee. Naturally, it is also possible to use the knowledge of the transform function to limit the search in the image to colours close to a knee, especially if there are a lot of such colours. Another possibility is to search for contours in the image of transformed reproduction colours and in the image of corrected colours, and to classify a contour in the former image as a false contour if there is no corresponding contour in the latter image. 
         [0040]    A preferred embodiment of the analysis of false contours will now be explained in greater detail. 
         [0041]    First, flat image regions are detected by the following steps: 
         [0042]    1. For all image pixels, a criterion K F =∥∇C∥ is calculated with ∇ the derivation operator, ∥•∥ a norm operator and C a vector of colours for a set of neighboured image pixel, for example RGB values (Red Green Blue). Alternatively, other activity criteria may be employed. 
         [0043]    2. Image pixels are declared flat when K F &lt;T F , where T F  is a threshold. 
         [0044]    3. Flat image regions are detected from flat pixels by applying a median filter, morphologic opening and closing operations as well as a suppression of small non-connected regions. 
         [0045]    In flat image regions, false contours are detected by the following steps: 
         [0046]    1. For all pixels of flat image regions, a criterion 
         [0000]    
       
         
           
             
               K 
               C 
             
             = 
             
               
                 MIN 
                 i 
               
                
               
                 ( 
                 
                    
                   
                     C 
                     - 
                     
                       C 
                       i 
                     
                   
                    
                 
                 ) 
               
             
           
         
       
     
         [0000]    is calculated with C i  being colour values with possible colour discontinuities, i.e. around transform anomalies. These colour values can be taken from transform information being either LUT entries, colour values on borders between valid ranges of partial transforms, or other specific colours where the transform is expected to be inhomogeneous. Alternatively, other variance criteria may be employed. 
         [0047]    2. Image pixels are declared candidates of false contours if K C &gt;T C , where T C  is a threshold. 
         [0048]    3. By analysis of their spatial neighbourhood, candidates are then either validated and connected to build a false contour or, if they are isolated, eliminated. 
         [0049]    Detected false contours may be assessed in a post-processing step by a colour appearance model to judge the visibility of a false contour depending on image content and viewing conditions. 
         [0050]    Using transform information  123 ,  133  and transformed reproduction colours  127 , the false contour detection unit  141  provides information  145  about the detected false contours to the visualisation unit  143  so that the operator may receive one or more of warnings. 
       Transform Artefact Analysis 
       [0051]    Transform artefacts appear for instance when transform results in a value that is outside the gamut. Transform artefact analysis is performed using transform information  123 ,  133 . For a given proof viewing device  130  with given proof viewing forward transform  132  and proof viewing inverse transform  134 , let G V  be the gamut and C V,j  colour values on the border of G V . For a given reproduction device  120  with given reproduction forward transform  122  and reproduction inverse transform  124 , let G R  be the gamut and C R,j  colour values on the border of G R . 
         [0052]    The present invention improves upon the prior art in that it analyses transform artefacts based on at least two gamuts, the gamut G V  of a proof viewing device and the gamut G R  of a reproduction device. This analysis may for example be extended to more than one proof viewing device and more than one reproduction device. 
         [0053]    The transform artefact control detects the following cases: 
         [0054]    1. Colour values outside G V : A corrected colour value C is declared outside of G V  when C is not included in G V . Information about G V  is included in transform information  133 . In an alternative embodiment, G V  is calculated as convex hull from colours  131  (not shown in  FIGS. 1 and 2 ). 
         [0055]    2. Colour values modified by proof viewing transforms: By measuring the difference between a corrected colour C and its corresponding transformed colour, the colour is declared to be modified when the difference is beyond a threshold. The difference measure can be done in a specific colour space (for example CIEXYZ, or CIELab). 
         [0056]    3. Colour values outside G R : A corrected colour value C is declared outside of G R  when C is not included in G R . Information about G R  is included in transform information  123 . In an alternative embodiment, G R  is calculated as convex hull from colours  121  (not shown in  FIGS. 1 and 2 ). 
         [0057]    4. Colour values modified by reproduction transforms: By measuring the difference between a corrected colour C and its corresponding transformed colour, the colour is declared to be modified when the difference is beyond a threshold. The difference measure can be done in a specific colour space (for example CIEXYZ, or CIELab). 
         [0058]    The transform artefact analysis unit  142  provides information  144  about the detected artefacts to the visualisation unit  143  so that the operator may receive one or more of a number of warnings. 
         [0059]    Warning A indicates to the operator that he applies a colour correction that will result in a correctly reproduced colour on the reproduction device while the colour displayed on the proof viewing display is modified due to a limited gamut of the proof viewing device. In other words, the operator is told that “what he sees is not what he gets,” but he may still get what he wants. Warning A is given in case  1  and/or  2  above, provided that cases  3  and  4  are not present. 
         [0060]    Warning B indicates to the operator that he applies a colour correction that will result in an incorrectly reproduced colour on the reproduction device, because of the limited gamut of this device. Additionally, the incorrectly reproduced colour is not shown correctly on the proof-viewing device. This means that the operator cannot assess and control the incorrect colours of the reproduction device. Warning B is given in case  1  and/or  2 , if at least one of cases  3  and  4  is present. 
         [0061]    Warning B is notably interesting in an alternative embodiment in which the viewing forward transform  132  is fed by transformed reproduction colours  127  instead of corrected colours  112 . In this embodiment, the proof-viewing device  130  usually reproduces the colour that is correctly or incorrectly reproduced by the reproduction device  120 . Warning B indicates that the incorrectly reproduced colour is not shown correctly on the proof-viewing device. 
         [0062]    Warning C indicates to the operator that he applies a colour transform that will result in an incorrectly reproduced colour on the reproduction device, because of the limited gamut of this device. However, the colour is shown correctly on the proof-viewing device. This means that the operator can assess and control the incorrect colours of the reproduction device. Warning C is given in case  3  and/or  4 , provided that cases  1  and  2  are not present. 
       Visualization 
       [0063]    The visualization module  143  prepares the false contour and artefact information  146 , preferably for display by the proof viewing device  130 . This may be a separate image, a superimposed image or textual, statistical information. In case of image visualization, false contours may be indicated as lines, while artefact warning A, B. and C may be visualized as artificially coloured pixel. A single, predetermined colour may be used to indicate false contours and warnings A, B. and C, but it is preferred that each of these four indications is represented by a particular colour, distinct from the others. It is further preferred that these colours are modified depending on the surroundings so that they are clearly visible. In case of textual visualization, number and type of artefacts or false contours may be displayed. 
         [0064]    It should be noted that the components of the colour quality control unit  140 , may each be implemented in a processor, that one or more of the components may share a processor, and that the entire colour quality control unit  140  may be implemented in a processor. Furthermore, the components may have access to a dedicated memory (not shown), or a memory that may be shared with other components. 
         [0065]    It should also be noted that the forward transforms  122 ,  132  and the inverse transforms  124 ,  134  for, respectively, the reproduction device  120  and the proof viewing device  130 , may be performed in the colour correction device  110 , in the devices  120 ,  130  themselves, or in intermediate transform devices (not shown). 
         [0066]    It can thus be appreciated that the present invention improves upon the prior art by providing a device adapted to control colour quality in an image, in particular by detecting false contours therein. 
         [0067]    It will be understood that the present invention has been described purely by way of example, and modifications of detail can be made without departing from the scope of the invention. 
         [0068]    Each feature disclosed in the description and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination. Features may, where appropriate be implemented in hardware, software, or a combination of the two. Connections may, where applicable, be implemented as wireless connections or wired, not necessarily direct or dedicated, connections. 
         [0069]    Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims.