SYSTEM AND METHOD FOR IMAGE PROCESSING

Abstract: The invention relates to a system and a procedure for image processing. The system comprises a data communication network (1) which serves as a channel for the transmission of the image being processed, digitised in an electronic form of representation, and an image processing device (2; 2a, 2b, 2c), which is connected to the data communication network (1) and which processes the image to enhance its visual quality to print the image to different formats. According to the invention, the image processing system comprises a classifying device (3), which automatically classifies the image, and a correcting device (4), which automatically corrects the image.

Description: SYSTEM AND METHOD FOR IMAGE PROCESSING The present invention relates to an image processing system as defined in the preamble of claim 1 and to an image processing procedure as defined in the preamble of claim 5 for the processing of images via a data communication network. Conventional colour printing is partly an artistic activity. It takes a professional image processing specialist and complicated operations to pro- duce guaranteed image quality. Offset printers are artists in their own field; the inking must be controlled specifically for each image. Digital colour printers have changed the situation. People without any deep knowledge of printing can manipulate, process and print different types of colour images. The digital printing mode enables decentralisation of the various processing operations comprised in printing. Decentralised printing involves new aspects in the production of paper-based reading material. The vari- ous stages of production are more individual. An image can be printed with different printers using different printing parameters. Colour control in printing is traditionally based on colour correction. Colour correction means compensating for the distortion in printing that arises from non-ideal absorption of the spectral coverage of colour in the printing toner. At present, colour correction is based on data obtained via test printing, i.e. there is no reliable computational method available. In digital image processing, in decentralised printing and in digital colour printers, general colour correction is needed. The term "hardware independent colour' simply means that the values of digitised colour code and a system of chromaticity coordinates for the printer are defined by convention. These rela- tionships have been modified by balancing the visual system of chromaticity coordinates, such as CIELab and CIE uv. As regards hardware independence, the system of chromaticity coordinates can also be defined in terms of RGB or CMYK. The idea of hardware independence has been extended to decentralised printing systems in a data communication network environment, by defining profiles separately for each input device and each output device. When different devices are con- nected to the system, the same hardware levels and uniform control methods are used. The profiles are colour correction descriptors for different correction operations, which have to be defined experimentally. This means that the profiles for all possible inputs and outputs must be known. This naturally restricts the concept of decentralised printing as an independent system regarding place and time. The old idea about the printing of a colour image is that the original image is a model for the printing. This is a misleading idea because the true colours of the original image are not necessarily known. The image may have been digitised with a cheap camera or the image has been generated by an older coding method, which may result in inadequate image quality. If the image is to be printed, it has to be enhanced and corrected. The object of the present invention is to eliminate the drawbacks mentioned above. The image processing system comprises four different types of device; an input device, an image enhancing device, a display terminal and an output device. All devices are independently connected to a data communication network. Each device knows its own parameters, e.g. the colour correction profile. Each device has artificial intelligence to enable the device to process the data of a source independent image. What was said above means that it is not neces- sary to know the technical origin of the image . The image can be encoded by any coding method generally used. When the image is processed by a device comprised in the image processing system in question, a signal section can be added to the image code. The signal section may contain e.g. illumination information about the object of the image and make-up information about image processing. When the system of the invention is compared with conventional colour printing, one new requirement regarding changed working principles emerges. Today, those who use colour printing are editors, writers and computer users in general, whereas ten years ago they were professional image operators. Interactive image make-up operations are optional, but not indispensable for an acceptable printing result. As for the features characteristic of the invention, reference is made to the claims. The image processing system of the invention comprises a data communication network, which serves as a channel for the transmission of the image being processed, digitised in an electronic form of representation, and which connects an image processing device comprised in the system. The image processing de- vice processes the image and prints it to different formats. According to the invention, the image processing device comprises an image enhancing device. The image enhancing device automatically classifies and corrects the image. The image enhancing device may also only classify or only correct the image. In the procedure of the invention, an image digitised in an electronic form of representation is transmitted in a data communication network, in which the image is processed by means of different devices. The processing is aimed at improving the visual quality of the image. Besides improving the visual quality of the image, the image is printed to different for- mats; in other words, the image can be printed e.g. to a display terminal or on paper. According to the invention, the image is automatically classified on the basis of a signal section comprised in the image code, and, based on the classification, corrections are made in the image . The image processing system is decentralised so that the system input, a separate image processing device, a display terminal and the system output can be disposed in different locations and the functions of different devices can be performed at different times. Each device in the system only needs the image code. No technical parameters of the other devices are needed. Such a system can be said to be source and de- vice independent. In an embodiment of the device, the image processing system comprises a profile generating device, in which the image is processed on the basis of device-specific properties. In an embodiment of the device, the image processing system comprises an adding device arranged to add information code to the image, which information code may contain e.g. information about the illumination conditions of the image, image correction op- erations and image quality in general. In an embodiment of the device, the image is in digital format in the image processing system. The digital image format may have been encoded by many different methods commonly used. According to an embodiment of the procedure, in the automatic image correction, edge areas in the image are first identified. Next, gamma correction of the image is carried out. After this, the grey shade balance, brightness and RGB contrast of the image are adjusted. Finally, the sharpness of the image is enhanced, image noise is filtered and the colour memory is adjusted. In an embodiment of the procedure, the image is processed in the output device in accordance with the profile, i.e. characteristic features of the output device . In an embodiment of the procedure, the automatic image correction function uses information obtained from a standard observer. The observer is shown different images, of which he/she selects a preferred image, based on certain criteria. In an embodiment of the procedure, output device-specific correction is carried out after automatic classification and correction. In the following, the invention will be described in detail by the aid of embodiment examples by referring to the attached drawing, in which Fig. 1 represents an embodiment of the image processing system of the invention, Fig. 2 presents a block diagram representing the operation of a classifying device 3 comprised in the system of the invention, and Fig. 3 presents a block diagram representing the operation of an image processing device 2b comprised in the system of the invention. Fig. presents an image processing system ac- cording to present invention, in which three different image processing devices 2 are connected to a data communication network 1. Image processing device 2a is a device that receives the image from the data communication network 1, corrects the image as necessary and sends the image back into the system. Image processing device 2a comprises a classifying device 3 which classifies the image according to its properties. Object classification has been developed because the objects in different images require different col- our rendering and some colours are so-called memory colours. A prototype for this classification is the identification of a person's complexion and the ad- justment of the complexion to a preselected colour. Skin identification is performed using automatic sectioning in which image areas are selected based on a classification of the chromaticity coordinates for the human skin. In the classification, visual chromaticity coordinates are used and the skin colours have been measured from a large number of images taught to the system. Device 2a also comprises a correcting device 4 for automatic correction of the image. This automatic image correction improves the quality of all types of image. The correction is based on a computer that has been taught to recognise human preferences regarding visual colour rendering. The image parameters to be corrected are grey shade balance, presentation of lo- cal and overall shades, sharpness and noise. Target values for grey shade balance and image sharpness are relatively easy to find. When colour is involved, the situation becomes more complicated. By investigating, an agreement between different people regarding the best manner of representation of colour images has been achieved. Based on this agreement, the properties of a digitised image can be inferred with a certain accuracy from the colours measured from a picture. Automatic colour correction has been taught to a com- puter by showing several thousand test pictures to a hundred test persons. Automatic classification and correction can be incorporated in a standard word processing, page editor or image processing programme. This supports a working mode in which the author of a document fetches images from a data communication network or inputs them from an electronic camera or picture recorder independently. Image processing device 2b presents the image on a display terminal . Image processing device 2b also comprises a classifying de- vice 3 and a correcting device 4. Image processing device 2c prints the image on paper. The image processing device also comprises a classifying device 3 and a correcting device 4. An input device 6 feeds the image, digitised in an electronic form of representation, into the system. The input device 6 comprises a classifying device 3, which classifies the image. The system may also receive pictures from other sources in addition to the input device 6 because the data communication network 1 is not necessarily a small limited network. In the first block 6 in the functional block diagram in Fig. 2, the quality of the image fed in is measured using certain given parameters . At the same time, information about the image quality is added to the signal section comprised in the image code. In the next stage, block 7, the details of the image are identified and make-up instructions for local colours are registered in the signal section. After this, block 8, the main motif of the image is identified and instructions for colour make-up is added to the signal section of the image. Blocks 9 and 10 represent the final image, which comprises the image code itself, block 9, and the signal section of the image, block 10. In Fig. 3, the image code is examined, block 11, according to the functional block diagram to es- tablish whether it comprises a signal section. If a signal section is found, then image correction is performed based on the signal section, block 12, and if no signal section is found, then correction is performed automatically without additional information, i.e. operation proceeds to block 13, where the correction is carried out. After this alternative operation, the image code is passed on to device-specific treatment, in this case display terminal-specific treatment, block 14. Finally, the image code is displayed as a visual image on the display terminal, block 15. The image processing consists of image classification and automatic correction. In the course of time, a classification algorithm has been developed for automatic determination of image quality, dynamic range, MTF (modulation transfer function) and noise. The algorithm determines by a computational method whether the image quality is sufficient or insufficient for further processing. The quality classification algorithm is based on the assumption that the digitised image contains gradual distortions and uniform areas. The MTF is calculated from the distortion and noise of a uniform area. A good correlation between these values and the sharpness and noise of the visual image can be achieved. In the system, each display terminal and printer knows its own correction profile. In the case of a printer, the correction profile, in addition to being dependent on the printer itself, also depends on the toner and paper used in the printer. The invention is not restricted to the examples of its embodiments described above, but many variations are possible within the scope of the inventive idea defined by the claims.

Claims: CLAIMS 1. Image processing system, comprising: - a data communication network (1) , over which the image being processed is transmitted, said image being digitised in an electronic form of representation, and which connects a device comprised in the system; an image processing device (2; 2a, 2b, 2c), which is connected to the data communication network (1) and which processes the image to enhance its visu- al quality and/or prints the image to different formats, characterised in that the image processing system comprises a classifying device (3) for automatic classification of the image and/or a correcting device (4) for automatic correction of the image. 2. Image processing system as defined in claim 2, characterised in that the image processing system comprises a profile generating device (5) , which has been arranged to process the image on the basis of device-specific properties. 3. Image processing system as defined in claim 1 or 2 , characterised in that the classifying device (3) has been arranged to add information code to the image, said information code comprising information about image correction, exposure con- ditions, motif of the image, time when the picture was taken and/or equivalent. 4. Image processing system as defined in any one of claims 1 - 3, characterised in that the image is in a digital form in the image processing system. 5. Procedure for image processing, in which an image digitised in an electronic form of representation is transmitted in a data communication network, the image is processed to enhance its visual quality and/or printed to different formats, characterised in that the image is automatically classified on the basis of additional information comprised in the image and that the image is automatically corrected as necessary. 6. Procedure as defined in claim 5, char- acterised in that a signal section is added to the image code by means of an adding device comprised in the image processing system, said signal section containing information about image correction, exposure conditions, motif of the image, time when the picture was taken and/or equivalent. 7. Procedure as defined in claim 5 or 6, characterised in that the automatic correction of the image comprises identifying edge areas in the image; performing gamma correction of the image; adjusting the grey shade balance of the image; adjusting the brightness of the image; adjusting the RGB contrast of the image; enhancing the sharpness of the image; filtering the noise of the image; and performing colour memory adjustment of the image. 8. Procedure as defined in any one of claims 5 - 7, characterised in that the image is processed in an output device on the basis of the characteristic features of the output device. 9. Procedure as defined in any one of claims 5 - 8, characterised in that, in the automatic correction, information obtained from a test observer is used. 10. Procedure as defined in any one of claims 5 - 9, characterised in that the output device-specific correction is performed after the automatic classification and correction.

Inventors: SAARELMA HANNU, SAARELMA, HANNU
Applicants: GRAAFISEN TEOLLISUUDEN TUTKIMU, SAARELMA HANNU, GRAAFISEN TEOLLISUUDEN TUTKIMUSAEAETIOE, SAARELMA, HANNU
Application year: 1997
Main classification: G06T5
IPC codes: B41J21, B41J29, G06F3, G06T1, G06T5, G06T11, H04N1