Method of and apparatus for processing image data

Abstract: Mask size data M and a sharpness enhancement coefficient K are set in accordance with the pixel density of image data S ij * to be outputted. The image data S ij * is determined as S ij * = S ij + K·(S ij - U ij ) using the mask size data M and the sharpness enhancement coefficient K, wherein the smoothed image data U ij is defined by the following equation: [where L = (M-1)/2 ]

Description: Field of the Invention: The present invention relates to a method of and an apparatus for processing image data, wherein when image data to be outputted is processed for smoothing or enhancement of sharpness, the same result of processing can be obtained at all times without depending on the pixel density, by processing the image data based on the pixel density of the outputted image data. Description of the Related Art: A system is known which causes an optical system to read image information of a copy or subject to thereby produce image data and subjects the produced image data to various image processes so as to be outputted to a printer or the like. This type of system is widely used in the printing and platemaking fields in particular. Now, a personal computer, a work station, etc. have rapidly been advanced in recent years and has come to deal even with image data. For example, characters and images have conventionally been cut and patched up by hand to produce a copy. However, DTP (Desk Top Publishing) has recently been widespread which transfers image information from an image information input/output device to a work station to thereby compose the transferred image information thereat. In particular, a composing process in the printing field is effected by a composing system using the work station or the like or by a total scanner or the like. It is sometimes necessary to effect the conversion of the pixel density of image data which is an object to be processed between the image information input/output device and the work station or the like when the work station or the like is used. That is, a pixel density treatable by the image information input/output device and a pixel density treatable by the work station or the like are normally different from each other. It is therefore necessary to adjust these pixel densities. On the other hand, the input/output device referred to above sometimes processes the image data for smoothing and enhancement of sharpness. Thus, when the conversion of the pixel density is effected upon processing of the image data for smoothing and enhancement of sharpness, this results in different processes. From GB-A-2134352 a method for emphasizing sharpness upon scanning and recording a picture is known, whereby sharpness and enhanced image data are produced according the formula S + k (S - U), whereby S are original image data, U is an unsharp signal obtained by summing and averaging a plurality of picture element signals and k is a predetermined sharpness enhancement coefficient. In "Frontiers of Engineering and Computing in Health Care, 1983", proceedings of the fifth annual conference, September 10, 1983, Columbus, Ohio, U.S. A., page 161 to 165, R. Gordon and R. N. Rangayyan, "Radiographic Feature Enhancement, Information Content, and Dose Reduction in Mammography and Cardiac Angiography", an adaptive neighborhood operation is described for contrast enhancement. In order to achieve maximum contrast for a given fixed image, for each pixel the optimum matrix size comprising a varying number of surrounding scanning points is selected in accordance with the size of the detail present on the original image at this location. It is therefore an object of the present invention to provide a method and an apparatus for processing image data, wherein when image data to be output is processed for smoothing and enhancement of sharpness, the same result of processing can be obtained at all times without depending on the pixel density of the image data. The object is achieved by the method of appended claim 1 and the system of appended claim 7. The above and other objects, features and advantages of the present invention will become apparent from the following description and the appended claims, taken in conjunction with the accompanying drawings in which a preferred embodiment of the present invention is shown by way of illustrative example. FIG. 1 is a schematic block diagram showing the structure of an image data processing apparatus according to one embodiment of the present invention; FIG. 2 is a detailed block diagram illustrating the structure of a sharpness enhancement processing circuit of the image data processing apparatus shown in FIG. 1; FIG. 3 is a detailed block diagram depicting the structure of an auxiliary-scanning direction adding unit of the sharpness enhancement processing circuit shown in FIG. 2; FIG. 4 is a view for describing a data table stored in a storage unit of the sharpness enhancement processing circuit shown in FIG. 2; FIG. 5 is a view for describing the relationship between mask size data and sharpness enhancement coefficients shown in FIG. 4; FIG. 6 is a view for describing image data at respective points in the auxiliary-scanning direction adding unit shown in FIG. 3; and FIG. 7 is a view for describing image data processed for enhancement of sharpness. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a block diagram schematically showing the structure of an image data processing apparatus 10 according to one embodiment of the present invention. In the image data processing apparatus 10, an image recorded on a copy or subject 12 which is fed in an auxiliary scanning direction, is scanned or read in a main scanning direction by a CCD 16 via a condenser lens 14. The read image data is subjected to predetermined processing and transferred to a work station or the like. Incidentally, the work station or the like processes the image data for predetermined editing and transmits the same to an output device such as a printer or the like. The image data processing apparatus 10 comprises an A/D converter 18 for converting image data converted into an electrical signal by the CCD 16 into a digital signal, a correction circuit 20 for processing the image data converted into the digital signal for compensation for the dark current caused by the CCD 16, compensation for shading caused by a read optical system, etc., a gradation converter 22 for converting the gradation of the image data, a pixel density converter 24 for converting a pixel density of the image data into a pixel density processable by the work station or the like, a sharpness enhancement processing circuit 26 for processing the image data for enhancement of sharpness, and a pixel density setting unit 28 for setting a desired pixel density and for supplying data about the set pixel density to the pixel density converter 24 and the sharpness enhancement processing circuit 26. Incidentally, the pixel density converter 24 effects pixel density converting processes such as an image data thinning process, an interpolating process, etc. In the sharpness enhancement processing circuit 26, the image data is processed in principle for enhancement of sharpness in the following manner. That is, let's now consider that the image data of the copy 12 comprises m pixels arranged along the main scanning direction and n pixels arranged along the auxiliary scanning direction. Further, the image data corresponding to the respective pixels is represented as S ij (i = 1 ... m, j = 1 ... n). In the sharpness enhancement processing circuit 26, the image data S ij is regarded as the center and M x M (M: mask size data, M ≤ m, n) image data around the image data S ij are taken out along the main and auxiliary scanning directions. The image data thus taken out are the smoothed, thereby producing smoothed image data U ij represented as follows: Next, image data S ij * processed for sharpness enhancement is generated by using the image data S ij , the smoothed image data U ij and a given sharpness enhancement coefficient K as follows: S ij * = S ij + K · (S ij - U ij ) Incidentally, the mask size data may be processed so as to be arranged M in the main scanning direction and N in the auxiliary scanning direction (M ≠ N) upon generation of the image data S ij *. FIG. 2 is a block diagram showing the structure of the sharpness enhancement processing circuit 26. The sharpness enhancement processing circuit 26 comprises a CPU 30 for determining a sharpness enhancement coefficient K and mask size data M based on pixel density data ρ supplied from the pixel density setting unit 28, a storage unit 32 for storing therein the sharpness enhancement coefficient K and the mask size data M determined based on the pixel density data ρ, and a mask size controller 34 for outputting a control signal in response to the mask size data M. Further, the sharpness enhancement processing circuit 26 also includes a plurality of line memories LM1, LM2, ... LMn for storing image data therein for each main scanning line of the original 12, and selectors 36, 38 each used to store image data in a predetermined line memory LMn (n = 1, 2, ...) in response to the control signal supplied from the mask size controller 34 and to select desired image data from the predetermined line memory LMn, an auxiliary-scanning direction adding unit 40 and a main-scanning direction adding unit 42 for adding image data in the auxiliary and main scanning directions respectively to thereby generate smoothed image data U ij , a multiplier 43 for multiplying image data S ij outputted from the selector 38 by the square of the mask size data M, an adder 44 for adding the smoothed image data U ij outputted from the main-scanning direction adding unit 42 and whose sign is inverted to data outputted from the multiplier 43, a storage unit 46 for storing a table indicative of preset image data therein, selecting predetermined image data based on the sharpness enhancement coefficient K determined by the CPU 30 and the image data outputted from the adder 44, and outputting the same therefrom, a divider 47 for dividing the image data outputted from the storage unit 46 by the square of the mask size data M determined by the CPU 30, and an adder 48 for adding image data outputted from the divider 47 to the image data S ij outputted from the selector 38. Here, the adder 48 outputs S ij * and supplies it to the work station or the like. FIG. 3 shows the configuration of the auxiliary-scanning direction adding unit 40. The auxiliary-scanning direction adding unit 40 comprises a line memory LM for storing image data supplied from the line memories LM1 through LMn as image data fed in the auxiliary scanning direction, a subtractor 50 for subtracting image data outputted from the line memory LM and whose given number of pixels is shifted, from the image data outputted from the line memories LM1 through LMn, a register 52 for temporarily storing therein image data to be outputted to the main scanning direction adding unit 42, and an adder 54 for adding the output of the subtractor 50 to the output of the register 52 so as to re-output the result of addition to the register 52. On the other hand, the main-scanning direction adding unit 42 is constructed such that a shift register is used as an alternative to the line memory LM of the auxiliary-scanning direction adding unit 40. Other elements of structure are identical to those employed in the auxiliary-scanning direction adding unit 40, and their description will therefore be omitted. The image data processing apparatus 10 according to the present embodiment is basically constructed as described above. The operation of the image data processing apparatus 10 will now be described below. Image information which has been recorded on the copy 12, is first read by the CCD 16 using the condenser lens 14. The read image information is then converted into an analog signal. The converted analog signal is converted into image data serving as a digital signal by the A/D converter 18, followed by transfer to the correction circuit 20. The correction circuit 20 processes the image data for the correction relative to the dark current caused by the CCD 16, the correction of shading caused by the read optical system, etc. The gradation of the image data which has been subjected to the above processing, is converted into desired gradation in the gradation converter 22. Thereafter, the pixel density converter 24 converts the pixel density of the image data into a pixel density treatable by an external work station or the like for effecting an editing process of the image data. Here, the pixel density converter 24 performs pixel density converting processes such as a thinning process (reduction), a linear interpolating process, an Hermite interpolating process (enlargement), etc. on the image data based on the pixel density data ρ outputted from the pixel density setting unit 28. Next, the sharpness enhancement processing circuit 26 processes the image data subjected to the pixel density conversion for enhancement of sharpness. This process will be described in accordance with circuits shown in FIGS. 2 and 3. The CPU 30 first reads corresponding mask size data M and a corresponding sharpness enhancement coefficient K from the storage unit 32 in response to the pixel density data ρ supplied from the pixel density setting unit 28. FIG. 4 shows a data table which has been stored in the storage unit 32. In FIG. 4, for example, 12 lines/mm represent pixel density data ρ in the case where an image is made up of 12 scanning lines per mm. The mask size data M for generating smoothed image data U, with respect to the pixel density data ρ is set to 3. In this case, the size of one pixel is: 1/12 mm ≃ 83 µm Therefore, an output image range for producing the smoothed image data U is: 83 x 3 µm = 249 µm Similarly, mask size data M with respect to other pixel density data ρ are set in such a manner that the output image range falls between 200 µm and 250 µm. That is, the mask size data M is set so as to be substantially proportional to the pixel density data ρ. Thus, the output image range for generating the smoothed image data U is set so as to be substantially constant in the range of 200 µm to 250 µm. Therefore, a process for obtaining image data S* processed for sharpness enhancement in accordance with the equation (2) can be effected within the same output image range. Accordingly, the same result of processing can be obtained irrespective of the pixel density. Incidentally, the range of 200 µm to 250 µm represents the optimum range judging from visual characteristics of a human being. FIG. 5 is a graph for describing the relationship between the mask size data M and the sharpness enhancement coefficient K. This graph shows the relationship between the mask size data M and the sharpness enhancement coefficient K for obtaining a sharpness enhancing process equivalent to that in the case where the mask size data M is set to 11 (M = 11) and the sharpness enhancement coefficient K is set to 1 (K = 1). Thus, the sharpness enhancing process depends on the sharpness enhancement coefficient K as well as the mask size data M. The relationship between the pixel density data ρ, the mask size data M and the sharpness enhancement coefficient K is shown in the data table of FIG. 4. The mask size data M which has been read from the storage unit 32 by the CPU 30, is supplied to the mask size controller 34 and the sharpness enhancement coefficient K is supplied to the storage unit 46. In this case, the pixel density, the mask size data M and the sharpness enhancement coefficient K will be described below as being 12 lines/mm, 3 and 6, for example, respectively. The mask size controller 34 first controls the selector 36 so as to successively connect the pixel density converter 24 (FIG. 1) to the three line memories LM1 through LM3 (because M = 3). Thus, the image data outputted from the pixel density converter 24 is stored in each of the line memories LM1 through LM3 for each main scanning line. The mask size controller 34 then controls the selector 38 so as to successively output image data to the auxiliary-scanning direction adding unit 40 from the respective line memories LM1 through LM3 and so as to output the central image data S ij for producing the image data S ij * to the adders 44, 48 to be described later. The auxiliary-scanning direction adding unit 40 reads image data, at the same main scanning positions, of the line memories LM1 through LM3 in the auxiliary scanning direction. Then, the read image data are successively stored in the line memory LM as image data arranged in the auxiliary scanning direction and supplied to the subtractor 50 in succession. In response to the control signal outputted from the mask size controller 34, the line memory LM delays the image data a time interval corresponding to three pixels because the mask size data M is 3, and outputs the delayed image data to the subtractor 50. The output of the subtractor 50 is supplied to the register 52 via the adder 54 and added to the adder 54 again. FIG. 6 shows image data at respective points (A through E) in the auxiliary-scanning direction adding unit 40 at the time that the column of image data in the main scanning direction, which are supplied from the selector 38, is represented by a through i . Incidentally, a , b , c , ... are expressed by the following equations respectively: a = [S i-1,1 , S i-1,2 , ... S i-1,j , ... S i-1 ] b = [S i,1 , S i,2 , ... S i,j , ... S i,n ] c = [S i+1,1 , S i+1,2 , ... S i+1,j , ... S i+1,n ] Here, the main-scanning direction adding unit 42 is supplied with the image data at the point E. Thus, an image data column T i * is outputted from the auxiliary-scanning direction adding unit 40 in accordance with the relationship shown in FIG. 6 assuming that image data S i-1j-1 through S i+1j+1 are arranged as shown in FIG. 7. The image data column T i * is expressed as follows: T i * = a + b + c = [(S i-1,1 + S i,1 + S i+1,1 ), ..., (S i-1,n + S i,j + S i+1,j ), ..., (S i-1,n + S i,n + S i+1,n )] = [T i1 *, T i2 *, ... T ij *, ... T in *] where T ij * = (S i-1j + S ij + S i+1j ) Similarly, in the main-scanning direction adding unit 42, image data T ij added together within a mask, i.e., in-mask added image data T ij is determined by effecting serial-parallel conversion using a shift register as an alternative to the line memory LM of the auxiliary-scanning direction adding unit 40 and adding the image data T ij * in the main scanning direction. The image data T ij is expressed as follows: T ij = (T ij-1 * + T ij * + T ij+1 *) Incidentally, the relationship between the smoothed image data U ij determined from the equation (1) and the in-mask added image data T ij is derived as follows: T ij = M 2 U ij The in-mask added image data T ij is then inverted. Thereafter, the adder 44 adds (actually subtracts the image data T ij from data obtained by multiplying the image data S ij supplied from the selector 38 to the multiplier 43 by M 2 in the multiplier 43) the image data T ij to the data thus obtained, and supplies the added data to the storage unit 46. In the storage unit 46, data K·(M 2 ·S-T) is determined from the data supplied from the adder 44 and the sharpness enhancement coefficient K supplied from the CPU 30, and supplied to the divider 47. In the divider 47, the data is divided by the data M 2 supplied from the CPU 30, and the so-divided data is applied to the adder 48. Further, the adder 48 adds the image data S ij to the divided data so as to produce the image data S ij * represented by the equation (2). Incidentally, the accuracy of calculation can be improved by using the image data T ij defined as the equation (10) as an alternative to the smoothed image data U ij defined as the equation (1). The image data S ij * is outputted to the work station or the like, where it is subjected to a desired editing process. Here, the image data S ij * has been processed for enhancement of sharpness according to the pixel density treatable by the work station or the like. Therefore, the degree of the sharpness enhancement with respect to an image is not affected by the pixel density, and the same sharpness enhancement can be achieved at all times. Incidentally, a description has been made of the sharpness enhancing process in the present embodiment. However, the present embodiment can bring about the same effects even when a smoothing process (a process for obtaining the smoothed image data U) is carried out. According to the present invention, as has been described above, the area of image data which is of an object of either a smoothing process or a sharpness enhancing process, is set up according to the pixel density of output image data. Further, a sharpness enhancement coefficient is also set up as required. Therefore, image data which has been subjected to a given process, can be obtained without depending on the pixel density.

Claims: A method of processing digital image data and output in a predetermined pixel density applying to the overall image, comprising the steps of: converting the image data from a first pixel density to a second pixel density for the overall image; setting a pixel area for the overall image said pixel area being substantially proportional to the second pixel density; retrieving, along with image data S for a given pixel, image data for any surrounding pixels that are adjacent to the given pixel and that fall within the set area; for the given pixel, processing said image data S for smoothness to produce smoothed image data U, by performing a smoothing operation on the retrieved data using said image data of said surrounding pixels falling within said pixel area; and for the given pixel, producing sharpness-enhanced image data S* represented as S* = S + K (S - U), using said image data S, said smoothed image data U and a predetermined sharpness enhancement coefficient K. Method according to claim 1, characterized in that said area represented by M is set so as to meet the following equation: (1/ρ) · M ≅ (C: constant value) where ρ = predetermined pixel density of the data to be smoothed M = mask size substantially proportional to the predetermined pixel density. Method according to claim 2, characterized in that said constant value C is set so as to fail within a range of 200 µm to 250 µm. Method according to claim 1, characterized in that said sharpness enhancement coefficient K is set depending on the range of said surrounding image data. Method according to claim 4, characterized in that the relationship between said sharpness enhancement coefficient K and said range M is set in accordance with a curve which passes through in the vicinity of points (K,M) = (6, 3), (2.5, 5), (1.5, 7), (1,11). Method according to claim 1, characterized in that image data S ij (i = 1, ... m, j = 1, ... n) is converted into smoothed image data U ij processed as defined by the following equation using M x N surrounding image data set by mask size data M, N each substantially proportional to the pixel density Image data processing system performing smoothing and sharpness enhancement processing on image data and output in a predetermined pixel density applying to the overall image, comprising: a pixel density converter (24) that converts the image data from a first pixel density to a second pixel density for the overall image; and a sharpness enhancement processing circuit (26) which comprises: range setting means (30) for setting a pixel area of surrounding image data, which surrounds a given pixel, so as to be substantially proportional to said second pixel density; smoothed image data generating means (LM1-LMn,38,40,42,47) for processing image data S of said given pixel for smoothness, using said surrounding image data falling within the area set by said range setting means, to thereby produce smoothed image data U for said given pixel; and image data generating means (44,46,48) for generating sharpness enhanced image data S* for the given pixel, defined as S* = S + K(S-U) using said image data S, said smoothed image data U and a predetermined sharpness enhancement coefficient K. Image data processing system according to claim 7, characterized in that the area of said surrounding image data and said sharpness enhancement coefficient K are set in a look-up table (32) corresponding to the pixel density. Image data processing system according to claim 7, characterized in that said smoothed image data generating means comprises a plurality of storing means (LM1∼LMn) for storing therein image data as line data arranged in a main scanning direction, selecting means (38) for selecting image data arranged in the main scanning direction and an auxiliary scanning direction corresponding to the range of said surrounding image data from said storing means, adding means (40,42) for adding said selected image data together, and dividing means (47) for dividing said added image data by the number of said selected image data.

Inventors: INOUE YOSHIAKI, INOUE, YOSHIAKI, INOUE, YOSHIAKI, C/O FUJI PHOTO FILM CO., LTD.
Applicants: FUJI PHOTO FILM CO LTD, FUJI PHOTO FILM CO., LTD.
Application year: 1992
Main classification: G06T5
IPC codes: H04N1, G06T5