Image processing system

Abstract: An image processing system obtains a binary signal from a multi-level signal read by an image scanner from an original document including mixed characters, ruled lines, and photos, and then produces a reproduced image from the binary signal. The image processing system includes: a fixed slice processing unit (1) for receiving the multi-level signal, and for slicing the multi-level signal by a predetermined fixed threshold level, and outputting the binary signal sliced by the fixed theshold level; a half-tone processing unit (2) for receiving the multi-level signal, and for slicing the multi-level signal by a plurality of threshold levels defined by a dither method, and outputting the binary signal sliced by the plural threshold levels defined by the dither method; a character-photo separating unit (3) for receiving the multi-level signal; and for detecting a pattern of the multi-level signal, separating either a character portion or photo portion based on the pattern, and outputting a selection signal; and, a selection unit (4) for selecting either the fixed slice processing unit or the half-tone processing unit based on the selection signal from the character/photo separating unit (3).

Description: The present invention relates to an image processing system enabling clear reproduction of an original document including mixed characters, ruled lines, and photos. The characters, ruled lines, and photos in the original document are scanned by an image scanner and a scanned image is converted to a multi-level signal and further converted to a binary signal. The original document is clearly reproduced based on processing of the binary signal according to the present invention. Image processing systems are widely used in the field of information processing systems. In image processing, a character can be easily converted to a binary signal based on a predetermined threshold level because the contrast of light and shade thereof is very clear. That is, for example, when the character portion (black portion) is a value "1", the remaining portion (white portion is a value "0". Accordingly, when all areas of the document comprise only characters, the image processing of the original document is very easy. When characters, ruled lines, and photos are mixed on one sheet of the original document, the image processing thereof is very troublesome because the photos contain half-tone colors such as gray colors so that the multi-level signal includes gray color areas, and fine lines of characters or ruled lines also become gray. One known method for processing half-tone colors is called "dithering". In the dither method, the light and shade level of each pixel of the original image are compared with a plurality of threshold levels (variable threshold level), and ON/OFF of the display elements are determined based on the resultant data after comparison. In this case, each of threshold levels is selected at random at every pixel by using, for example, a table of random numbers. Japanese Unexamined Patent Publication (Kokai) No. JP-A-58-003374 discloses a method for processing a half-tone colour based on the density level of the black pixel. That is, this method includes steps for dividing the original image into a plurality of blocks, and for obtaining the difference between a maximum density level and a minimum density level in each block. When the difference value is larger than a pre-determined threshold level, the area of such a block is binary-coded by a constant threshold level as a binary image area. When the difference value is smaller than a pre-determined threshold level, this area is binary-coded by dithering as a half-tone area. Japanese Unexamined Patent Publication (Kokai) No. JP-A-60196068 discloses a method for determining either the binary image area or the half-tone area. This method includes the steps for binary-coding of the scanned data based on a plurality of threshold levels, for counting the number of the values "0" and "1" in each threshold level, for comparing the counted numbers with each threshold level, and for detecting a change of the counted numbers by comparing them with a previous number. Whether the binary image area or the half-tone image area is to be selected is determined from this change of the counted numbers. GB-A-2 170 372 discriminates between a character and a photo portion of image data by comparing a local density gradient with a threshold value. EP-A-0 055 835 carries out the discrimination by using gradient information, a count of pixels having neither black nor white density levels, and look- a head information as the forth coming white and black levels. The object of the present invention is to provide an image processing system enabling clear reproduction of an original document including mixed characters, ruled lines, and photos. In accordance with the present invention, there is provided an image processing system for obtaining a binary signal from a multi-level signal read by an image scanner from an original document including mixed characters, ruled lines, and photos, and then obtaining a reproduced image from said binary signal, said image processing system comprising: a fixed slice processing means for receiving said multi-level signal, and for slicing said multi-level signal by comparison with a first pre-determined fixed threshold level, and outputting a first binary signal, said first binary signal being determined by the comparison; a half-tone processing means receiving said multi-level signal, and for slicing said multi-level signal by comparison with a plurality of threshold levels defined by a dither method, and outputting a second binary signal, said second binary signal being determined by the comparison by said dither method; a character/photo separating means for discriminating between characters, ruled lines and photo portions of the image read by the scanner by detecting a pattern of said image from said multi-level signal, said character/photo separating means comprising a successive grey colour detection circuit, a successive black colour detection circuit and a fine line detection circuit, the successive grey colour detection circuit comparing the value of successive multi-level picture elements with a second pre-determined fixed threshold level, and detecting the number of successive comparisons giving the same result to indicate a photo portion of said image when the number exceeds a third pre-determined threshold level, the fine line detection circuit detecting a change of value of said multi-levels signal of picture elements adjacent to a picture element of interest to indicate a fine line portion when the difference gradient of the picture elements exceeds a fourth pre-determined threshold level and the successive black colour detection circuit comparing the value of successive multi-level picture elements with a fifth pre-determined fixed threshold level set in the region of a level corresponding to a black colour, and detecting the number of successive comparisons giving the same result to indicate a thick character portion when the number exceeds a sixth pre-determined threshold level; and, a selection means which selects the first binary signals as said binary signal when a non-photo portion, fine line or thick character portion is detected by the character/photo separating means, and which selects the second binary signal as said binary signal when a photo portion is detected, and a fine line and thick character portion are not detected. In the drawings: Fig. 1 is a schematic block diagram of a general image processing system; Fig. 2 is a schematic block diagram of a conventional image processing system; Fig. 3A is a view for explaining an original document including characters, photos, and ruled lines; Fig. 3B is a view for explaining a multi-level signal including characters and photos; Fig. 4 is a schematic block diagram of an image processing system according to the present invention; Figs. 5A, 5B and 5C are views for explaining a slicing states of a multi-level signal including characters and photos; Fig. 6 is a schematic block diagram of a fine line detection circuit according to the present invention; Fig. 7 is a schematic block diagram of a successive gray colour detection circuit according to the present invention; Fig. 8 is a schematic block diagram of an image processing system according to an embodiment of the present invention; Figs. 9A, 9B and 9C are views for explaining slicing states of a multi-level signal including ruled lines, photos, thick characters, and fine line characters; and Fig. 10 is one embodiment of a successive black colour detection circuit of Fig. 8. Before describing the preferred embodiments, problems in a conventional method are explained below in detail. Figure 1 is a schematic block diagram of a general image processing system. In Fig. 1, reference number 100 denotes an original image of a document to be scanned, 101 an image scanner, 102 a personal computer with a display (CRT), 103 a laser printer and 104 an image reproduced by the printer. The original image includes characters, ruled lines, and photos. They are scanned by the image scanner 101 and converted to a multi-level signal and then converted to a binary signal having values of "0" or "1". The binary signal is input into the personal computer 102 and printed by the laser printer 103 so that the original image can be reproduced. In this case, the scanned multi-level signal of the character portions of the original image 100 is binary-coded by the image scanner 101 based on a fixed slice level method having a step in which the multi-level signal is binary coded by a predetermined fixed threshold level. Further, the multi-level signal of the photo portions of the original image is binary-coded by the half-tone processing method based on dithering for binary coding the multi-level signal based on a predetermined dither pattern. As explained above, the character and the photo portions are separately binary-coded by using the fixed slice level method and the half-tone processing method (dithering). This reason is explained as follows. That is, when both characters and photo are simultaneously binary-coded by the predetermined fixed threshold level, the photo portions cannot be clearly reproduced since the photo portions contain half-tone colors. In contrast, when both characters and photos are simultaneously binary-coded by dithering, the character portions cannot be clearly reproduced since the character portions comprise only two colors such as black and white colors. In general, the photo portion has a tone gradation in half-tone colors. The gradation is expressed by a concentration of black dots. Figure 2 is a schematic block diagram of a conventional image processing system. This system is disclosed in Japanese Unexamined Patent Publication (Kokai) No. JP-A-61221886. In Fig. 2, reference letter A denotes a dither processing means, B a multi-level signal processing means, C a separation means and D a selection means. The dither processing means A produces a dither value from the multi-gradation data of each pixel of the image including characters and photos. The multi-level signal processing means B produces multi-level data after comparing the multi-gradation data with at least two thresholds. The separation means C separates each block of the image in accordance with either a binary image area or a half-tone image area. The selection means D selects the dither processing means A or the multi-level signal processing means B based on the resultant data from the separation means C. The conventional system utilizes the characteristic by which the density gradation of the edge of the character is sharpened compared with that of the half-tone. Accordingly, each block of the image is separated based on the change of the density gradation of the edge as to whether the binary image area or the half-tone image area is detected. However, when fine ruled lines are mixed among the character portions and the photo portions in the original image, these fine lines are not clearly reproduced as with the ruled lines in the above conventional system. This problem is explained below in detail. Figures 3A is a view for explaining an original document including characters, photos, and ruled lines. Figure 3B is a view for explaining the multi-level signal scanned along an arrow line shown in Fig. 3A. In Fig. 3A, 110 denotes an original image, and RL a ruled line. In this case, when the character portions C are binary-coded by the fixed slice level after converting to the multi-level signal, peak/valley portions thereof are clearly obtained. However, the ruled line and the photo portions P become unclear when using this fixed slice level because the multi-level signal MS of the photo portion includes gray colors. In contrast, when the photo portions are binary-coded by dithering, the character portions become unclear. Further, since the line width of the ruled line is very fine compared with that of one scan line of the image scanner, the image scanner cannot separate the ruled line. An image processing system according to the present invention is explained in detail hereinafter. Figure 4 is a schematic block diagram of an image processing system according to the present invention. In Fig.4, reference number 1 denotes a fixed slice level processing circuit, 2 a half-tone processing circuit, 3 a character/photo separation circuit, and 4 a selection circuit. Further, FSS denotes a fixed slice signal, HTS denotes a half-tone signal, and MS denotes a multi-level signal, for example, sixty-four levels (values) indicating the density gradation of the color of the image. In Fig. 4, the multi-level signal MS is input in parallel to the circuits 1 to 3. The outputs of the circuits 1 and 2, i.e., the fixed slice signal FSS and the half-tone signal HTS, are input to the circuit 4. The circuit 3 separates from the multi-level signal MS information as to whether the multi-level signal indicates a character portion or a photo portion. In the selection circuit 4, when the circuit 3 detects a character portion, the fixed slice signal FSS is selected. When the circuit 3 detects a photo portion, the half-tone signal HTS is selected. Figures 5A, 5B and 5C are views for explaining a slicing state of the multi-level signal including characters and photos. Reference C is a character portion, and P a photo portion. Further, Th 0 denotes a threshold level, and MS the multi-level signal. As shown in the drawing, the multi-level signal MS includes the gray colors in the photo portion P, and denotes clear white and black colors in the character portion C. When the multi-level signal MS is sliced by the threshold level Th 0 which level is set in the neighbourhood of the white level, the resultant data is obtained as shown in Fig. 5B. In this case, the value "0" is continued during the term T in the photo portion P, but "0" and "1" are repeated at every cycle "t" in the character portion C. In the present invention, when the number of "0's" which occur in succession exceeds a predetermined reference value "LH", this portion is determined as the photo portion P so that the half-tone signal HTS of Fig. 4 is selected as the half-tone image portion. Accordingly, when the number of "0's" does not exceed the pre-determined reference value "LH" this portion is determined as the character portion so that the fixed slice signal FSS is selected. Further, when a character is written by fine lines, the multi-level signal MS is shown by Fig. 5C (see Fig. 9C). In this case, when the multi-level signal MS is sliced by the threshold level Th 0 , the character portion C is incorrectly determined as a photo portion if the number of "0's" exceeds the reference value "LH". Accordingly, a fine line detection circuit is provided in the system to avoid the above mis-judgement. Further, when a character is written by a thick line, the multi-level is as shown in Figure 9A. In this case, the threshold Th 0 is sliced by the multi-level signal MS, and the character BC is incorrectly determined as a photo portion where the number of consecutive "0's" exceeds LH. Accordingly, a successive black colour detection circuit is provided to identify thick line portions. Figure 6 is a schematic block diagram of a fine line detection circuit according to the present invention. This circuit is included in the character/photo separation circuit 3 in Fig. 4. In Fig. 6, M denotes a multi-level signal holding block, 21 and 22 shift registers, 23 a read only memory (ROM), and 24 a register group. References X 1 to X 8 and S 0 denote pixels each constituted by the multi-level signal. S 0 is a center pixel of this block. The fine line detection circuit is constituted by a differential circuit which detects a change of the light and shade of adjacent vertical and horizontal pixels relative to the center pixel. The differential circuit includes a primary differential circuit (ROM 23) and a secondary differential circuit (ROM 23'). In these circuits, the primary differential value Y 1 and the secondary differential value Y 2 are given as follows. Y 1 = S 0 - 1/4 (X 2 + X 4 + X 6 + X 8 ) Y 2 = | X 6 - X 2 | + | X 8 - X 4 | Accordingly, to calculate the above formulas, first, the multi-level signals X 4 , S 0 and X 8 (line Ln) are sent to the shift register 21, and then the multi-level signals X 5 , X 6 , and X 7 (line Ln+1) are sent to the shift register 21. At the same time, the line Ln previously stored in the shift register 21 is shifted to the shift register 22. Further, the multi-level signals X 1 , X 2 and X 3 (line Ln-1) are sent directly to the register group 24. As a result, a 3 x 3 matrix is obtained in the register group 24. Each of the multi-level signals X 2 , X 4 , X 6 , X 8 , and S 0 is extracted from the register group 24 and input to the ROM 23 for calculating the formula (1). The ROM 23 has the function that the value "1" is output therefrom when the primary differential value Y 1 is equal to or larger than a threshold level Yh. Similarly, each of the multi-level signals X 2 , X 4 , X 6 , and X 8 is extracted from the register group 24 and input to the ROM 23' for calculating the formula (2). The ROM 23' has the function that the value "1" is output therefrom when the secondary differential value Y 2 is equal to or larger than a threshold level Yh'. Figure 7 is schematic block diagram of the successive gray color detection circuit according to the present invention. This circuit is also included in the character/photo separation circuit 3 in Fig. 4. This circuit is used for detecting the number of "0's" during the term T in the photo portion of Fig. 5B. In Fig. 7, 21, 22, and 24 are the same elements as that of Fig. 6. Each of pixels X 11 to X 33 corresponds to X 1 to X 8 in Fig. 6. Reference number 31 denotes a comparator, 32 a counter, 33 a flip-flop circuit, 34 an AND gate, and 35 an inverter. First, the threshold level Th 0 and the multi-level signal X 21 of the center line are input into the comparator 31, and the signal X 21 is compared with the threshold level Th 0 so that the binary signal X 21A is output from the comparator 31. The threshold level Th 0 is the same as that of Fig. 5A. The binary signal X 21A is input into the counter 32. The counter 32 is up-counted while the binary signal X 21A has the value "1". Further, a reference value LH and a clock signal CLK are input into the counter 32. The output value "1" of the counter 32 is obtained only when the count number thereof is equal to or larger than the reference value LH. This reference value LH is used for separating either the character or the photo and is previously determined to be larger than the successive number of the binary signal X 21A of a character portion. Accordingly, when the multi-level signals are sequentially input into the comparator 31 in response to the clock signal CLK of the scanning direction, the output binary signal X 21A becomes "1" in succession when photo portions are scanned. The counter 32 is up-counted when the value "1" is input. When the count number of the counter 32 reaches the reference value LH, the counter 32 outputs the value "1". The value "1" from the counter 32 is continued while the binary signal X 21A is the value "1". The value "1" is input to the flip-flop circuit (F/F) 33 and the value "1" is also output from the flip-flop circuit 33. Accordingly, the flip-flop circuit 33 outputs the value "1" in the photo portions. Meanwhile, when the original image is not a photo portion, the binary signal X 21A becomes the value "0" and the value "0" is inverted to the value "1" by the inverter 35. The value "1" from the inverter 35 is input to the clear terminal CL of the counter 32 so that the counter 32 is reset. Further, the flip-flop circuit 33 is also reset when the counter 32 is reset. The clock signal CLK is inverted by the inverter 36 and the inverted clock signal CLK' is input to the flip-flop circuit 33. The ROM 37 constitutes a part of the differential circuit and corresponds to the ROM 23 of the thin line detection circuit in Fig. 6. The ROM 37 includes an inversion function, and outputs the value "1" in case of a photo portion. The output of the ROM is input to the AND gate 34. The output of the AND gate 34 is applied to the selection circuit 4. When the value "1" is applied from the AND gate 34 to the selection circuit 4, the selection circuit 4 selects the half-tone processing circuit 2 in Fig. 4. In contrast, when the value "0" is applied from the AND gate 34 to the selection circuit 4, the selection circuit 4 selects the fixed slice level circuit 1. Figure 8 is a schematic block diagram of the image processing system according to the present invention. In Fig. 8, the character/photo separation circuit 3 in Fig. 4 is constituted by the successive gray colour detection circuit 42 (see Fig. 7, upper and central portions), the fine line detection circuit 41 (see Fig. 6) and a successive black colour detection circuit (43), the decision circuit 44 and the inverters 45 and 46. The fixed slice level circuit 1, the half-tone processing circuit 2 and the selection circuit 4 are the same as that of Fig. 4. The successive gray colour detection circuit 42 is mainly constituted by the counter 32 and the flip-flop circuit 33 in Fig. 7 and detects the photo portions in the original images. The fine line detection circuit 41 is mainly constituted by the ROM 23 in Fig. 6 and detects either the character portion or the ruled line from the multi-level signal. The successive black colour detection circuit 43 is shown in Fig. 10, in which reference number 51 denotes a comparator, 52 a counter, 53 a flip-flop circuit, and 54, 55 inverters. The comparator 51 compares the multi-level signal X 21 with the threshold level Th 1 . When the multi-level signal X 21 is equal to or larger than the threshold level Th 1 (that is, the multi-level signal X 21 is near to the black, the comporator 51 outputs the value "1". The counter 52 counts the number of "1's" which are successively output from the comparator 51. When number of "1's" exceeds the reference value BH, the counter outputs the value "1" and this value is input into the flip-flop circuit 53. The flip-flop circuit 53 outputs the value "1" when the value "1" is input. Meanwhile, when the comparator 51 outputs the value "0", the value "0" is inverted to "1" by the inverter 54 and input to the clear terminal CL of the counter 52. Further, the inverted "1" is also input to the re-set terminal of the flip-flop circuit 53 so that this circuit is re-set. In this case, the reference value BH is smaller than the reference value LH shown in Fig. 7. According to the results of an experiment, the reference value BH is larger than the value 0.3 mm, and the reference value LH is larger than the value 0.5 mm. The decision circuit 44 is mainly constituted by the AND gate 34 and outputs the value "1" as the selection signal SL to the selection circuit 4 when the multi-level signal S 0 indicates a photo portion. The selection circuit 4 selects the half-tone signal HTS from the half-tone processing circuit 2. When the selection signal SL is the value "0", the selection circuit 4 selects the fixed slice signal FSS from the fixed slice level circuit 1. The decision circuit 44 outputs the value "1" when the circuit 43 outputs the value "0" (the inverter 45 outputs the inverted value "1"), providing the circuit 42 outputs the value "1", and providing the circuit 41 outputs the value "0" (the inverter 46 outputs the inverted value "1"). The selection circuit 4 selects the halftone signal HTS of the half-tone processing circuit 2 when the value "1" is input thereinto. In contrast, the selection circuit 4 selects the fixed slice signal FSS of the fixed slice level circuit 1 when the value "0" is input there-into. Figures 9A, 9B and 9C are views for explaining the slicing state of the multi-level signal including ruled lines, photos, thick line characters, and fine line characters. In Fig. 9A, C is a character portion comprised of fine lines, for example, "1111" in Fig. 9C. BC is also a character portion, but comprised of thick lines, for example, "T" in Fig. 9C. RL is the ruled line portion shown in Fig. 9C, and P is the photo portion shown in Fig. 9C. Further, Th 0 denotes the first threshold level, and Th 1 denotes the second threshold level. As shown in the drawing, the multi-level signal MS denotes the gray colour in the portions of the photo P, the ruled line RL, and the fine line characters C. The multi-level signal MS denotes clear white and black colours in the thick line character portion BC. When the multi-level signal MS is sliced by the threshold levels Th 0 and Th 1 , the threshold level Th 0 is set in the neighbourhood of the white level, and the threshold level Th 1 is set in the neighbourhood of the black level. Accordingly, the thick character portion BC is sliced by the threshold level Th 1 and the successive values of "0" can be obtained during the term TB. The thick character portions are detected by the successive black colour detection circuit 43 in Fig. 8.

Claims: An image processing system for obtaining a binary signal from a multi-level signal read by an image scanner from an original document including mixed characters, ruled lines, and photos, and then obtaining a reproduced image from said binary signal, said image processing system comprising: a fixed slice processing means (1) for receiving said multi-level signal, and for slicing said multi-level signal by comparison with a first pre-determined fixed threshold level, and outputting a first binary signal, said first binary signal being determined by the comparison; a half-tone processing means (2) receiving said multi-level signal, and for slicing said multi-level signal by comparison with a plurality of threshold levels defined by a dither method, and outputting a second binary signal, said second binary signal being determined by the comparison by said dither method; a character/photo separating means (3) for discriminating between characters, ruled lines and photo portions of the image read by the scanner by detecting a pattern of said image from said multi-level signal, said character/photo separating means (3) comprising a successive grey colour detection circuit, a successive black colour detection circuit and a fine line detection circuit, the successive grey colour detection circuit comparing the values of successive multi-level picture elements with a second pre-determined fixed threshold level (Th 0 ), and detecting the number of successive comparisons giving the same result to indicate a photo portion of said image when the number exceeds a third pre-determined threshold level (LH), the fine line detection circuit detecting a change of value of said multi-levels signal of picture elements adjacent to a picture element of interest to indicate a fine line portion when the difference gradient (Y 1 , Y 2 ) of the picture elements exceeds a fourth pre-determined threshold level (Y h , Y h ') and the successive black colour detection circuit comparing the value of successive multi-level picture elements with a fifth pre-determined fixed threshold level (Th 1 ) set in the region of a level corresponding to a black colour, and detecting the number of successive comparisons giving the same result to indicate a thick character portion when the number exceeds a sixth pre-determined threshold level (BH) ; and, a selection means (4) which selects the first binary signals as said binary signal when a non-photo portion, fine line or thick character portion is detected by the character/photo separating means (3), and which selects the second binary signal as said binary signal when a photo portion is detected, and a fine line and thick character portion are not detected. An image processing system as claimed in claim 1, wherein said second pre-determined fixed threshold level (Th 0 ) is set in the region of a level corresponding to a white colour.

Inventors: KANEMITSU NORIO, TABATA YOSHIO, WAKABAYASHI MASARU, KANEMITSU, NORIO, TABATA, YOSHIO, WAKABAYASHI, MASARU
Applicants: FUJITSU LTD, PFU LTD, FUJITSU LIMITED, PFU LIMITED
Application year: 1989
Main classification: H04N1
IPC codes: G06K9, G06T5, H04N1