Abstract:
An image processing apparatus including an image reading mechanism, a display, a memory, an image processing mechanism, an image creating mechanism, and a controller. The image processing mechanism performs first and second corrections using the plurality of stepped values. The image creating mechanism creates first and second subtractive images based on a first corrected image corrected by the first correction and a second corrected image corrected by the second correction. The controller controls the display to display the input image, the first corrected image, the final corrected image, the first subtractive image, and the second subtractive image in a screen image. A method of image processing and a computer readable data storing medium storing a program for image processing are also described.

Description:
FIELD OF THE INVENTION 
   The present invention relates to an image processing method and apparatus, and more particularly to an image processing method and apparatus capable of correcting an image with different image density threshold values. The present invention also relates to a computer readable data storing medium storing a program to perform operations of the image processing method. 
   BACKGROUND OF THE INVENTION 
   Discussion of the Background 
   When a double-sided color document is processed with a background color scanner or a background digital color copying machine, an image on the back surface of the document is often transferred to a resultant image. This is called a back-image transfer problem. 
   One attempt to correct an image having a background image transfer problem is described in a publication of U.S. patent application, No. 20020071131 published on Jun. 13, 2002. This attempt eliminates an edge contour of a back-image from an image in process. 
   When such correction is performed, however, it is not easy for a user to judge whether a back-image is sufficiently removed from the corrected image. Generally, users check images in the front and back surfaces of the original sheet and the corrected image, back and forth. This is not an easy task since a user&#39;s eye sight is always moving from one image to another. 
   In addition, the back-image transfer problem is a delicate problem often requiring an extremely small amount of correction. However, this is not taken into account by the above attempt. 
   SUMMARY OF THE INVENTION 
   In view of the foregoing, it is an object of the present invention to provide a novel image processing apparatus which performs a correction for an image having a back-image transfer problem to an arbitrary extent in a way such that a result can easily be judged by a user. 
   Another object of the present invention is to provide a novel image processing method which performs a correction for an image having a back-image transfer problem to an arbitrary extent in a way such that a result can easily be judged by a user. 
   Another object of the present invention is to provide a novel computer readable data storing medium storing a program for image processing which performs a correction for an image having a back-image transfer problem to an arbitrary extent in a way such that a result can easily be judged by a user. 
   To achieve the above-mentioned object, in one embodiment, a novel image processing apparatus includes an image reading mechanism, a display, a memory, an image processing mechanism, and an image creating mechanism, and a controller. The image reading mechanism is configured to read an original image to produce an input image. The display displays an image. The memory stores a plurality of stepped values representing an image density threshold parameter. The image processing mechanism is configured to perform an image processing operation at least two times using the plurality of stepped values in an increasing order. The image creating mechanism is configured to create first and second subtractive images based on a first corrected image corrected by a first correction performed by the image processing mechanism and a second corrected image corrected by a second correction performed by the image processing mechanism. The controller is configured to control the display to display the input image, the first corrected image, the lastly corrected image, the first subtractive image, and the second subtractive image in a screen image. 
   The image creating mechanism may create the first subtractive image by comparing the first corrected image with the second corrected image in units of pixel, subtracting common image elements between the first and second corrected images from the first corrected image, and assigning a predetermined white density value to an area where the common image elements are subtracted. Further, the image creating mechanism may create the second subtractive image by comparing the first corrected image with the second corrected image, subtracting common image elements between the first and second corrected images from the second corrected image, and assigning the predetermined white density value to an area where the common image elements are subtracted. 
   The controller may control the display to display the first and second subtractive images at a same position in an alternate fashion in the screen image. 
   The controller may control switching between a first display mode in which the display displays the screen image with the first subtractive image and a second display mode in which the display displays the screen image with the second subtractive image. The controller may control a change of the predetermined white density value. 
   Further, to achieve the above-mentioned object, in one embodiment, a novel image processing method includes the steps of storing, reading, performing, creating and controlling. The storing step stores a plurality of stepped values representing an image density threshold parameter. The reading step reads an original image to produce an input image. The performing step performs an image processing operation at least two times using the plurality of stepped values in an increasing order. The creating step creates first and second subtractive images based on a first corrected image corrected by a first correction performed by the performing step and a second corrected image corrected by a second correction performed by the performing step. The controlling step controls the display of the input image, the first corrected image, the final corrected image, the first subtractive image, and the second subtractive image in a screen image. 
   The creating step may create the first subtractive image by performing the sub-steps of comparing the first corrected image with the second corrected image, subtracting common image elements between the first and second corrected images from the first corrected image, and assigning a predetermined white density value to an area where the common image elements are subtracted. Further, the creating step may create the second subtractive image by performing the sub-steps of comparing the first corrected image with the second corrected image, subtracting common image elements between the first and second corrected images from the second corrected image, and assigning the predetermined white density density value to an area where the common image elements are subtracted. 
   The controlling step may control the display of the first and second subtractive images at a same position in an alternate fashion in the screen image. 
   Further, to achieve the above-mentioned object, in one embodiment, a novel computer readable data recording medium storing a program for image processing including the steps of storing, reading, performing, creating, and controlling. The storing step stores a plurality of stepped values representing an image density threshold parameter. The reading step reads an original image to produce an input image. The performing step performs an image processing operation at least two times using the plurality of stepped values in an increasing order. The creating step creates first and second subtractive images based on a first corrected image corrected by a first correction performed by the performing step and a second corrected image corrected by a second correction performed by the performing step. The controlling step controls the display of the input image, the first corrected image, the final corrected image, the first subtractive image, and the second subtractive image in a screen image. 
   The creating step may create the first subtractive image by performing the sub-steps of comparing the first corrected image with the second corrected image, subtracting common image elements between the first and second corrected images from the first corrected image, and assigning a predetermined white density value to an area where the common image elements are subtracted. Further, the creating step may create the second subtractive image by performing the sub-steps of comparing the first corrected image with the second corrected image, subtracting common image elements between the first and second corrected images from the second corrected image, and assigning the predetermined white density value to an area where the common image elements are subtracted. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
     A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein: 
       FIG. 1  is a block diagram of an image processing apparatus according a preferred embodiment of the present invention; 
       FIGS. 2A-2E  are illustrations for explaining screen images created during a procedure of a weak-image elimination performed by the image processing apparatus of  FIG. 1 ; 
       FIG. 3  is a block diagram of a controller included in the image processing apparatus of  FIG. 1 ; 
       FIG. 4  is an illustration of a memory map for explaining the contents of the memory included in the controller of  FIG. 3 ; and 
       FIGS. 5 and 6  are flowcharts for explaining an image correction by the weak-image elimination of the image processing apparatus of  FIG. 1 . 
   

   DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
   This patent specification is based on Japanese patent application, No. JPAP2002-074289 filed on Mar. 03, 2002 in the Japanese Patent Office, the entire contents of which are incorporated by reference herein. 
   In describing preferred embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However the disclosure of this patent specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that operate in a similar manner. Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views, particularly to  FIG. 1 , an image processing apparatus  100  according to a preferred embodiment of the present invention is explained with reference to  FIG. 1 . As shown in  FIG. 1 , the image processing apparatus  100  includes a first input unit  1 , a second input unit  2 , a display unit  3 , a recording unit  4 , a controller  5 , a large capacity (LC) data storage  6 , a medium drive unit  7 , and a system data bus  8 . 
   The first input unit  1  includes, for example, a keyboard, a mouse, and a touch-sensitive panel although they are not shown. The first input unit  1  enters various kinds of instructions and data necessary for an image processing operation, including various kinds of information including operation modes, display modes, and their associated parameters. The second input unit  2  includes at least one of, for example, a digital still camera and a scanner, which are not shown, and inputs an image into the image processing apparatus  100 . The display unit  3  includes a CRT (cathode-ray tube) display or a liquid crystal display (LCD), for example. The display unit  3  displays information entered through the first and second input units  1  and  2 , respectively. The recording unit  4  includes a laser printer, for example, and records processed images on a recording sheet. 
   The controller  5  controls the entire operations of the image processing apparatus  100  to execute various operations including the image processing operation. The controller includes a CPU (central processing unit)  10  and a memory  13  (see  FIG. 3 ) which includes a ROM (read only memory) and RAM (random access memory). The memory  13  stores various kinds of programs and associated data necessary for the CPU  10  to perform the operations including the image processing operation. The programs stored in the memory  13  includes an operating system and a plurality of programs for image processing. These programs are downloaded to the memory  13  from a data medium driven by the medium drive unit  7 . The data medium may be a CD-ROM (compact disc read only memory), for example, and the medium drive unit  7  may be a CD-ROM drive unit. It is also possible to execute the image processing programs and a data input and output operation, for example, directly from the medium drive unit  7  without downloading to the memory  13 . Further, if the above-mentioned programs and associated data are initially stored in the ROM of the memory  13 , the medium drive unit  7  can be eliminated. 
   The large capacity data storage  6  includes a hard disc drive and stores programs and data, as well as transaction data during an execution of a program, on a temporary-time basis. The large capacity data storage  6  also serves as an image buffer to temporarily store an image which has been corrected through the image processing operation, which is output into a file, for example, by an instruction of the CPU  10 . 
   The above-mentioned components included in the image processing apparatus  100  are connected to the system data bus  8  to communicate with each other. 
   The above-mentioned data medium may also be one of semiconductor memory devices including a ROM (read only memory) and a nonvolatile memory card, for example. In this case, the medium drive unit  7  can be eliminated. The data medium may also be one of magnetic media including a DVD (digital versatile disc), a DVD-ROM (digital versatile disc read only memory), a MO (magneto-optic disc), a MD (magnetic disc), and a CD-R (compact disc recordable), for example. Further, the data medium may be one of magnetic media including a magnetic tape and a flexible disc, for example. 
   In addition, it is also possible to install the above-mentioned various programs in the image processing apparatus  100  by downloading from a server, without using the data medium such as the CD-ROM. In this case, the image processing apparatus  100  needs to be connected to a network to which the server is connected. In this environment, the image processing apparatus  100  downloads a part, of or the entire operation system and the plurality of programs for image processing. By using these downloaded programs, the image processing apparatus  100  executes the image processing operation. In addition, it is also possible that the image processing apparatus  100  downloads a program-execution program from the server and performs the image processing operation in accordance with instructions of the program-execution program. 
   The image processing apparatus  100  having the above-described structure performs a weak-image elimination to eliminate a low density image such as, for example, an image transmitted from a back surface of an original sheet during a scanning operation using a scanner. The image processing apparatus  100  performs this weak-image elimination by changing a threshold value of an image density used as an image density cut-off parameter. With the weak-image elimination, the image processing apparatus  100  can eliminate an expected thin dirty background as well as a transferred-from-back image. Accordingly, this weak-image elimination can be applied to various kinds of images including a scanned image obtained with a scanner and an image obtained with a digital still camera, for example. 
   The image processing apparatus  100  performs the weak-image elimination during the image processing operation, in which an input image and corrected images are displayed at a time in the same screen image of the display unit  3 .  FIGS. 2A-2D  show exemplary screen image  3   a - 3   d , respectively, for the weak-image elimination when displayed on the display unit  3 . The screen image  3   a  of  FIG. 2A  includes a plurality of images including first and second push-button icons A 1  and A 2 , an input image B 1  which is as obtained and is not processed through the weak-image elimination, and a first corrected image B 2  which is obtained by correcting the input image B 1  through the weak-image elimination using a first threshold value Th 1  as an image density cutoff parameter. In the input image B 1 , an image of a smiling circle with shading is an image from the front surface of an original sheet which is scanned but letter images A, B, and C, an image of parallelogram, and an image of a heart-like shape are images transferred from the back surface of the original sheet. The first corrected image B 2  shows the letter images of A, B, and C are eliminate, but other images transferred from the back surface remain. 
   The screen image  3   b  of  FIG. 2B  includes a plurality of images including the first and second push-button icons A 1  and A 2 , the input image B 1 , the first corrected image B 2 , and a second corrected image B 3  which is obtained by correcting the input image B 1  through the weak-image elimination using a second threshold value Th 2  as the image density cutoff parameter. The second threshold value Th 2  is greater (darker) than the first threshold value Th 1 . The second corrected image B 3  shows the letter images A, B, and C and other images transferred from the back surface are all eliminated. 
   The screen image  3   c  of  FIG. 2C  includes a plurality of images including the first and second push-button icons A 1  and A 2 , the input image B 1 , the first corrected image B 2 , the second corrected image B 3 , and a first subtractive image B 4 . The first subtractive image B 4  is an image obtained by comparing the first corrected image B 2  with the second corrected image B 3  in units of pixel, subtracting common image elements between the first and second corrected images B 2  and B 3  from the first corrected image B 2 , and assigning a predetermined white density value to an area where the subtraction is performed. The first subtractive image B 4  shows the images of letters A, B, and C are eliminated but the images of the parallelogram and heart-like shape remain. 
   The screen image  3   d  of  FIG. 2D  includes a plurality of images including the first and second push-button icons A 1  and A 2 , the input image B 1 , the first corrected image B 2 , the second corrected image B 3 , and a second subtractive image B 5 . The second subtractive image B 5  is an image obtained by comparing the first corrected image B 2  with the second corrected image B 3 , subtracting common image elements between the first and second corrected images B 2  and B 3  from the second corrected image B 3 , and assigning the predetermined white density value in units of pixel to an area where the subtraction is performed. The second subtractive image B 5  shows all the images transferred from the back surface of the original sheet scanned are eliminated. 
     FIG. 2E  demonstrates an alternate screen image  3   e  in which the screen images  3   c  and  3   d  are alternately displayed at least one cycle. This alternate display cycle can be set to an arbitrary number and, when a plurality of cycles are performed at intervals of a predetermined time period, differences in the first and second subtractive images B 4  and B 5  are flickering at the intervals of the predetermined time period since the image elements in the screen images  3   c  and  3   d  are located respectively at the same positions. 
   As in the same way with the screen image  3   b  of  FIG. 2B , a third corrected image (not shown) can be obtained by correcting the input image B 1  through the weak-image elimination using a next threshold value following the second threshold value Th 2 . In this way, many successively corrected images can be obtained through the weak-image elimination using a plurality of predetermined stepped-threshold values. 
   The above-mentioned plurality of stepped-threshold values which include the first and second threshold values Th 1  and Th 2  are stored in the memory  13  and can be changed arbitrarily by a user instruction through the first input unit  1  or the programs sent from the server through the network. The first threshold values Th 1  and Th 2 , the predetermined white density value, the number of the alternate display cycle, and a value of the predetermined time period are also stored in the memory  13  and can be changed arbitrarily by a user instruction through the first input unit  1  or the programs sent from the server through the networks. 
   In addition, the positions and sizes of the above-described image elements contained in the screen images  3   a - 3   d  are also stored in the memory  13  and can also be changed arbitrarily according to a user instruction through the first input unit  1  or the programs sent from the server through the network. 
   The first push-button icon A 1  serves as a button to complete the weak-image elimination when the first push-button icon A 1  is clicked. The second push-button icon A 2  serves as a button to start an image correction using the second threshold value Th 2  or a different subsequent threshold value. The second push-button icon A 2  also serves as a button to alternate the first and second subtractive images B 4  and B 5  in the screen, or the first subtractive image B 4  and a subsequent subtractive image in the screen. 
   As alternatives to the first and second push-button icons A 1  and A 2 , respective switch buttons may be provided to the first input unit  1 , for example. 
   The image processing apparatus  100  is provided with various display modes including first and second display modes to select one of the first and second subtractive images B 4  and B 5 . The first display mode selects a screen image displaying the first subtractive image B 4 . The second display mode selects a screen image displaying the second subtractive image B 5 . The first and second display modes can be switched with the second push-button icon A 2 . 
     FIG. 3  shows an exemplary structure of the controller  5  which includes the CPU  10 , an image processor  11 , an image creator  12 , and the memory  13 . The image processor  11  handles the image processing operation in collaboration with the CPU  10  in accordance with the image processing programs stored in the memory  13 . The image creator  12  generates the first and second subtractive images B 1  and B 2  and also successive subtractive images when instructed. The image creator  12  performs this image creation in collaboration with the CPU  10  in accordance with the image processing programs stored in the memory  13 . 
     FIG. 4  shows an exemplary map of the memory  13 . As shown in  FIG. 4 , the memory  13  includes a memory area  13   a  which includes data blocks DATA 1 -DATAl 2 , for example. The first and second threshold values Th 1  and Th 2  and successive threshold values Th 3 , Th 4 , and Th 5 , for example, are assigned to the data blocks DATA 1 , DATA 2 , DATA 3 , DATA 4 , and DATA. 5 , respectively, for example. The predetermined white density value, the number of the alternate display cycle, and the value of the predetermined time period are assigned to the data blocks DATA 6 , DATA 7 , DATA 8 , respectively. Also, the positions and sizes of the image elements contained in the screen images  3   a ,  3   b ,  3   c , and  3   d  are assigned to the data blocks DATA 9 , DATA 10 , DATA 11 , and DATAl 2 , for example. 
   Referring to flowcharts of  FIGS. 5 and 6 , the weak—image elimination performed by the image elimination performed by the image processing apparatus  100  is explained.  FIG. 5  shows an outline of the image processing operation performed by the image processing apparatus  100 . In step  101  of  FIG. 5 , the image processing apparatus  100  obtains the input image B 1  through the first input unit  1 . Then, in Step S 102 , the image processing apparatus  100  performs a primary correction including a shading correction, a color correction, and so on relative to the input image B 1 . Then, in Step  103 , the image processing apparatus  100  performs the weak-image elimination relative to the input image B 1  and consequently obtains the second corrected image B 3  as a satisfactory quality image. In Step S 104 , the image processing apparatus  100  displays the second corrected image B 3  with the display unit  3 . 
   An exemplary procedure of the weak-image elimination performed by Step S 103  of  FIG. 5  is explained in detail with reference to  FIG. 6 . In Step S 201  of  FIG. 6 , the CPU  10  instructs the image processor  11  to perform a first correction of the image density threshold using the first threshold value Th 1  relative to the input image B 1  and obtains the first corrected image B 2 . Also in Step S 201 , the CPU  10  instructs the display unit  3  to display the input image B 1  and the first corrected image B 2  in one screen image as the screen image  3   a  of  FIG. 2A . In Step  3202 , the CPU  10  checks whether the first push-button icon A 1  is clicked. When the first push-button icon A 1  is determined as being clicked and the check result of Step S 202  is YES, the first corrected image B 2  is judged as acceptable by the user. Then, the procedure of the weak-image elimination ends. 
   When the first push-button icon A 1  is determined as not clicked and the check result of Step S 202  is NO, the first corrected image B 2  is judged as not acceptable by the user and the process proceeds to Step S 203 . Subsequently, in Step S 203   r  the CPU  10  checks whether the second push-button icon A 2  is clicked. When the second push-button icon A 2  is determined as not clicked and the check result of Step S 203  is NO, the process returns to Step S 202  to restart the check of the first push-button icon A 1 . 
   When the second push-button icon A 2  is determined as being clicked and the check result of Step S 203  is YES, the process goes to Step S 204  in which the CPU  10  instructs the image processor  11  to perform a second correction of the image density threshold using the second threshold value Th 2  relative to the input image B 1  and obtains the second corrected image B 3 . After that, also in Step S 204 , the CPU  10  instructs the display unit  3  to display the input image B 1 , the first corrected image B 2 , and the second corrected image B 2  in one screen image as the screen image  3   b  of  FIG. 2B . 
   In Step S 205 , the CPU  10  checks whether the first push-button icon A 1  is clicked. When the first, push-button icon A 1  is determined, as being clicked and the check result of Step S 205  is YES, the second corrected image B 3  is judged as acceptable by the user. Then, the procedure of the weak-image elimination ends. When the first push-button icon A 1  is determined as not clicked and the check result of Step S 205  is NO, the second corrected image B 3  is judged as not acceptable by the user and the process goes to Step S 206 . Subsequently, in Step S 206 , the CPU  10  checks whether the second push-button icon A 2  is clicked. When the second push-button icon A 2  is determined as not clicked and the check result of Step S 206  is NO, the process returns to Step S 202  to restart the check of the first push-button icon A 1 . In this case, it is possible to terminate the process immediately by Step S 202  or to proceed to the performance of a third correction of the image density threshold using the third threshold value Th 3  relative to the input image B 1 . In the latter case, the image processing apparatus  100  can show the user an image corrected with a greater threshold value of image density. The user can continue this process five times since the stepped-threshold values Th 1 -Th 5  are prestored in the memory  13 . 
   When the second push-button icon A 2  is determined as being clicked and the check result of Step S 206  is YES, the process goes to Step S 207  in which the CPU  10  further checks whether the first display mode is initially selected. When the first display mode is determined as being selected and the check result of Step S 207  is YES, the process goes to Step S 208 . In Step S 208 , the CPU  10  instructs the image creator  12  to create the first subtractive image B 4  based on the first and second corrected image B 2  and B 3 . The CPU  10  further instructs the image creator  12  to create the second subtractive image B 5  based on the first and second corrected images B 2  and B 3 . Subsequently, also in Step S 208  the CPU instructs the display unit  3  to display the input image B 1 , the first corrected image B 2 , the second corrected image B 3 , and the first subtractive image B 4  in one screen as the screen image  3   c  of  FIG. 2C . 
   When the first display mode is determined as not selected and the check result of Step S 207  is NO, the process goes to step S 209 . In step S 209 , the CPU  10  instructs the image creator  12  to create the first subtractive image B 4  based on the first and second corrected images B 2  and B 3 . The CPU  10  further instructs the image creator  12  to create the second subtractive image B 5  based on the first and second corrected images B 2  and B 3 . Subsequently, also in Step S 209 , the CPU instructs the display unit  3  to display the input image B 1 , the first corrected image B 2 , the second corrected image B 3 , and the second subtractive image B 5  in one screen as the screen image  3   d  of  FIG. 2C . 
   After Step S 208  or Step S 209 , the CPU instructs the display unit  3  to switch the display mode from the first display mode to the second display, in Step S 210 . Thereby, the screen is changed from screen image  3   c  to screen image  3   d  . When the number of the alternate display cycle is set to 3, for example, and the predetermined time period is set to one second, for example, the display unit  3  switches between the screen images  3   c  and  3   d  three times at intervals of one second so that the user can observe the screen as the screen image  3   e  of  FIG. 2E . This facilitates a visual check of the two subtractive images as the results of the correction by the weak-image elimination. After Step S 210 , the process returns to Step S 202  to allow the user to determine whether to terminate the process or to continue the correction by the weak-image elimination. 
   The present invention may be conveniently implemented using a conventional general purpose digital computer programmed according to the teachings of the present invention, as will be apparent to those skilled in the computer art. Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present invention, as will be apparent to those skilled in the software art. The present invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art. 
   Numerous additional modifications and variations are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the disclosure of this patent specification may be practiced otherwise than as specifically described herein.