Abstract:
The present invention, which achieves these objectives, relates to image processing in which an image resolution of a input image data is compared to information of predetermined standard resolution, and the image data is judged to determine whether it includes specific information related to copy protection, with judging being controlled not to work on the basis of the result of the comparing means. Because the control technique of the present invention controls not to work the judgment on the basis of the result of the comparing means, the control technique according to the invention provides an efficient judging processing, since no judgment is performed on low resolution image data which is not so prone to counterfeiting.

Description:
BACKGROUND OF THE INVENTION  
         [0001]    1 . Field of the Invention  
           [0002]    This invention relates to an image processing apparatus, an image processing method and a computer program product for judging whether image data include specific information related to copy protection.  
           [0003]    2. Description of the Related Art  
           [0004]    In connection with color copying machines, it has been considered to implement an image recognition processing function to prevent counterfeiting of a copy-prohibited object such as a banknote or valuable securities. One drawback of color copying machines is that they are expensive stand-alone devices. More recently, high quality copying has been attained using less expensive computers and computer peripheral apparatus such as a color scanner and a color printer, and image processing software to edit an input and output image. A need has therefore developed, using an image recognition processing function, to prevent counterfeiting of a banknote and valuable securities for an inexpensive color image processing system using a color scanner and printer.  
           [0005]    There are some known judging methods for judging whether an original is a copy-prohibited object or not. An original is judged based on a color spectrum distribution of image data (R,G,B data for each pixel) generated by scanning the original, and a comparison of the color spectrum distribution with copy-prohibited object data stored in a ROM, or a comparison of an image pattern of a part of the original (or the entire original) with a copy-prohibited object pattern stored in a ROM. The result of the judging is an evaluation value as to whether the original is a copy-prohibited object or not.  
           [0006]    It is recently possible to make a copy-prohibited object by using a technology called digital watermark. The copy-prohibited object is altered to include information indicating whether the object is a copy-prohibited object. The process of making the copy-prohibited object is as follows. First, second digital information (sub-information) is attached indicating a copy-prohibited object to digital image data as the first digital information (main-information). Next, a printed document is made from the digital image data with its attached second information. Of course the second digital information indicating a copy-prohibited object can be detected from the digital image data with its attached second digital information, as a characteristic of the digital watermark. It is possible to detect the second digital information indicating a copy-prohibited object from newly-created image data which is created from the printed document by an image reading apparatus (e.g., a color scanner). This technology is called digital watermark and is increasingly used for prohibiting illegal copying of printed material.  
           [0007]    In view of widespread use of computer peripherals to make color copier, a judging process chiefly made of software for a copy-prohibited object is preferable to a hardware one comprising many electrical circuits. Such a software process, however, uses too much processing power and too long a time to judge whether an image is a copy-prohibited object or not and to process the image.  
         SUMMARY OF THE INVENTION  
         [0008]    An object of the present invention is to address the above situation.  
           [0009]    One particular object of the present invention is to provide an image processing apparatus and method and a computer program product that can avoid unnecessary processing and can provide a faster judgment of whether or not an object is copy-prohibited faster.  
           [0010]    Another object of the present invention is to provide an image processing apparatus and method and a computer program product that have a new function not known before.  
           [0011]    According to one aspect, the present invention, which achieves these objectives, relates to image processing in which an image resolution of a input image data is compared to information of predetermined standard resolution and the image data is judged to determine whether it includes specific information related to copy protection, with judging being controlled not to work on the basis of the result of the comparing means.  
           [0012]    Because the control technique of the present invention controls not to work the judgment on the basis of the result of the comparing means, the control technique according to the invention provides an efficient judging processing, since no judgment is performed on low resolution image data which is not so prone to counterfeiting.  
           [0013]    The foregoing and still other objects, features and advantages of the present invention will become fully apparent from the following description to be taken in conjunction with the attached drawings. 
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0014]    [0014]FIG. 1 is a diagram which shows the image processing apparatus of this suggestion.  
         [0015]    [0015]FIG. 2 is a diagram which shows one embodiment of a image processing system of the present invention.  
         [0016]    [0016]FIG. 3 is a block diagram that shows the main portion of FIG. 2.  
         [0017]    [0017]FIG. 4 is a flow chart which shows the process sequence by using the construction of FIG. 2 and FIG. 3.  
         [0018]    [0018]FIG. 5 is a flow chart which shows the process sequence of a third embodiment.  
         [0019]    [0019]FIG. 6 is a flow chart which shows a modification of the process sequence of FIG. 4.  
         [0020]    [0020]FIG. 7 is a flow chart which shows a modification of the process sequence of FIG. 4.  
         [0021]    [0021]FIG. 8 is a flow chart which shows a modification of the process sequence of FIG. 5.  
         [0022]    [0022]FIG. 9 is a flow chart which shows a modification of the process sequence of FIG. 5.  
         [0023]    [0023]FIG. 10 is a diagram which shows a six embodiment of an image processing system.  
         [0024]    [0024]FIG. 11 is a block diagram that shows the main portion of FIG. 10. 
     
    
     DESCRIPTION OF THE PREFERRED EMBODIMENTS  
       [0025]    [0025]FIG. 1 is a block diagram which shows an image processing apparatus of this suggestion.  
         [0026]    Input image data control means  110  controls a resolution of an image which is read by image data source  120  as an image scanner. Image data generating means  130  generates image data of an image resolution which is controlled by input image data control means  110 . Memory  140  stores the image data generated by image data generating means  130 . Data attaching means  150 , which is controlled by main control means  200  based on the image resolution controlled by input image data control means  110 , attaches digital data to the image data stored in memory  140 . Image character recognition means  160 , which is controlled by main control means  200  based on the image resolution controlled by input image data control means  110 , judges whether the image data stored in memory  140  belongs to a copy-prohibited object image.  
         [0027]    Recognition information output means  170  outputs a recognition result of the image character recognition means  160 . Recognition information receiving means  180  displays the recognition result on a display or the like, and receives the recognition result information and informs the image processing apparatus&#39;s user that an original based on said image data is a copy-prohibited object image. Image data output means  190  outputs sequentially an output image.  
         [0028]    Each function block in FIG. 1 works as the following description. Image data generating means  130  generates image data of a resolution which is indicated from an indicating means (unshown) of input image data control means  110  and is based on a preset image on image data source  120  and an indication by an user of the image process apparatus. Information of the image resolution indicated by a user of the image process apparatus is output to main control means  200  at the same time. Main control means  200  control data attaching means  150  and image character recognition means  160  and recognition information output means  170  based on the information of the image resolution output from input image data control means  110 .  
         [0029]    (The First Embodiment)  
         [0030]    Information indicating a copy-prohibited object image is attached to an original by using a technology called digital watermark in one preferable embodiment of this invention.  
         [0031]    An original of the copy-prohibited object is formed by printing a printing object from image data to which is attached the information indicating a copy-prohibited object. The digital image data, with its attached information indicating the copy-prohibited object, is made by attaching second digital information indicating the copy-prohibited object to the first digital information which is a source of the printing object. The digital watermark is possible to be any kind of digital watermark, such as one attached to a specific frequency of image information as invisible information or visible information but difficult for human eyes to see like yellow dots.  
         [0032]    A inexpensive color scanner or printer is preferable to carry out a counterfeit prevention of a copy-prohibited object less expensive than a comparatively expensive color copying machine as stated above. It is effective answer to judge the copy-prohibited object by using a software process, but the software judging process has a problem related to a process speed. Accordingly, the invention checks the possibility that a printing image based on an original is used as a counterfeit, in accordance with image resolution. The possibility is degree of risk that someone mistakes the counterfeit for a genuine one.  
         [0033]    The following is a detailed explanation, which is made with reference to the drawings, of the preferred embodiments of this invention. FIG. 2 shows one embodiment of an image processing system of the present invention. Image scanner  1  is an image input apparatus and a personal computer  2  processes image data input by image scanner  1 . Cable  3  connects image scanner  1  and personal computer  2  and communicates the image data.  
         [0034]    [0034]FIG. 3 is a block diagram that shows the main portion of FIG. 2. CPU  11  is a central processing unit and RAM  12  is random access memory and ROM  13  is read only memory. Display control unit  14  controls display  15  and operation input unit  16  is a keyboard or a mouse. Connection I/O  17  is used for connecting operation input unit  16  to the image processing system. External memory unit  18  is a hard disk or a memory card etc. Connection I/O  19  is used for connecting external memory unit  18  to the image processing system. Bus  22  is used for communication image data or another data. Image scanner  21  is the same as image scanner  1  in FIG. 2. Connection I/O  22  is used for receiving image data from image scanner  21  and sending control signals to image scanner  21 . Interface unit  23  is a communication unit like a network.  
         [0035]    [0035]FIG. 4 is a flow chart which shows a process sequence based on performing a process of blocks of FIG. 2 and FIG. 3. A program which describes the process sequence of FIG. 4 is stored on ROM  13  in advance or on external memory unit  18  and then the program is moved into RAM  12 . CPU  11  executes the program to execute the process of this embodiment by software processes. The program is preferably a part of a scanner driver.  
         [0036]    Reading image resolution, designated by image system user, is stored on RAM  12  in step  10 . In step  20 , CPU  11  judges whether the designated image resolution {Rin} is not as high as a predetermined first standard resolution {T 1 }, e.g. 100 dpi [dot/inch]. This process is the first judgment. In the case the designated image resolution {Rin} is not as high as the predetermined first standard resolution {T 1 }, the process flows to step  40 . On the other hand in the case the designated image resolution {Rin} is as high as the predetermined first standard resolution {T 1 }, the process flows to step  30 . As a result, a judgment which a scanned image is a copy-prohibited object image does not work when the scanned image&#39;s resolution is not as high as a predetermined resolution since an printout of the scanned image is useless as a counterfeit. It is fast to print an image that image resolution is not as high as the first standard density since the judgment is not executed.  
         [0037]    In step  30 , CPU  11  judges whether the designated image resolution {Rin} is not as high as the predetermined second standard resolution {T 2 }, e.g. 300 dpi [dot/inch]. This judgment is a second judgment. In the case the designated image resolution {Rin} is not as high as the predetermined second standard resolution {T 2 }, the process flows to step  41 . On the other hand in the case the designated image resolution {Rin} is as high as the predetermined second standard resolution {T 1 }, the process flows to step  60 . It can be expected that a counterfeiter who scans a copy-prohibited object image designates high resolution scanning. Accordingly, judgment as to whether a scanned image is a copy-prohibited object image executes when the scanned image is high resolution.  
         [0038]    In step  40  or  41 , CPU  11  judges the image data of image resolution is a low risk of counterfeiting and indicates, through the connection I/O  22 , the color image scanner  21  scanning a original on the flatbed by user&#39;s designated image resolution. The image scanner scans the original. The image data based on the original is sent and stored on RAM  12  through the connection I/O  12 . After step  40 , the process of FIG. 4 flows to step  90 . After step  41 , the process of FIG. 4 flows to step  50 .  
         [0039]    In step  50 , the image resolution is not high enough and is not suitable for inputting a vivid copy-prohibited object, but CPU  11  takes measures to prevent a counterfeit of the copy-prohibited object by way of caution. Concretely, CPU  11  attaches the product&#39;s number of personal computer  2  or color image scanner  1  and the user ID information to the image stored on RAM  12 . The attached information is registered when a driver of the color image scanner  1  is installed. If the image stored on RAM  12  is printed or is output a external apparatus through a network, it is thus possible to identify the person or apparatus that scanned the copy-prohibited object image by using the attached information. The attachment is performed by the technology is called digital watermark. After step  50 , the process of FIG. 4 flows to step  90 .  
         [0040]    In step  60 , since there is a possibility of inputting of the copy-prohibited object image as a vivid image, CPU  11  judges the image data of the image resolution is high risk of counterfeiting and performs extraction of digital watermark attached to the copy-prohibited object image from the image stored on RAM  12 . CPU  11  indicates, through connection I/O  22 , color image scanner  21  scanning a original on the flatbed by lower image resolution than the user&#39;s designated one. Color image scanner  21  scans the original by the lower image resolution. The image data generated by the scanning is sent to RAM  12  through the connection I/O  22 . This scanning is carried by using a well-known function of a color image scanner driver. After step  60 , the process of FIG. 4 flows to step  70 .  
         [0041]    In step  70 , CPU  11  judges whether the lower image data generated by the scanning is the copy-prohibited object image or not. In the case CPU  11  judges that the lower image data belongs to the copy-prohibited object image, the process flows to step  80 . On the other hand in the case CPU  11  judges that the lower image data is not a copy-prohibited object image, the next process is step  42 . Step  42  is the same as step  40  or  41 , and the process flows thereafter to step  90 .  
         [0042]    In Step  80 , the lower image data generated by the scanning is output as a processed image. Concretely, the lower image data generated by the scanning is output 1) after converting color or changing image size, or/and 2) after attaching any symbol or figure as a processed image. The processed image is not equal to the scanned image data.  
         [0043]    It is easy to make the processed image from the image stored on RAM  12  by working a well-known image processing program module correspond to 1) and 2) under CPU  11 &#39;s control. The processed image is output to external memory unit  18  as an image data file through the connection I/O  19 . The process terminates when step  80  has finished.  
         [0044]    In step  90 , the image data scanned in step  42  is output to external memory unit  18  as a image file through the connection I/O  19 , when CPU  11  judges the lower image data generated by the scanning is not a copy-prohibited object image. The process terminates when step  90  has finished.  
         [0045]    The original as a print document, which is made from the digital image data with attached information indicating a copy-prohibited object image as a digital watermark, is scanned by color image scanner  21 . The judgment of the copy-prohibited object image in step  80  is performed by extracting the digital watermark from the scanned image data.  
         [0046]    In step  80 , it is possible to select another process which the image data generated by the scanned image is not output at all. As a result, the copy-prohibited object image can not be input in the first place. Of course, it may be good to give warning of indicating the copy-prohibited object image is an original. The warning is displayed on the display  15  through display control unit  14 . The warning has the advantage to stop mischief and mistake a copy-prohibited object image for the original.  
         [0047]    It is possible to prevent a counterfeiter from reading a copy-prohibited object image by high image resolution. Additionally, a process speed of this embodiment&#39;s image processing system which judges a copy-prohibited object image by using software and CPU is faster because a judgment of the copy-prohibited object image is not performed for an image read with low image resolution. This embodiment&#39;s image processing system does not judge an image read with middle range resolution because a possibility of reading copy-prohibited object image is not high enough, and then the middle range resolution image is attached with information. It is thus possible to stop the software judgment consuming much time.  
         [0048]    [Second Embodiment] 
         [0049]    The judgment of a copy-prohibited object image, in step  70  of the first embodiment, is performed for photo electrical converted image data generated from a print object added information, using digital water mark, indicating the copy-prohibited object image.  
         [0050]    For the judgment of a copy-prohibited object image, in step  70 , it is possible to replace another method. For example, an original is judged based on a color spectrum distribution based on image data (R,G,B data for each pixel) generated by scanning the original and a comparison of the color spectrum distribution with copy-prohibited object data stored in a ROM or a comparison of an image pattern of a part of the original (or the entire original) with a copy-prohibited object pattern stored in a ROM. The result of the judging is an evaluation value as to whether the original is a copy-prohibited object or not. An original is judged by comparing a color spectrum distribution based on image data (R,G,B data for each pixel) generated by scanning the original with a copy-prohibited object data stored a ROM or by comparing an image pattern of a part of the original (or the entire original) with a copy-prohibited object pattern stored a ROM. The result of the comparing is a evaluation value which indicates whether the original is a copy-prohibited object image or not.  
         [0051]    In this case, the evaluation value (e.g., the sum of the absolute value of the comparing result or the correlation between the image data (pattern) and data (pattern) stored a ROM) is judged on the basis of a predetermined threshold. If the sum of the absolute value of the comparing result is not over the predetermined threshold, the original is judged as a copy-prohibited object image. If the sum of the absolute value of the comparing result is over the predetermined threshold, the original is not judged as a copy-prohibited object image. If the correlation is over the predetermined threshold, the original is judged as a copy-prohibited object image. If the correlation is over the predetermined threshold, the original is not judged as a copy-prohibited object image.  
         [0052]    [Third Embodiment] 
         [0053]    In the first embodiment and second embodiment, if an original image is not judged as a copy-prohibited object image, the original image is output without information attached to the original image. It is possible to attach information in the original image in step  51 , which is the same as step  50 , after step  42 . A flowchart of this process is FIG. 5. FIG. 5 and FIG. 3 are the same except step  51 .  
         [0054]    [Fourth Embodiment] 
         [0055]    In step  30  of the first, second and third embodiment, if the user-designated image resolution is not as high as the predetermined second standard resolution, the specific data is attached to the image data in step  50 . It is possible to replace step  50  with step  71 , which is the same as step  70 , or to perform both step  50  and step  71 .  
         [0056]    [0056]FIG. 6 is a flowchart which performs the above-mentioned change to FIG. 4. In step  71  after reading an image in step  41 , a judgment of a copy-prohibited object is performed. In the case CPU  11  judges that the image is a copy-prohibited object image, the process flows to step  80 . On the other hand in the case CPU  11  judges that the image is not a copy-prohibited object image, the next process flows to step  90 . The rest of the steps in FIG. 6 are the same as FIG. 4.  
         [0057]    [0057]FIG. 7 is a flowchart which performs the alternate change mentioned above for FIG. 4. In step  71 , after being attached with data in step  50 , a judgment of a copy-prohibited object is performed like step  70 . In the case CPU  11  judges that a read image is a copy-prohibited object image, the process flows to step  80 . On the other hand in the case CPU  11  judges that the image doesn&#39;t is not a copy-prohibited object image, the process flows to step  90 . It is possible to reduce process speed without reading the image by low resolution, because image resolution is somewhat lower in this case. The rest of the steps in FIG. 7 are the same as FIG. 4.  
         [0058]    [0058]FIG. 8 is a flowchart which performs the above-mentioned change to FIG. 5. In step  71  after reading an image in step  41 , a judgment of a copy-prohibited object is performed. In the case CPU  11  judges that the image is a copy-prohibited object image, the next process is step  80 . On the other hand in the case CPU  11  judges that the image is not a copy-prohibited object image, the process flows to step  90 . The rest of the steps in FIG. 8 are the same as FIG. 5.  
         [0059]    [0059]FIG. 9 is a flowchart which performs the above-mentioned change to FIG. 5. In step  71 , after being attached with data in step  50 , a judgment of a copy-prohibited object is performed like step  70 . In the case CPU  11  judges that a read image is a copy-prohibited object image, the process flows to step  80 . On the other hand in the case CPU  11  judges that the image is not a copy-prohibited object image, the process flows to step  90 . The rest of the steps in FIG. 9 are the same as FIG. 5.  
         [0060]    [Fifth Embodiment] 
         [0061]    The above-mentioned process of attaching data or judging a copy-prohibited object is performed for color scanned image data on the basis of user-designated image resolution. The process is not only performed for the color scanned image data but also other input image data. The other image input data is input from interface unit  23  in FIG. 3 as communication means like a network or a detachable storage medium (e.g., smart media, compact flash, magnetic optical disk) which is connected to a un-shown drive unit of the image process system in FIG. 3 and stores color image data. The attached information, in step  50 , is the network address of the sender apparatus which send image data through interface unit  23  or the number of the detachable memory in the abovementioned case.  
         [0062]    The above-mentioned judging program of copy-prohibited object is included in a communication program (ex. Internet browser soft ware) or a program for obtaining image from a storage medium.  
         [0063]    CPU  11  controls the input image resolution information of stored image in step  10  in this case. Image data stored on the detachable memory being attached the un-shown drive unit is read through an I/O unit which is connected the drive unit of the detachable memory. The image resolution information in step  10  and the image data in step  40 ,  41  and  42  may be input through an interface unit connected to a network like the Internet.  
         [0064]    [Sixth Embodiment] 
         [0065]    Image data including the processed image data and the scanned image data is output as an image data file to external memory unit  18  (a hard disk of this image processing system) through the connection I/O  19 . However, image data may be output to a color printer or an external apparatus through network and an interface unit. In this case, attached information in step  50  is a product number or a network address of a send side apparatus or a receive side apparatus. In this embodiment, a copy-prohibited object judging program includes a program for using communication through network or printer driver.  
         [0066]    [0066]FIG. 10 indicates a example of a image processing system of this embodiment. Image scanner  101  is an image input apparatus and a personal computer  102  processes image data and outputs processed image data to color printer  104  as a output apparatus.  
         [0067]    [0067]FIG. 11 is a block diagram that shows the main portion of FIG. 10. Connection I/O  125  connects to an image output apparatus like a color printer. Other components of FIG. 11 are the same as FIG. 3. In this case, image output in step  80  and  90  in FIGS. 4, 5,  6 ,  7 ,  8  and  9  are replaced with image output to a color printer  24  connected through I/O  25 . Image data in step  80 ,  90  may be output through an interface unit connected to a network like the Internet.  
         [0068]    [Seventh Embodiment] 
         [0069]    When the color printer outputs an object image in the sixth embodiment, there is attached information attached to the object image by using digital watermark method from step  50  and step  51 . However, It is possible to attach information like serial number in a printed image as unknown color information for an image processing system user.  
         [0070]    (Other Embodiments)  
         [0071]    The object of the present invention can also be achieved by providing a storage medium storing program codes for performing the aforesaid processes to a system or an apparatus, reading the program codes with a computer (e.g., CPU, MPU) of the system or apparatus from the storage medium, then executing the program.  
         [0072]    In this case, the program codes read from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention.  
         [0073]    Further, the storage medium, such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM can be used for providing the program codes.  
         [0074]    Furthermore, besides aforesaid functions according to the above embodiments are realized by executing the program codes which are read by a computer, the present invention includes a case where an OS (Operating System) or the like working on the computer performs a part or entire processes in accordance with designations of the program codes and realizes functions according to the above embodiments.  
         [0075]    The image processing system judges a risk of a read image being used for a forgery on the basis of a user&#39;s indicated image reading resolution and reduces a process for prohibiting forgery which is usually performed for every image even when there is little risk.  
         [0076]    As a result, a process of calculation by using a software for prohibiting forgery is efficient and it is possible to be faster than a process speed of the image process system totally.