Abstract:
A background pattern image combining apparatus for combining a background pattern image with an input image is provided. The background pattern image includes a plurality of first isolated points having a size that can be read by an image reader and a plurality of second isolated points having a size that cannot be read by the image reader. The background pattern image combining apparatus includes a detector that detects, in the input image, a specific area which is an area having a specific state, and a combining portion that combines the background pattern image with the input image by placing not the plurality of first isolated points but the plurality of second isolated points in the specific area, and, by placing the plurality of first isolated points and the plurality of second isolated points in an area other than the specific area.

Description:
This application is based on Japanese patent application No. 2010-128183 filed on Jun. 3, 2010, the contents of which are hereby incorporated by reference. 
     BACKGROUND OF THE INVENTION 
     1. Field of the Invention 
     The present invention relates to an apparatus and method for integrating a background pattern image into an input image. 
     2. Description of the Related Art 
     In order to deter unauthorized copying of a document image depicted on the original paper, a technique has been employed in which a character string such as “copy” is printed onto paper as a background pattern image together with the document image. 
     Such a “background pattern image” consists of many character dots  6 J and dots-to-be-invisible  6 S as shown in  FIG. 5 . The character dots  6 J represent a character string, and the dots-to-be-invisible  6 S camouflage (disguise) the character string. 
     Each of the character dots  6 J and the dots-to-be-invisible  6 S is very small. While the character dot  6 J has a size that can be scanned by a scanner, the dot-to-be-invisible  6 S has a size that cannot be scanned thereby. Accordingly, if a copier is used to copy the document image depicted on the original paper, only the character dots  6 J are printed on paper with the dots-to-be-invisible  6 S not printed thereon. This makes the character string represented by the background pattern image apparent. It is, thus, possible to deter someone from making unauthorized copying. 
     Overlaying a background pattern image on a document image sometimes renders the document itself illegible. To cope with this, there has been proposed the following method. 
     In combining character data and modification data that are stored separately from each other, and outputting the resultant data, a CPU determines whether or not the character data or the modification data is present. Note that background pattern image data is used as the modification data. When both the character data and the modification data to be outputted are present, a further determination is made as to whether or not the modification data exceeds a prescribed density. Then, when it is determined that the modification data exceeds the prescribed density, trimming is performed in which a portion corresponding to one dot adjacent to a character dot of the character data is turned OFF, and then, the character data is combined with the modification data and the resultant data is outputted (Japanese Laid-open Patent Publication No. 8-180047). 
       FIGS. 10A to 10C  are diagrams showing an example of a Quick Response (QR) code. 
     According to the method described in Japanese Laid-open Patent Publication No. 8-180047, characters are reversed, and therefore, a background pattern image is less camouflaged. 
     Further, the method described in Japanese Laid-open Patent Publication No. 8-180047 is not applicable to an object other than characters, for example, not applicable to a QR code as shown in  FIG. 10A . This is because if dots constituting the QR code are reversed, it becomes impossible for a computer to analyze the QR code. 
     As shown in  FIG. 10B , simply overlaying a background pattern image on the QR code again makes it difficult for a computer to analyze the QR code. To cope with this, it may be conceived that a background pattern image is disposed so as not to overlap with the QR code and its periphery as shown in  FIG. 10C . This, however, makes the QR code stand out for the entire document. 
     SUMMARY 
     The present disclosure is directed to solve the problems pointed out above, and therefore, an object of an embodiment of the present invention is to combine a background pattern image with an input image more favorably than that in the conventional case. 
     A background pattern image combining apparatus according to an aspect of the present invention is a background pattern image combining apparatus for combining a background pattern image with an input image, the background pattern image including a plurality of first isolated points having a size that can be read by an image reader and a plurality of second isolated points having a size that cannot be read by the image reader. The background pattern image combining apparatus includes a detector that detects, in the input image, a specific area which is an area having a specific state, and a combining portion that combines the background pattern image with the input image by placing not the plurality of first isolated points but the plurality of second isolated points in the specific area, and, by placing the plurality of first isolated points and the plurality of second isolated points in an area other than the specific area. 
     Preferably, the combining portion places the plurality of first isolated points and the plurality of second isolated points in the thin line area and an adjacent area next to the thin line area in such a manner that with respect to one line, out of the two lines, sandwiched between the thin line area and the adjacent area, a distance between that one line and one of the plurality of first isolated points closest to that one line is equal to a distance between that one line and one of the plurality of second isolated points closest to that one line. 
     Preferably, the combining portion does not place any of the plurality of first isolated points and any of the plurality of second isolated points next to a pixel representing a black dot in the input image. 
     Preferably, the detector determines whether or not the two lines have a same color as that of the plurality of first isolated points, and, if the detector determines that the two lines have, then the detector detects an area defined by the two lines as the thin line classified as a dots-to-be-invisible area in Step # 703  of  FIG. 6 . 
     These and other characteristics and objects of the present invention will become more apparent by the following descriptions of preferred embodiments with reference to drawings. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is a diagram illustrating an example of a network system including an image forming apparatus. 
         FIG. 2  is a diagram illustrating an example of the hardware configuration of an image forming apparatus. 
         FIG. 3  is a diagram illustrating an example of the functional configuration of an image forming apparatus. 
         FIG. 4  is a diagram illustrating an example of a document image. 
         FIG. 5  is a diagram illustrating an example of a background pattern image. 
         FIG. 6  is a flowchart depicting an example of the flow of area classifying processing. 
         FIG. 7  is a diagram illustrating an example of the positional relationship among a thin line, character dots, and dots-to-be-invisible. 
         FIG. 8  is a flowchart depicting an example of the overall processing flow of an image forming apparatus. 
         FIG. 9  is a diagram illustrating an example of a specific pattern area of a document image that is the original image depicted on paper. 
         FIGS. 10A to 10C  are diagrams illustrating an example of a QR code. 
     
    
    
     DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       FIG. 1  is a diagram illustrating an example of a network system including an image forming apparatus  1 ;  FIG. 2  is a diagram illustrating an example of the hardware configuration of the image forming apparatus  1 ; and  FIG. 3  is a diagram illustrating an example of the functional configuration of the image forming apparatus  1 . 
     The image forming apparatus  1  shown in  FIG. 1  is an apparatus generally called a multifunction device, a Multi-Function Peripheral (MFP), or the like. The image forming apparatus  1  is configured to integrate, thereinto, a variety of functions, such as copying, network printing (PC printing), faxing, and scanning. 
     The image forming apparatus  1  is capable of sending and receiving image data with a device such as a personal computer  2  via a communication line  3 , e.g., a Local Area Network (LAN), a public line, or the Internet. 
     Referring to  FIG. 2 , the image forming apparatus  1  is configured of a Central Processing Unit (CPU)  10   a , a Random Access Memory (RAM)  10   b , a Read-Only Memory (ROM)  10   c , a mass storage  10   d , a scanner  10   e , a printing unit  10   f , a network interface  10   g , a touchscreen  10   h , a modem  10   i , a control circuit, and so on. 
     The network interface  10   g  is a Network Interface Card (NIC) for communicating with another device such as the personal computer  2  via the communication line  3 . 
     The touchscreen  10   h  displays, for example, a screen for giving a message or instructions to a user, a screen for the user to enter a process command and process conditions, and a screen for displaying the result of a process performed by the CPU  10   a . The touchscreen  10   h  also detects a position thereof touched by the user with his/her finger, and sends a signal indicating the result of the detection to the CPU  10   a.    
     The scanner  10   e  is a device that reads images printed on paper, such as photographs, characters, drawings, diagrams, and the like, and creates image data thereof. 
     The modem  10   i  is a device for transmitting image data via a fixed-line telephone network to another facsimile terminal and vice versa based on a protocol such as Group  3  (G 3 ). 
     The printing unit  10   f  serves to print, onto paper, an image obtained by scanning with the scanner  10   e  or an image indicated in image data received from the personal computer  2  or another facsimile terminal. Such an image is hereinafter referred to as a “document image  50 ”. 
     The image forming apparatus  1  is also equipped with a background pattern image print function to print, onto paper, a background pattern image together with the document image  50 . 
     The ROM  10   c  and the mass storage  10   d  store, therein, programs and data for implementing the functions of a specific pattern detection portion  101 , a thin line detection portion  102 , a dot density detection portion  103 , an area classifying portion  104 , a background pattern image generating portion  105 , a dilation processing portion  106 , a dot position determination portion  107 , a print image data generating portion  108 , and the like, all of which are shown in  FIG. 3 . These programs and data are loaded into the RAM  10   b  as necessary, and executed by the CPU  10   a . The individual portions shown in  FIG. 3  perform processing; thereby to implement the background pattern image print function. 
     An example of the mass storage  10   d  is a hard disk or a flash memory. 
     The personal computer  2  is a client to which the image forming apparatus  1  provides service. A driver for the image forming apparatus  1  is installed into the personal computer  2 . 
       FIG. 4  is a diagram illustrating an example of a document image  50 ;  FIG. 5  is a diagram illustrating an example of a background pattern image  51 ;  FIG. 6  is a flowchart depicting an example of the flow of area classifying processing; and  FIG. 7  is a diagram illustrating an example of the positional relationship among a thin line  50   h , character dots  6 J, and dots-to-be-invisible  6 S. 
     The following is a description of user operation and processes performed by the individual portions of the image forming apparatus  1  shown in  FIG. 3  for a case where a document image  50  is printed onto paper together with a background pattern image. 
     The user prepares a document image  50  to be printed along with a background pattern image. For example, the user may create the document image  50  by using an application such as word-processing software or drawing software for the personal computer  2 . Alternatively, the user may use, as the document image  50 , a handwritten image on paper. The following is a description of an example in which the user creates the document image  50  shown in  FIG. 4  by using drawing software for the personal computer  2 . 
     After creating the document image  50  by using the drawing software, the user operates the personal computer  2  to enter a print command thereinto. At this time, the user selects an option to add a background pattern image to an input image. 
     In response to this operation, the personal computer  2  transmits image data of the document image  50  and a predetermined command to the image forming apparatus  1 . 
     When the image forming apparatus  1  receives the image data and the predetermine command, the specific pattern detection portion  101  through the print image data generating portion  108  discussed above perform the following processes. 
     The specific pattern detection portion  101  detects, in the document image  50 , a specific pattern area  50   p  that is an area having a specific pattern. The specific pattern detection portion  101  detects, as the specific pattern area  50   p , for example, an area containing a one-dimensional bar code or an area containing a Quick Response (QR) code. 
     The “one-dimensional bar code” is a series of stripes, or, in other words, is constituted by bars and spaces having proportional thickness and thinness. The “one-dimensional bar code” is sometimes called a “bar code” simply. The “QR code” is a matrix code consisting of black modules arranged in a square pattern on a white background, as is shown in the lower-left of the document image  50  of  FIG. 4 . The specific pattern detection portion  101 , thus, detects the QR code in the document image  50  as the specific pattern area  50   p.    
     The thin line detection portion  102  detects, in the document image  50 , a thin line  50   h  having a width equal to or less than a threshold Lw (3 dots, for example). At this time, the thin line detection portion  102  also detects a width of each of the thin lines  50   h.    
     The dot density detection portion  103  detects, as a dot high-density area  50   d , an area in which the total number of pixels of the area is a constant value or more, and the ratio of the number of dotted pixels to the total number of pixels is a predetermined value or more. 
     Meanwhile, as shown in  FIG. 5 , a background pattern image is constituted by many small dots having two different sizes. The many small dots are arranged not to contact each other, or, in other words, are isolated from each other. In short, the dots are isolated points. 
     A scanner can scan larger dots. A group of the larger dots represent a character string. The larger dots are hereinafter referred to as “character dots  6 J”. 
     On the other hand, a scanner cannot scan smaller dots. Even if paper on which the smaller dots are printed is scanned by the scanner, the smaller dots are not read thereby. The smaller dots, therefore, seem to disappear from a printed matter. In view of this, the smaller dots are hereinafter referred to as “dots-to-be-invisible  6 S”. The dots-to-be-invisible  6 S are used to camouflage a character string represented by the character dots  6 J. 
     Referring now back to  FIG. 3 , the area classifying portion  104  categorizes the entire area of the document image  50  into a free area, a dots-to-be-invisible area, and a non-dot area. The “free area” is a section in which both the character dots  6 J and the dots-to-be-invisible  6 S can be placed. The “dots-to-be-invisible area” is a section in which only the dots-to-be-invisible  6 S can be placed. The “non-dot area” is a section in which neither the character dots  6 J nor the dots-to-be-invisible  6 S can be placed. 
     A categorization process by the area classifying portion  104  is described below with reference to the flowchart of  FIG. 6 . 
     If the thin line detection portion  102  detects thin lines  50   h  (Yes in Step # 701  of  FIG. 6 ), and, if a gap between two neighboring thin lines  50   h  is a threshold Lk, e.g., a length corresponding to 5 dots, or smaller (Yes in Step # 702 ), then the area classifying portion  104  classifies (determines) a section between the two neighboring thin lines  50   h  as a non-dot area (Step # 704 ). The section between the two neighboring thin lines  50   h  is hereinafter referred to as a “thin line area”. 
     On the other hand, if the gap (section) between two neighboring thin lines  50   h  is greater than the threshold Lk (No in Step # 702 ), and, if the color of character dots  6 J is identical to the color of the two neighboring thin lines  50   h  (Yes in Step # 703 ), then the area classifying portion  104  determines that the thin line area is a dots-to-be-invisible area (Step # 707 ). Otherwise (No in Step # 703 ), the area classifying portion  104  determines that the thin line area is a free area (Step # 708 ). 
     If the specific pattern detection portion  101  detects a specific pattern area  50   p  (Yes in Step # 705 ), then the area classifying portion  104  classifies the specific pattern area  50   p  as a dots-to-be-invisible area (Step # 707 ). 
     If the dot density detection portion  103  detects a dot high-density area  50   d  (Yes in Step # 706 ), then the area classifying portion  104  classifies the dot high-density area  50   d  as a dots-to-be-invisible area (Step # 707 ). 
     Subsequently, the area classifying portion  104  determines (Step # 708 ), as a free area, an area that is categorized as neither a dots-to-be-invisible area nor a non-dot area through the foregoing steps. 
     Referring now back to  FIG. 3 , the background pattern image generating portion  105  generates a background pattern image  51  in accordance with a command from the personal computer  2 . In this embodiment, the background pattern image generating portion  105  generates a background pattern image  51  representing a character string of “COPY” as shown in  FIG. 5 . Note, however, that the positions of the character dots  6 J and dots-to-be-invisible  6 S are properly adjusted by the dot position determination portion  107  as is discussed later. 
     The dilation processing portion  106  dilates areas determined to be either dots-to-be-invisible areas or non-dot areas by dilation processing thereon, so that two areas adjacent to each other are allowed to contact each other. 
     The dot position determination portion  107  determines where the character dots  6 J and the dots-to-be-invisible  6 S, which constitute the background pattern image  51  generated by the background pattern image generating portion  105 , are to be positioned in the areas that have undergone the dilation processing appropriately by the dilation processing portion  106 . The determination is made in a manner based on the following method [1] and method [2]. 
     Method [1]: The character dots  6 J are placed at regular intervals Lj in an area of the document image  50  classified as a free area in such a manner that a character string “COPY” is represented. For example, the character dots  6 J are so placed that the character string is represented in the middle of the free area. If the free area is substantially large, the character dots  6 J may be so placed that a plurality of character strings “COPY” are represented side-by-side. In this embodiment, a gap between the dots (the character dots  6 J or the dots-to-be-invisible  6 S) is denoted by using the number of dots defining a distance between the centers of the dots. 
     Method [2]: The dots-to-be-invisible  6 S are placed at regular intervals Ls in an area classified as a free area, to be more specific, in a part of the free area where the character dots  6 J are not placed, in such a manner that the dots-to-be-invisible  6 S do not contact the character dots  6 J. Further, the dots-to-be-invisible  6 S are placed at regular intervals Ls in an area classified as a dots-to-be-invisible area. The interval Ls may be equal to the interval Lj. It is desirable that the interval Ls between the dots-to-be-invisible  6 S be kept also around the boundary between two neighboring areas. 
     Further, the dot position determination portion  107  adjusts the positions of the character dots  6 J and dots-to-be-invisible  6 S so that both rule [3] and rule [4] discussed below are satisfied. 
     Rule [3]: The dots-to-be-invisible  6 S are placed so as to avoid being adjacent to black pixels. Alternatively, the dots-to-be-invisible  6 S are placed so as to avoid being adjacent to other pixels having the same color as that of the dots-to-be-invisible  6 S. 
     Rule (4): In the case where the character dots  6 J and the dots-to-be-invisible  6 S are placed with a thin line  50   h  interposed therebetween, the dot position determination portion  107  places the character dots  6 J and the dots-to-be-invisible  6 S in such a manner that a distance between the thin line  50   h  and the character dot  6 J or the dot-to-be-invisible  6 S that is placed on one side with respect to the thin line  50   h  and is closest thereto is the same as a distance between the thin line  50   h  and the character dot  6 J or the dot-to-be-invisible  6 S that is placed on the other side with respect to the thin line  50   h  and is closest thereto. Suppose, for example, that the thin line  50   h  is a line extending along the up-down direction, and, that the dots-to-be-invisible  6 S and the character dots  6 J are to be placed on the left and the right of the thin line  50   h  respectively. In such a case, as shown in  FIG. 7 , the dot position determination portion  107  determines the positions of the character dots  6 J and dots-to-be-invisible  6 S in such a manner that a distance between the thin line  50   h  and the dot-to-be-invisible  6 S that is placed on the left of the thin line  50   h  and is closest thereto is the same as a distance between the thin line  50   h  and the character dot  6 J that is placed on the right of the thin line  50   h  and is closest thereto. 
     The print image data generating portion  108  disposes the character dots  6 J and the dots-to-be-invisible  6 S at the positions on the document image  50  determined by the dot position determination portion  107 ; thereby to combine the document image  50  and the background pattern image  51  together. As a result, image data for printing is generated. 
     The printing unit  10   f  prints, onto paper, the document image  50  with which the background pattern image  51  is combined based on the image data generated by the print image data generating portion  108 . 
       FIG. 8  is a flowchart depicting an example of the overall processing flow of the image forming apparatus  1 . The following is a description of steps of the overall processing for overlaying a background pattern image  51  on a document image  50  and printing the resulting image onto paper, with reference to the flowchart of  FIG. 8 . 
     When obtaining image data of the document image  50  (Step # 11  of  FIG. 8 ), the image forming apparatus  1  detects, in the document image  50 , a specific pattern area  50   p , a thin line  50   h , and a dot high-density area  50   d  (Step # 12 ). The image forming apparatus  1  classifies an area that does not correspond to any of the specific pattern area  50   p , the dot high-density area  50   d , and a thin line area as either one of a free area, a dots-to-be-invisible area, and a non-dot area (Step # 13 ). The classification method is as discussed earlier with reference to  FIG. 6 . 
     The image forming apparatus  1 , then, performs dilation processing on an area that is classified as the dots-to-be-invisible area or the non-dot area, and makes two areas adjacent to each other contact each other (Step # 14 ). 
     In parallel with the processes of Step # 12  through Step # 14  or before or after the same, the image forming apparatus  1  generates a background pattern image  51  (Step # 15 ). The image forming apparatus  1 , then, determines where to dispose, in the document image  50 , character dots  6 J and dots-to-be-invisible  6 S constituting the background pattern image  51  (Step # 16 ). 
     Subsequently, the image forming apparatus  1  places the character dots  6 J and the dots-to-be-invisible  6 S at the positions on the document image  50  determined as discussed above; thereby to overlay the background pattern image  51  on the document image  50  (Step # 17 ). The image forming apparatus  1 , then, prints the resultant image onto paper (Step # 18 ). 
       FIG. 9  is a diagram illustrating an example of a specific pattern area  50   p  of a document image  50  that is the original image depicted on paper. 
     In this embodiment, as shown in  FIG. 9 , dots-to-be-invisible  6 S are placed in a QR code contained in the document image  50 , and no character dots  6 J are placed therein. Accordingly, even when a digital camera or the like equipped in a mobile phone terminal is used to shoot the QR code in the document image  50  on which a background pattern image  51  is overlaid, the QR code can be analyzed properly with the background pattern image  51  not sensed. Further, this embodiment makes it possible to integrate the background pattern image  51  into an area other than the specific pattern area  50   p  of the document image  50 . 
     As shown in the lower-right of  FIG. 4 , this embodiment exemplifies a case in which a thin line area is an area between thin lines  50   h  having the same width. The embodiment is not limited thereto, and a one-dimensional bar code may be regarded as the thin line area. Stated differently, a one-dimensional bar code may be dealt with as a specific pattern area  50   p , and also, as a thin line area. 
     It is a matter of course that, when a printed matter obtained by using the apparatus or method according to the present invention is copied to paper, among dots constituting the background pattern image  51 , only character dots  6 J are copied onto the paper. In short, a character string such as “COPY” is conspicuously visible in the duplicate. It is, thus, possible to deter a person from making unauthorized copying of the document image  50 , namely, the original document. 
     In the embodiments discussed above, the overall configurations of the image forming apparatus  1 , the configurations of various portions thereof, the content to be processed, the processing order, the structure of the document image  50 , and the like may be altered as required in accordance with the subject matter of the present invention. 
     While example embodiments of the present invention have been shown and described, it will be understood that the present invention is not limited thereto, and that various changes and modifications may be made by those skilled in the art without departing from the scope of the invention as set forth in the appended claims and their equivalents.