Patent Description:
There are known several infrared latent image printing techniques of printing an image embedded with an infrared latent image as information that is invisible under normal light and detectable simply by an infrared light sensing device.

One of the infrared latent image printing techniques uses a transparent toner that transmits visible light while including a component that absorbs infrared light. According to this technique, since the transparent toner is transparent to visible light, an image including an infrared latent image that is detectable by infrared light alone is printable with the transparent toner on a white background or atop infrared transmissive toner such as cyan, magenta, or yellow toner.

Another one of the infrared latent image printing techniques uses carbon black that absorbs both the infrared light and the visible light. This technique is advantageously implementable by a general-purpose printer.

<CIT> discloses a technique of forming an image including an infrared latent image with general-purpose cyan, magenta, yellow, and black toners, without using a special transparent toner. Since the cyan, magenta, and yellow toners are transparent, an infrared sensing device simply displays a portion in which the black toner is embedded.

However, the infrared latent image printing technique that uses the transparent toner is not widely used because a colorant such as the transparent toner including a component that absorbs infrared light is more expensive than general-purpose colorants such as cyan, magenta, and yellow toners.

With respect to the infrared latent image printing technique that uses carbon black, since the carbon black is non-transparent even to visible light and therefore a simple overprinting renders an infrared latent image printed with carbon black naturally visible under visible light, a special synthesizing process may be performed to camouflage the infrared latent image with a background image.

The technique disclosed in <CIT> renders a gray component indispensable for masking a latent image by metameric color matching between the latent image and a background image. In addition, a latent image formed by the technique disclosed in <CIT> may slightly appear due to changes in viewing circumstance even when the gray component is present in the background image, because the metamerism ensures identical perception of colors under specific illumination light (e.g., D50).

<CIT> discloses a watermark embedded in an image that has the property of being relatively indecipherable under normal light, and yet decipherable under UV light. This fluorescent mark comprises a substrate containing optical brightening agents, and a first colorant mixture pattern printed as an image upon the substrate. The colorant mixture pattern layer has as characteristics a property of strongly suppressing substrate fluorescence, as Well as a property of low contrast under normal illumination against the substrate or a second colorant mixture patten printed in close spatial proximity to the first colorant mixture pattern. The second colorant mixture patten having a property of providing a differing level of substrate fluorescence suppression from the first such that the resultant image rendered substrate suitably exposed to an ultra-violet light source, will yield a discernable image evident as a fluorescent mark.

<CIT> discloses a method for creation of a substrate fluorescence mask having background color(s), UV mark color(s), and distraction color(s), to be printed as an image on a substrate containing optical brightening agents. The method includes selecting one or more UV mark colors for the mask such that the UV mark colors exhibit low contrast against the background color(s) under normal illumination and high contrast against the background color(s) under UV illumination. One or more distraction colors are also selected, such that the distraction color(s) exhibit low contrast against the background color(s) under UV illumination and exhibit high contrast against the background color(s) under normal illumination. A distraction pattern, formed from one or more distraction colors, is also selected.

<CIT> discloses systems and methods that facilitate generating a background image with a UV-fluorescent watermark for printing on a document. A binary watermark mask is generated to separate the background image into the UV-active and the UV-dull regions. Based on the assigned binary value of the watermark mask, each pixel is assigned a UV-active or UV dull color using an adaptive halftoning technique, in order to generate a binary UV-active image and a binary UV-dull image. A binary watermarked background image is generated by combining the binary UV-active and UV-dull images, and s printed on a document. The UV-active and UV-dull colors have different UV intensities under UV light, but are indistinguishable under normal lighting conditions. In this manner, the background image is visible when exposed to visible light, and the UV-fluorescent watermark is visible When exposed to UV light.

<CIT> discloses a watermark embedded in an image that has the property of being relatively indecipherable under normal light by including a distraction pattern, and yet remains decipherable under infrared illumination when viewed by a suitable infrared sensitive instrument. This infrared mark comprises, a substrate reflective to infrared radiation, a foreground colorant mixture printed as an image upon the substrate, a background colorant mixture and a distraction colorant mixture.

In light of the above-described problems, it is a general object of the present invention to form an enhanced stealth latent image.

In order to achieve the above-mentioned object, there is provided an image processing device according to claim <NUM>. Advantageous embodiments are defined by the dependent claims. Advantageously, the image processing device includes among other features an auxiliary masking unit, a color-matching masking unit, and a latent image embedding unit. The auxiliary masking unit is configured to process a background image into which a latent image is embedded, to obtain an effect to conceal the latent image. The color-matching masking unit is configured to perform color conversion of the background image to obtain a color-matching masking effect to conceal the latent image. The latent image embedding unit is configured to embed the latent image in the background image processed and converted by the auxiliary masking unit and the color-matching masking unit, respectively, to generate an image embedded with the latent image.

Accordingly, an enhanced stealth latent image is formed by taking advantages of a color-matching masking effect and an effect that compensates for a defect of the color-matching masking effect in a mutually complementary manner to conceal the latent image.

Advantageously, there is also provided a method of embedding a latent.

A more complete appreciation of the embodiments and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings, wherein:.

Although the embodiments are described with technical limitations with reference to the attached drawings, such description is not intended to limit the scope of the disclosure and not all of the components or elements described in the embodiments of the present disclosure are indispensable to the present disclosure.

In a later-described comparative example, embodiment, and exemplary variation, for the sake of simplicity, like reference numerals are given to identical or corresponding constituent elements such as parts and materials having the same functions, and redundant descriptions thereof are omitted unless otherwise required.

It is to be noted that, in the following description, suffixes Y, M, C, and K denote colors of yellow, magenta, cyan, and black, respectively. To simplify the description, these suffixes are omitted unless necessary.

Referring to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views, embodiments of the present disclosure are described below.

Initially with reference to <FIG>, a description is given of a first embodiment of the present disclosure.

<FIG> is a schematic cross-sectional view of an image forming apparatus <NUM> according to the first embodiment of the present disclosure.

The image forming apparatus <NUM> serving as an image processing apparatus is a multifunction peripheral (MFP) having at least two of copying, printing, scanning, and facsimile functions.

As illustrated in <FIG>, the image forming apparatus <NUM> includes a sheet feeder <NUM>, a housing <NUM>, a scanner <NUM>, and an automatic document feeder (ADF) <NUM>.

The image forming apparatus <NUM> includes a plotter <NUM> serving as an image forming device inside the housing <NUM>. The plotter <NUM> includes a tandem image forming unit <NUM>, a registration roller pair <NUM> that supplies the image forming unit <NUM> with a recording medium fed by the sheet feeder <NUM> through a conveyance passage <NUM>, an optical writing device <NUM>, a fixing device <NUM>, and a duplex tray <NUM>.

In the image forming unit <NUM>, four drum-shaped photoconductors <NUM> are arranged side by side to form toner images of yellow (Y), magenta (M), cyan (C), and black (K), respectively. Note that the black toner is an infrared absorbing visible toner. Each of the four photoconductors <NUM> is surrounded by various pieces of image forming equipment such as a charger, a developing device <NUM>, a transfer device, a cleaner, and a neutralizer. An intermediate transfer belt <NUM>, entrained around a drive roller and a driven roller, is disposed while being sandwiched between the four photoconductors <NUM> and the respective transfer devices.

In the tandem image forming apparatus <NUM> configured as described above, the scanner <NUM> reads a document image, which is an image of a document fed by the ADF <NUM>, for example. The optical writing device <NUM> optically writes a latent image on the photoconductor <NUM> for each color of Y, M, C, and K according to data of the image. The developing device <NUM> develops the latent image into a toner image for each color. The toner images are primarily transferred onto the intermediate transfer belt <NUM> in the order of Y, M, C, and K, for example. Specifically, the toner images of the four colors are superimposed one atop another on the intermediate transfer belt <NUM> in a primary transfer process. Thus, a composite full-color toner image is formed on the intermediate transfer belt <NUM>. Then, in the image forming apparatus <NUM>, the full-color toner image is secondarily transferred onto a recording medium supplied from the sheet feeder <NUM>. Thereafter, the fixing device <NUM> fixes the full-color toner image onto the recording medium. Finally, the recording medium bearing the fixed toner image is ejected. Thus, the image forming apparatus <NUM> forms a full-color image on a recording medium.

Referring now to <FIG>, a description is given of a hardware configuration of the image forming apparatus <NUM> described above.

<FIG> is a block diagram illustrating a hardware configuration of the image forming apparatus <NUM>.

As illustrated in <FIG>, the image forming apparatus <NUM> includes an image processing device <NUM> that processes a document image read by the scanner <NUM> and outputs the processed image as image data to the plotter <NUM>. The scanner <NUM>, the ADF <NUM>, and the image processing device <NUM> construct a tilt correction device and a reading device.

The image processing device <NUM> includes a central processing unit (CPU) <NUM>, a read only memory (ROM) <NUM>, a main memory <NUM>, a chipset <NUM>, an image processing application specific integrated circuit (ASIC) <NUM>, a controller ASIC <NUM>, a main memory <NUM>, and an input/output (I/O) ASIC <NUM>.

The CPU <NUM> controls the image forming apparatus <NUM>. The main memory <NUM> is a memory into which a program is loaded to cause the CPU <NUM> to control the image forming apparatus <NUM>. The main memory <NUM> is used as a work area for the CPU <NUM>. The main memory <NUM> is also used as an image memory to temporarily store image data to be handled. The chipset <NUM> is used together with the CPU <NUM> to control an access from the controller ASIC <NUM> and the I/O ASIC <NUM> to the main memory <NUM>.

The program executed by the image forming apparatus <NUM> according to the present embodiment may be stored in a computer- readable storage medium, such as a compact disc read-only memory (CD-ROM), a flexible disk (FD), a compact disc recordable (CD-R), and a digital versatile disk (DVD), in an installable or executable file format, to be provided.

Alternatively, the program executed by the image forming apparatus <NUM> according to the present embodiment may be stored in a computer connected to a network such as the Internet and downloaded via the network, thus being providable. The program executed by the image forming apparatus <NUM> according to the present embodiment may be provided or distributed via a network such as the Internet.

The scanner <NUM> has a function of reading image data to be copied or output to an external interface, for example. The plotter <NUM> has a function of printing image data stored in the main memory <NUM>.

The image processing ASIC <NUM> performs image processing on image data read by the scanner <NUM> and outputs the processed image data to the controller ASIC <NUM>. In addition, the image processing ASIC <NUM> performs image processing on image data from the controller ASIC <NUM> to allow the plotter <NUM> to print the image data. According to print timing of the plotter <NUM>, the image processing ASIC <NUM> transmits the processed image data to the plotter <NUM>.

The controller ASIC <NUM> uses the main memory <NUM> over the chipset <NUM> to rotate and edit image data handled by the image forming apparatus <NUM>. The controller ASIC <NUM> stores the image data in a hard disk drive (HDD) <NUM>. The controller ASIC <NUM> transmits and receives the image data to and from the image processing ASIC <NUM>. The main memory <NUM> is used as an image memory with which the controller ASIC <NUM> performs image processing. The HDD <NUM> is used to temporarily store processed image data.

The I/O ASIC <NUM> is an external interface that gives an additional function to the image forming apparatus <NUM>. For example, the I/O ASIC <NUM> includes interfaces such as a network interface, a universal serial bus (USB), a secure digital (SD) card, an operation unit, a serial peripheral interface (SPI), an inter-integrated circuit (I2C), and a document width sensor (or width detection sensor) interfaces, a hardware accelerator that accelerates image processing, and an encryption processing circuit.

Referring now to <FIG>, a description is given of functions exerted by the image processing device <NUM>.

<FIG> is a functional block diagram of the image processing device <NUM> according to the first embodiment of the present disclosure.

Note that a description is herein given of characteristic functions of the present embodiment among the functions exerted by the image processing device <NUM>.

The image processing device <NUM> generally has a function of generating an image embedded with a latent image with four colorants including a black colorant exhibiting an infrared absorption characteristic and cyan, magenta, and yellow colorants each exhibiting an infrared transmission characteristic, by taking advantages of a color-matching masking effect and a visual masking effect that compensates for a defect of the color-matching masking effect in a mutually complementary manner. The plotter <NUM> prints the generated image that is embedded with the latent image, thereby producing a printed matter including an infrared latent image.

The infrared latent image herein refers to image information that is difficult to be visually recognized under visible light and detectable simply by a sensing device having a reaction in infrared. An image embedded with a latent image described below refers to an image in which invisible information including an infrared latent image is embedded. A background image described below represents a visible image into which a latent image is embedded. When an image embedded with a latent image is viewed, the background image is viewed alone. A latent image described below refers to image information that is embedded as invisible information into the background image.

A masking effect refers to a physical mask effect to conceal a latent image. Masking refers to image processing applied to a background to obtain the masking effect.

As illustrated in <FIG>, the image processing device <NUM> includes a first masking unit <NUM>, a second masking unit <NUM>, and a latent image embedding unit <NUM>.

The first masking unit <NUM> serving as an auxiliary masking unit performs a first masking process to conceal a latent image. The first masking process refers to a process of changing a density change characteristic between pixels in an image to obtain a visual masking effect to conceal the latent image. The first masking process is herein referred to as a visual masking process.

In other words, the first masking unit <NUM> serving as an auxiliary masking unit is configured to process a background image into which a latent image is embedded, to obtain an effect to conceal the latent image. The first masking unit <NUM> is configured to change a density change characteristic between pixels in the background image to obtain a visual masking effect to conceal the latent image.

In general, changes in density such as noise are easily noticed with respect to a flat portion having little density change of an image. By contrast, the changes in density such as noise are hardly noticed with respect to a portion having a great density change, because the changes in density are confused with surrounding density differences. Such a human sensing characteristic is called a visual masking effect.

<FIG> is a diagram illustrating a way disclosed in <CIT>, in which a specific pattern writing unit separates a background color of image information to extract color components and determines an appropriate density based on the extracted color components.

As illustrated in graph <NUM> of <FIG>, the specific pattern writing unit separates the background color of the image information received from a scanner into YMC color components and extracts a black component (hatched by diagonal lines in graph <NUM> of <FIG>). According to a first embodiment of <CIT>, the specific pattern writing unit separates the background color of the image information to extract the color components and determines an appropriate density based on the extracted color components. Accordingly, a specific pattern is added in an inconspicuous manner without deteriorating the color reproducibility of a copy. In addition, the detection accuracy is increased to reliably track the copy.

In the embedment of an infrared pattern using the metamerism as in the aforementioned technique disclosed in <CIT>, color matching conditions change due to changes in the illumination environment or changes in density of an image forming apparatus. Accordingly, a visual difference occurs between a portion embedded with a latent image and a portion not embedded with the latent image. Therefore, an advantage of the visual masking effect is to be taken to conceal the latent image.

In order to take the advantage of the visual masking effect, the first masking unit <NUM> synthesizes a specific masking pattern and a background image into which a latent image is embedded, so as to prevent visualization of the latent image.

<FIG> is a diagram illustrating an example of the background image, as a target background image, into which a latent image is embedded.

As illustrated in <FIG>, the target background image is not a gray image entirely constructed of cyan, magenta, and yellow. As a background color component of the target background image, a reddish color represented by magenta and yellow values is used. That is, the target background image does not include a cyan component. In other words, the target background image is formed with colors that do not include a gray component.

<FIG> is a diagram illustrating an example of the first masking process.

As illustrated in <FIG>, a grid waveform is an example of a specific masking pattern. The first masking unit <NUM> synthesizes the specific masking pattern and a target background image into which a latent image is embedded.

Note that, in order to increase the visual masking effect, the pattern type and intensity is desirably changed according to the spatial frequency characteristics of the background image and the latent image. For example, a user or an administrator may select any pattern type and intensity from a plurality of pattern types and intensities. In addition to the changes to pattern, aperiodic noise may be added. A detailed description is deferred of how to select and adjust the pattern.

The second masking unit <NUM> serving as a color-matching masking unit performs a second masking process to conceal a latent image. The second masking process refers to a process of performing color conversion to enhance a color-matching masking effect to conceal a latent image. The second masking process is herein referred to as a color-matching masking process. The color-matching masking effect is defined as an effect of concealing a latent image in a background by taking an advantage of a masking effect from the metamerism. In other words, the second masking unit <NUM> serving as a color-matching masking unit is configured to perform color conversion of the background image to obtain a color-matching masking effect to conceal the latent image.

<FIG> is a diagram illustrating a relationship between a density of black to be embedded and cyan, magenta, and yellow (CMY) amounts (or densities) to be added.

Embedding an infrared pattern using black toner as in the technique disclosed in <CIT> uses a gray component (i.e., CMY components) corresponding to the density of the black to be embedded as illustrated in <FIG>. In a case in which the gray component corresponding to the density of the black to be embedded is absent, the color tones do not metamerically match before and after the CMY-to-CMYK conversion, rendering the latent image visible.

<FIG> is a diagram illustrating an example of the second masking process.

As illustrated in <FIG>, the second masking unit <NUM> adds the gray component corresponding to a density value of the black to be embedded, to attain a metameric color match before and after an embedding process. In other words, the second masking unit <NUM> serving as a color-matching masking unit is configured to add a gray component as color conversion of a background image.

Note that, as the CMY amounts added by the second masking unit <NUM>, the CMY values are desirably used that metamerically match black having a predetermined density and used for embedment.

With such a color adjustment, a masking effect is obtained taking an advantage of the metamerism even for a background image of any color.

Referring now to <FIG> and <FIG>, a detailed description is given of how to determine a gray component to be added in the color-matching masking process performed by the second masking unit <NUM>.

<FIG> is a diagram illustrating an amount of gray added in the color-matching masking process. <FIG> is a reference table illustrating a relationship between an amount of black to be embedded and corresponding print amounts of CMY-gray, that is, cyan, magenta, and yellow (CMY) that generate gray.

<FIG> illustrates CMY-gray as a metamer of K-gray. Note that the CMY-gray is generated by printing C, M, and Y in equal amount. The K-gray is generated by K component. Since the combination of CMY as a metamer of the K-gray differs depending on the characteristics of colorants used in the image forming apparatus <NUM>, the combination of CMY is preferably determined according to the characteristic of the image forming apparatus <NUM>. In other words, the conditions for metamerism depend on the characteristics of printing devices.

As an example of the combination of CMY, <FIG> illustrates 3C gray as a metamer of the K-gray in the image forming apparatus <NUM>. As illustrated in <FIG>, when K = <NUM>%, appropriate percentages of C, M, and Y are <NUM>%, <NUM>%, and <NUM>%, respectively, to generate the 3C gray as a metamer of the K-gray under a D50 light source. Note that the K-gray does not metamerically match a gray generated by C =<NUM>%, M = <NUM>%, and Y = <NUM>%.

In the color-matching masking process, the second masking unit <NUM> preferably adds C = <NUM>%, M = <NUM>%, and Y = <NUM>% as an amount of gray, in a case in which a latent image is formed with a maximum print amount of K = <NUM>%. By adding, to an entire image, the CMY amounts corresponding to the maximum print amount of K used for embedment, the color-matching masking process can be performed on any background color.

<FIG> illustrates a metameric relationship between various print amounts of K and the respective print amounts of C, M, and Y in the image forming apparatus <NUM>. Retaining the CMY amounts corresponding to the print amount of K as a reference table as illustrated in <FIG> allows determination of an amount of gray to be added appropriate for a variable density of a latent image to be embedded. Note that, in the present embodiment, the reference table illustrated in <FIG> is used for adding gray. Alternatively, the reference table may be used for adding K and reducing C, M, and Y.

As described above, the amount of gray to be added is automatically determined with reference to the table illustrated in <FIG>. Alternatively, for example, a user may adjust the amount of gray to be added, in consideration of the design or designability. For example, a user who is concerned about the graying of a background rather than the stealth may not necessarily add the gray component corresponding to the maximum density. For example, in a case in which a latent image is embedded at a density of K = <NUM>% at maximum, a gray component corresponding to K = <NUM>% may be added, placing importance on the designability. In a case in which a latent image corresponding to a maximum density of K = <NUM>% is embedded and importance is placed on the stealth, a gray component corresponding to K = <NUM>% may be added to a background image. In other words, the second masking unit <NUM> serving as a color-matching masking unit is configured to determine the gray component according to a density of the latent image. Alternatively, the gray component may be manually adjustable by, e.g., a user.

As described above, in an infrared embedding pattern using a visible black toner, one type of masking effect is insufficient to conceal a latent image. To sufficiently conceal a latent image, in the present embodiment, masking processes are performed in combination, such as the first masking process to obtain a visual masking effect and the second masking process to obtain a masking effect from the metamerism.

The first masking unit <NUM> and the second masking unit <NUM> generate a masked background image subjected to the first masking process and the second masking process to conceal a latent image with enhanced confidentiality.

Referring back to <FIG>, the latent image embedding unit <NUM> performs a latent image synthesizing process of embedding a designated latent image in the masked background image generated by the first masking unit <NUM> and the second masking unit <NUM> to generate an image embedded with the latent image. In other words, the latent image embedding unit <NUM> is configured to embed the latent image in the background image processed by the first masking unit <NUM> serving as an auxiliary masking unit and converted by the second masking unit <NUM> serving as a color-matching masking unit, to generate an image embedded with the latent image. Note that the latent image information is preferably image information designated with the K plane. The latent image embedding unit <NUM> changes an amount of generation of a black component according to the pixel value of the latent image, thereby embedding the latent image.

Referring now to <FIG>, a description is given of a flow of a latent image embedding process performed by the latent image embedding unit <NUM>.

<FIG> is a schematic flowchart of the latent image embedding process.

In the latent image embedding process, which is also referred to as a latent image synthesizing process, illustrated in <FIG>, the latent image embedding unit <NUM> performs the following process on all pixel values in a masked background image.

As illustrated in <FIG>, in step S1, the latent image embedding unit <NUM> acquires a pixel value (as a CMY value) of the masked background image generated by the first masking unit <NUM> and the second masking unit <NUM>.

Subsequently in step S2, the latent image embedding unit <NUM> refers to a pixel value of a latent image at a pixel position identical to a position of a reference pixel of the masked background image. In the present example, the latent image embedding unit <NUM> refers to K-plate information (i.e., K value) as the latent image is formed by the K plate. In addition, the latent image is binarized.

Subsequently in step S3, the latent image embedding unit <NUM> determines whether the pixel value (i.e., K value) of the latent image is greater than <NUM> (i.e., K > <NUM>).

When the latent image embedding unit <NUM> determines that the pixel value (i.e., K value) of the latent image is greater than <NUM> (YES in step S3), that is, when the pixel is a black pixel, the latent image embedding unit <NUM> performs high black conversion to replace the CMY value with K in step S4. Note that decreased CMY amounts are adjusted in the CMY-to-CMYK conversion such that the color tone (e.g., Lab) does not theoretically change under visible light at the time of conversion, in other words, such that the color tone before conversion and the color tone after conversion metamerically match.

On the other hand, when the latent image embedding unit <NUM> determines that the pixel value (i.e., K value) is not greater than <NUM> (NO in step S3), specifically, when the pixel value is <NUM> (i.e., K = <NUM>), the latent image embedding unit <NUM> does not generate K, leaving the CMY value unchanged in step S5. Alternatively, the latent image embedding unit <NUM> may perform low black conversion to generate K in less amount than the amount of K generated when the pixel value (i.e., K value) of the latent image is greater than <NUM>. Note that, even in a case in which the latent image embedding unit <NUM> performs the low black conversion, the CMY-to-CMYK conversion is adjusted such that the color tones metamerically match before and after the conversion.

In step S6, the latent image embedding unit <NUM> newly stores the CMYK amount (i.e., CMYK value) generated in step S4 or step S5 as a pixel value of an image embedded with the latent image.

The latent image embedding unit <NUM> repeats the processing of steps S1 to S6 on all the pixels of the masked background image to generate a new image embedded with the latent image. Since the color tone is herein adjusted not to change under visible light at the time of CMY-to-CMYK conversion, the image embedded with the latent image and the masked background image do not change visually when the images are output. However, in the image embedded with the latent image, the generated amount of K differs for each pixel depending on the pixel values of the latent image.

<FIG> illustrate a difference between a visual image and an infrared image of a printed matter produced by printing an infrared latent image generated by the image processing device <NUM>. Specifically, <FIG> is a diagram illustrating a latent image and an image embedded with the latent image. <FIG> is a diagram illustrating the difference between the visual image and the infrared image of the printed image embedded with the latent image.

More specifically, <FIG> illustrates an example in which a binary image storing a Quick Response (QR) code (registered trademark) is embedded as a latent image in a uniform background image subjected to the first masking process and the second masking process.

In the image embedded with the latent image, K is generated according to the characteristic amount of the QR code as illustrated in <FIG>. When the image forming apparatus <NUM> prints the image embedded with the latent image with CMYK toners to faithfully reproduce the pixel values of the image embedded with the latent image, the masked background image is viewed as illustrated in <FIG>.

On the other hand, through an infrared sensing device, CMY toners are transparent because the CMY toners have a transmission characteristic; whereas K toner appears black because the K toner has an absorption characteristic. Therefore, the QR code embedded as a latent image can be confirmed with the infrared sensing device.

As described above, in the color-matching masking process as the second masking process according to the present embodiment, color tones of a background image metamerically match before and after the CMY-to-CMYK conversion is performed to embed a latent image in the background image, even in a case in which the background image does not include a gray component and therefore the technique disclosed in <CIT> fails to satisfy the metamerism. Thus, in the present embodiment, the color-matching masking effect prevents visualization of the latent image.

In addition, the visual masking process as the first masking process generates a change in shading in the background image, which is originally in a uniform color. Thus, the visual masking process provides a visual masking effect. Accordingly, even in a case in which the conditions for metamerism change due to density fluctuations or changes in viewing circumstance, the present embodiment prevents visualization of the latent image.

Further, in the present embodiment, the color-matching masking process is performed after the visual masking process. In a case in which the visual masking process is performed after the color-matching process, changes in shading resulting from the visual masking process may cause the conditions for metamerism collapse. To address such a situation, the color-matching masking process is performed after the visual masking process in the present embodiment. In addition, in combination with any other masking processes, the color-matching masking process is desirably performed as a last process.

Referring now to <FIG>, a description is given of how to select a mask pattern (or spatial pattern) to be added in the visual masking process according to an attribute of a latent image.

<FIG> illustrate some examples of a mask pattern selected according to attributes of latent images. <FIG> is a diagram illustrating a first example of the mask pattern selected according to an attribute of a latent image. <FIG> is a diagram illustrating a second example of the mask pattern selected according to an attribute of another latent image. <FIG> is a diagram illustrating a third example of the mask pattern selected according to an attribute of yet another latent image.

Specifically, <FIG> illustrate different types of mask pattern to be added, according to the attributes of the latent images. In other words, the first masking unit <NUM> serving as an auxiliary masking unit is configured to synthesize a spatial pattern and a background image into which a latent image is embedded. The first masking unit <NUM> is configured to select one type of the spatial pattern from a plurality of types of the spatial pattern according to an attribute of the latent image. One approach to concealing a latent image involves a mask pattern having a characteristic similar to a typical characteristic of the latent image, because such a mask pattern makes it difficult to visually distinguish between the mask pattern and the latent image and prevents visualization of the latent image.

Specifically, <FIG> illustrates a mask pattern suitable for embedding a QR code as a latent image. In a case in which a latent image having a two-dimensional grid pattern such as a QR code is used, a mask pattern in a grid waveform is desirably used in which the positional information (X, Y) of the image is indicative of the phase information. In other words, the spatial pattern is a grid pattern having coordinate information as phase information.

<FIG> illustrates a mask pattern suitable for embedding a circular mark as a latent image. In general, typical graphic shapes such as circles, triangles, and quadrangles remain as memory shapes in the human brain and are easily recognized. Therefore, a slight change in density of a latent image in such a shape may facilitate visual recognition of the latent image. To address such a situation, in a case in which a latent image has a graphic shape such as a circle, a triangle, or a quadrangle, it is desirable to embed a mask pattern having an attribute close to the graphic shape of the latent image. <FIG> illustrates a spherical wave pattern to be added as a visual masking pattern so as to prevent visualization of the circular mark. In other words, the spatial pattern is a spherical wave pattern having a distance from a specific position as phase information. The distance from a specific position is, e.g., a distance from an image center as illustrated in <FIG>.

<FIG> is a graph illustrating how to adjust the phase of a mask pattern.

As illustrated in <FIG>, the phase of the mask pattern is adjusted so as to superimpose a peak of the spherical wave increased in density atop a black portion of the circular mark. As a consequence, even in a case in which the circular portion becomes visible due to density fluctuations or changes in viewing circumstance, the circular portion is visually mixed with the spherical wave that causes the density fluctuations. Thus, the present example further reduces the visibility of the latent image and enhances the stealth.

<FIG> illustrates a wave-front pattern in which a square wave radially spreads from the center, as a mask pattern for visual masking to conceal a quadrangular latent image. In other words, the spatial pattern is a quadrangular or rectangular wave pattern. As in the case of the spherical wave illustrated in <FIG>, a peak of the wave front is superimposed atop the quadrangular latent image to prevent visualization of the latent image.

<FIG> illustrate some frequency examples of a mask pattern selected according to attributes of latent images. <FIG> is a diagram illustrating a first frequency example of a mask pattern selected according to an attribute of a latent image. <FIG> is a diagram illustrating a second frequency example of the mask pattern selected according to an attribute of another latent image. <FIG> is a diagram illustrating a third frequency example of the mask pattern selected according to an attribute of yet another latent image.

In other words, <FIG> illustrate how to adjust the cycle of a visual mask pattern in a case in which a QR code is embedded as a latent image.

In <FIG>, a code having a relatively small minimum cell and a relatively high spatial frequency is synthesized with a dense pattern having a relatively high spatial frequency as a visual mask pattern.

On the other hand, in <FIG>, a code having a relatively large minimum cell and a relatively low spatial frequency is synthesized with a pattern having a relatively low frequency as a visual mask pattern.

Note that the density cycle of the visual mask pattern is preferably matched with a print cycle of the cell size of the QR code. This is because signals having closer spatial frequencies are harder for humans to separately recognize as different signals, thus effectively preventing visualization of the latent image.

Note that a computer may automatically select the type of spatial pattern and adjust the phase based on an attribute of a background image as described above. Alternatively, a user, for example, may manually select the type of spatial pattern and adjust the phase with reference to the aforementioned rules relative to the latent image. In other words, the first masking unit <NUM> serving as an auxiliary masking unit is configured to determine one of a period and amplitude information of the spatial pattern according to an attribute of the latent image. Alternatively, one of a period and amplitude information of the spatial pattern may be manually changeable by, e.g., a user.

A spatial pattern synthesized with a background image as described above provides a visual masking effect, even in a case in which the background image is a flat image without a portion having great density fluctuations and hampers visual masking.

<FIG> is a diagram illustrating some examples of effects resulting from visual masking.

Specifically, <FIG> illustrates latent images in the upper row and images embedded with latent images in the middle and lower rows. Specifically, <FIG> illustrates, in the middle row, the images in which the latent images in the upper row are embedded in uniform background images, respectively. <FIG> illustrates, in the lower row, the images in which the latent images in the upper row are embedded in the background images to which visual masking patterns are added, respectively.

More specifically, in the middle row of <FIG>, the latent images are visualized on the uniform background images, respectively, because the conditions for metamerism are not satisfied at the time of image formation due to changes in viewing circumstance or the density fluctuations of device.

By contrast, as illustrated in the lower row of <FIG>, visualization of the latent images is prevented on the background images embedded with the visual masking patterns having attributes close to the attributes of the latent images, respectively, regardless of changes in viewing circumstance or the density fluctuations of device.

<FIG> illustrate other examples of the visual masking pattern.

With reference to <FIG>, a description is given above of a grid pattern formed in a two-dimensional sine wave to mask a QR code. Alternatively, a rectangle pattern as illustrated in <FIG> may be used.

Note that the grid pattern as illustrated in <FIG> and the rectangle pattern as illustrated in <FIG> may be selected by, e.g., a user in consideration of the designability.

In a case in which a specific shape such as a circle, a quadrangle, or a QR code does not exist, a background image may be synthesized with an aperiodic noise signal, as illustrated in <FIG>, as a visual masking pattern. In other words, the spatial pattern is an aperiodic noise signal. Such an aperiodic signal has a relatively high affinity with any latent image shape. Adjustment of the period and the amount of noise of the aperiodic signal maintains the designability of the background image.

According to the present embodiment, in a technique of embedding an infrared latent image by a combination of visible colorants having different optical characteristics such as cyan, magenta, yellow, and black, a latent image is concealed by taking advantages of the color-matching masking effect and the visual masking effect that compensates for the defect of the color-matching masking effect in a mutually complementary manner. Accordingly, an enhanced stealth or confidential latent image is formed.

Note that, in the present embodiment, the visual masking effect and the color-matching masking effect are described as examples. Advantages of other different masking effects may be taken in combination depending on the properties of the background image and the latent image.

Referring now to <FIG>, a description is now given of a second embodiment of the present disclosure.

According to the first embodiment, the first masking unit <NUM> adds a visual masking pattern to a background image in the first masking process. The second masking unit <NUM> adds a gray component in the second masking process. By taking advantages of the visual masking and the color-matching masking, an enhanced stealth latent image is formed.

However, in a case in which an original background image includes a portion exhibiting a visual masking effect, such as a portion having a high contract, and a portion having a sufficient gray component and exhibiting a color-matching masking effect, the background image may not be subjected to the masking processes described above.

Therefore, in the second embodiment different from the first embodiment, the background image is segmented so that the visual masking effect and the color-matching masking effect are determined for each segment to search, in the background image, a portion in which an enhanced stealth latent image can be embedded. In the second embodiment, an enhanced stealth latent image is embedded by taking advantages of multiple masking effects such as the visual masking effect and the color-matching effect complementarily, without processing the background image as in the first embodiment. A redundant description of identical features in the first and second embodiments is herein omitted; whereas a description is now given of features of the second embodiment different from the features of the first embodiment.

<FIG> is a functional block diagram of an image processing device 200A according to the second embodiment of the present disclosure.

As illustrated in <FIG>, the image processing device 200A includes a first masking effect determining unit <NUM>, a second masking effect determining unit <NUM>, the latent image embedding unit <NUM>, a segmenting unit <NUM>, a candidate segment determining unit <NUM>, an embedment background image extracting unit <NUM>, and a background image synthesizing unit <NUM>.

The segmenting unit <NUM> segments a background image into which a latent image is embedded.

<FIG> is a diagram illustrating an example of the background image.

As illustrated in <FIG>, the background image of the present embodiment is a mixture of a portion having a high contrast and a portion having a relatively low contrast. The gray component may be present or absent depending on the segments of the background image.

Now, a description is given of segmentation of the background by the segmenting unit <NUM>.

<FIG> is a diagram illustrating an example of segmentation of the background image.

According to the example of segmentation illustrated in <FIG>, the segmenting unit <NUM> segments the background image in a grid pattern. Note that the segmenting unit <NUM> may adjust the segment position for each user, instead of fixing the segment position.

The segmenting unit <NUM> outputs the segmented background image to the first masking effect determining unit <NUM>.

The first masking effect determining unit <NUM> serving as an auxiliary masking effect determining unit determines, for each segment of the background image, a visual masking degree that indicates the effectiveness of visual masking.

<FIG> is a diagram illustrating an example of determination of the visual masking degree for the background image segmented as illustrated in <FIG>.

A description is now given of some ways of determination of the visual masking degree.

Initially, a description is given of a first way of determination. According to the first way, the visual masking degree is determined as "large" when the segment of the background image includes a relatively large number of components contrasting sharply in shading. By contrast, the visual masking degree is determined as "small" when the segment of the background image includes a relatively small number of components contrasting sharply in shading. Such determination may be made based on a histogram distribution. In a case in which a pixel histogram distribution indicates a relatively large degree of dispersion, the segment of the background image includes pixels in a plurality of colors and has a relatively high contrast. By contrast, in a case in which the pixel histogram distribution indicates a relatively small degree of dispersion, the segment of the background image includes uniform pixels that construct a flat image.

A description is now given of a second way of determination. According to the second way, the visual masking degree is determined based on whether or not the segment of the background image includes, among the spatial frequency components that construct a latent image, a relatively large amount of main spatial frequency component (i.e., spatial frequency component of the latent image). The second way of determination is effective because the spatial frequency components of a background image close to the spatial frequency components of a latent image make it hard for human vision to separate signals, thus facilitating concealment of the latent image.

A description is now given of a third way of determination. According to the third way, a user, for example, visually determines whether an image in a segment has the contrast and subjectively evaluates the visual masking degree.

The second masking effect determining unit <NUM> serving as a color-matching masking effect determining unit determines, for each segment of the background image, a color-matching masking degree that indicates the effectiveness of color-matching masking.

<FIG> is a diagram illustrating an example of determination of the color-matching masking degree for the background image segmented as illustrated in <FIG>.

A description is now given of a way of determination of the color-matching masking degree.

The color-matching masking degree is determined by analyzing pixel values such as red-green-blue (RGB) values or CMY values in a segment of the background image. Specifically, the second masking unit <NUM> analyzes the gray component in an RGB value or a CMY value. The gray component may be extracted by extracting a common component of the RGB value or the CMY value. For example, when CMY = (<NUM>%, <NUM>%, <NUM>%), <NUM>% common in the CMY value may be extracted as a gray component. In the case of an RGB signal, the RGB signal may be converted into a hue-saturation-value (HSV) signal. The gray component may be determined by a value of saturation (S).

The gray component of an entire segment may be temporarily determined as a gray component for an average value of all the pixels of the segment. Alternatively, the gray component of the entire segment may be determined by counting pixel values having a predetermined gray component or greater. The color-matching masking degree is determined according to the amount of the gray component for each segment.

Note that a user, for example, may visually determine the saturation of an image in a segment and subjectively evaluate the color-matching masking degree.

The candidate segment determining unit <NUM> determines a candidate segment in which a latent image is embeddable or can be embedded, based on determination results of the visual masking degree and the color-matching masking degree.

<FIG> is a diagram illustrating an example of determination of the candidate segment.

According to the example illustrated in <FIG>, in the present embodiment, the candidate segment determining unit <NUM> determines, as a candidate segment, a segment for which both the visual masking degree and the color-matching masking degree are determined as "large". Note that this way of determination is adjustable as appropriate for the density of black used for embedment or the characteristics of the image forming apparatus <NUM>.

The embedment background image extracting unit <NUM> selects or determines a target segment for embedding a latent image from candidate segments and extracts the selected segment (i.e., image area).

<FIG> is a diagram illustrating an example of determination of the target segment. <FIG> is a diagram illustrating the target segment extracted.

Note that, in a case in which plural candidate segments are determined as illustrated in <FIG>, a user, for example, can select any one of the plural candidate segments. As a consequence, according to the purpose, the user can embed a latent image in any segment selected from the candidate segments automatically calculated.

The latent image embedding unit <NUM> performs a latent image synthesizing process of embedding a specified latent image in the extracted target segment (or target image area) to generate an image embedded with the latent image.

<FIG> is a diagram illustrating an example of the image embedded with the latent image.

The background image synthesizing unit <NUM> performs a process of synthesizing the generated image embedded with the latent image and the segment or area, from which the target segment is extracted, of the background image.

As described above, according to the present embodiment, a segment from which great visual masking effect and color-matching masking effect are obtained is determined in a background image. According to the determination result, a latent image is embedded in the determined segment. Accordingly, an enhanced stealth infrared latent image is formed by taking advantages of the visual masking effect and the color-matching masking effect.

Note that, in the processing of the second embodiment combined with the processing of the first embodiment, a pattern can be added in the visual masking process to address a small visual masking degree; whereas, to address a small color-matching masking degree, the color-matching masking process is performed on an image to turn a segment in which a latent image is unable to be embedded into a segment in which a latent image is able to be embedded.

Note that in the embodiments described above, the image processing devices <NUM> and 200A are applied to the image forming apparatus <NUM>, which is an MFP having at least two of copying, printing, scanning, and facsimile functions. Alternatively, the image forming apparatus <NUM> may be, e.g., a copier, a printer, a scanner, or a facsimile machine.

An information processing device such as a print server or a client personal computer (PC) may be applied as the image processing device <NUM> or 200A described above. In such a case, the information processing device includes a CPU that operates according to an installed program, thereby performing substantially the same function as the function of the image processing device <NUM> or 200A to generate an image embedded with a latent image. The image forming apparatus <NUM> having a printing function prints image data including the image embedded with the latent image, which is generated by the information processing device, thereby producing a printed matter including an infrared latent image.

The processing units illustrated in <FIG> and <FIG> are not necessarily arranged in the same image processing device or information processing device. For example, in <FIG>, the first masking unit <NUM> may be implemented by an information processing device such as a print server or a client PC. The second masking unit <NUM> may be implemented by an image processing apparatus such as an MFP or a printer.

Claim 1:
An image processing device (<NUM>) comprising:
an auxiliary masking unit (<NUM>) configured to process a background image into which a latent image is embedded, to obtain an effect to conceal the latent image;
a color-matching masking unit (<NUM>) configured to perform color conversion of the background image to obtain a color-matching masking effect to conceal the latent image; and
a latent image embedding unit (<NUM>) configured to embed the latent image in the background image processed and converted by the auxiliary masking unit (<NUM>) and the color-matching masking unit (<NUM>), respectively, to generate an image embedded with the latent image;
characterised in that
the color-matching masking unit (<NUM>) is configured to add a gray component as the color conversion of the background image;
wherein the color-matching masking unit (<NUM>) is configured to determine the gray component according to a density of black of the latent image;
wherein the latent image embedding unit (<NUM>) is configured to change an amount of generation of a black component by replacing the gray component with the black component upon determination if a pixel value of the latent image at a pixel position identical to a position of a reference pixel of the masked background image is grater than <NUM>, to embed the latent image using a black colorant.