Image processing device, method, system and the associated program for generating a composite image

An image processing device, which includes: an original reception unit that receives an original image; a dot image generation unit that generates, on the basis of additive information to be added to the original image, a dot image in which a plurality of dots each formed by one or more pixels are arranged; a state alteration unit that, when any of the dots in the dot image is determined to be not extractable, alters a state of the non-extractable dot on the basis of a relationship between a position on the dot image generated by the dot image generation unit and a corresponding position on the original image; and a composite image generation unit that generates a composite image by superimposing, on the original image, the dot image having the state of the non-extractable dot altered by the state alteration unit.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2008-232252 filed on Sep. 10, 2008.

BACKGROUND

Technical Field

The present invention relates to an image processing device, an image processing system, an image processing method, a recording medium storing a program, and a data signal.

SUMMARY

An image processing device, which includes: an original reception unit that receives an original image; a dot image generation unit that generates, on the basis of additive information to be added to the original image, a dot image in which a plurality of dots each formed by one or more pixels are arranged; a state alteration unit that, when any of the dots in the dot image is determined to be not extractable, alters a state of the non-extractable dot on the basis of a relationship between a position on the dot image generated by the dot image generation unit and a corresponding position on the original image; and a composite image generation unit that generates a composite image by superimposing, on the original image, the dot image having the state of the non-extractable dot altered by the state alteration unit.

DETAILED DESCRIPTION

Exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

First, a configuration of units for generating a composite image will be described with reference toFIG. 1.

FIG. 1is a block diagram showing a configuration of units for generating a composite image. These units are to be mounted on a personal computer, an image formation device or the like serving as a composite image processing device.

As shown inFIG. 1, the units for generating a composite image include an original image acquisition unit10, an additive information reception unit20, a composite image generation unit30, and a dot extraction unit40.

A composite image processing device according to the present invention includes the composite image generation unit30.

The original image acquisition unit10acquires an original image in which additive information is to be embedded.

The original image acquisition unit10may be formed by a scanner for acquiring image data, or by various types of memory devices for storing image data.

When the original image acquisition unit10is formed by a scanner, the original image acquisition unit10acquires an original image in the form of image data from an original document placed on the scanner.

The additive information reception unit20has a function to receive additive information to be added to the original image, and is formed for example by a keyboard as an input device for a personal computer, or by an input key202as an input device for an image formation device.

With the original image acquired by the original image acquisition unit10and the additive information input by the additive information reception unit20, the composite image generation unit30generates a dot image from the additive information, and generates a composite image by superimposingly synthesizing the dot image and the original image.

The dot image generated from the additive information is an image formed by a plurality of dots (black round spots), in which the additive information is represented by the arrangement of a plurality of dots.

The dot extraction unit40performs processing to extract dots from an image in which the dots are superimposed to an original image.

The dot extraction unit40also reads additive information from the extracted dots.

When the system is formed by a scanner203and a personal computer204, as shown inFIG. 2A, for example, the scanner203serves the function of the original image acquisition unit10, a keyboard as an input device for the personal computer204serves the function of the additive information reception unit20, and the CPU (Central Processing Unit) and a memory device of the personal computer204serve the functions of the composite image generation unit30and the dot extraction unit40. An image processing program is stored in the memory device of the personal computer204, and the personal computer204serves as the image processing device.

When using the system formed by the scanner203and the personal computer204, the user places a desired original document on the scanner203, and inputs desired additive information from the keyboard of the personal computer. The personal computer204generates a dot image from the input additive information and generates a composite image of the original image and the dot image.

When the system is formed only by a personal computer205as shown inFIG. 2B, for example, an memory device of the personal computer205, which stores an image data, serves the function of the original image acquisition unit10, a keyboard as an input device of the personal computer205serves the function of the additive information reception unit20, and a CPU and a memory device of the personal computer205serve the functions of the composite image generation unit30and the dot extraction unit40. An image processing program is stored in the memory device of the personal computer205, and the personal computer205serves as the image processing device.

When using the system formed only by the personal computer205, the user selects a desired original image, to which additive information is to be added, from image data (which may be an image file or a document file) stored in the memory device of the personal computer205, and inputs the additive information from the keyboard. The personal computer205generates a dot image from the input additive information, and generates a composite image of the original image and the generated dot image.

Further, when the system is formed by only an image formation device as shown inFIG. 2C, for example, a scanner201of the image formation device serves the function of the original image acquisition unit10, an input key202as an input device of the image formation device serves the function of the additive information reception unit20, a CPU and a memory device of the image formation device serve the functions of the composite image generation unit30and the dot extraction unit40. An image processing program is stored in the memory device of the image formation device, and the image formation device serves as the image processing device.

When using the system formed by only the image formation device, the user places a desired original document to which additive information is to be added on the scanner201of the image formation device, and inputs desired additive information from the input key202. The image formation device reads the original document placed on the scanner20, generates a dot image from the input additive information, generates a composite image of the original image and the dot image, and prints out the composite image on paper.

In the following examples, a description will be made, including a dot state alteration unit308of the composite image generation unit30, which has different functions and configurations.

Dot state alteration units308,308-1and308-2have a function to alter the state of dots in a dot image generated by the dot image generation unit302.

Description of a First Example will be made of the composite image generation unit30having the dot state alteration unit308. The dot state alteration unit308performs the alteration of the state of dots by displacing the position of the dots.

Description of a Second Example will be made of the composite image generation unit30having the dot state alteration unit308-1. The dot state alteration unit308-1performs the alteration of the state of dots by altering the color of the dots.

Description of a Third Example will be made of the composite image generation unit30having the dot state alteration unit308-2. The dot state alteration unit308-2performs the alteration of the state of dots by altering the shape of the dots.

FIRST EXAMPLE

Functions of the composite image generation unit30will be described with reference toFIG. 3.

FIG. 3is a block diagram showing functions of the composite image generation unit30.

As shown inFIG. 3, the composite image generation unit30includes an original image reception unit301, a dot image generation unit302, a dot repositioning unit303, a final dot memory unit304, a dot verification unit305, an image synthesizing unit307, a dot state alteration unit308, a displacement pattern memory unit309, an original density detection unit310, and a dot line alteration unit311.

The original image reception unit301acquires an original image from the original image acquisition unit10.

The dot image generation unit302generates a dot image based on the additive information received from the additive information reception unit20.

The dot repositioning unit303stores a dot image in which the dot position is altered by the dot state alteration unit308.

The final dot memory unit304acquires, from the dot repositioning unit303, a dot image in which the alteration of the dot position is completed by the dot state alteration unit308, and transmits this dot image to the image synthesizing unit307.

The dot verification unit305has a function to verify whether or not dots on an original image made by synthesis between an original image and a dot image can be extracted. The dot verification unit305sends an original image having dots arranged thereon and verifies whether or not the dots can be extracted by the dot extraction unit40.

The dot verification unit305also has a function to verify whether or not a dot whose position has been altered by the dot state alteration unit308is made extractable by the alteration of position. The dot verification unit305sends image data in which a dot whose position is altered is arranged on an original image to the dot extraction unit40, and verifies whether or not the dot can be extracted by the dot extraction unit40.

The dot verification unit305may verify the extractability of a dot by other methods as well. For example, positional information of a dot in a dot image is sent together with an original image from the dot verification unit305to the dot positional relationship determination unit50, and the dot positional relationship determination unit50determines whether or not the dot can be extracted on the basis of the positional relationship between to the dot image and the original image, and the result of this determination is acquired by the dot verification unit305to provide a verification result. The dot positional relationship determination unit50is not included in the composite image generation unit30, but is provided in a composite image processing device having the composite image generation unit30, as a separate component for generating a composite image.

Description will be made of a function of the dot positional relationship determination unit50with reference toFIGS. 4A and 4B.

FIGS. 4A and 4Bare schematic diagrams showing how the dot positional relationship determination unit50determines about the extractability of dots.FIG. 4Ais a schematic diagram showing the positions of dots in a dot image,FIG. 4Bis a schematic diagram showing the positions of the same dots in the original image.

As shown inFIG. 4A, the dot positional relationship determination unit50determines the positions of dots.

The position of each dot is determined as a coordinate value expressed in units of pixels in an X-Y plane with the upper left end point of the dot image being defined as the origin.

For example, as shown inFIG. 4A, one dot is represented by the coordinate (3, 2), while another dot is represented by the coordinate (7, 3).

Once the coordinate values of the dots in the dot image are obtained, as shown inFIG. 4B, it is checked whether or not the original image and the obtained dots are matched on the positions of the coordinates of the dots in an X-Y plane expressed in units of pixels with the upper left endpoint of the original image being defined as the origin.

If the original image is arranged on the position of the coordinate of a dot, it is determined that the dot overlaps with the original image and hence cannot be extracted.

A dot sometimes comprises a plurality of pixels. In such a case, the coordinate of the center point of the dot may be determined, and then the dot is determined to be not extractable if the original image exists within a range of a radius corresponding to n (n is a value predetermined according the size or shape of the dot) pixels from the coordinate of the center point of the dot.

Returning to the description ofFIG. 3, the dot extraction unit40extracts dots from the composite image.

The dot state alteration unit308has a function to alter the position of a dot that cannot be extracted by the dot verification unit305, and includes a displacement pattern memory unit309, an original density detection unit310, and a dot line alteration unit311.

The displacement pattern memory unit309stores a displacement pattern for altering the positions of dots. The displacement pattern indicates, as shown inFIG. 6A, destination pixel positions in sequence with the initial dot position being placed at the center (the details will be described later with reference toFIGS. 6A to 6C).

The original density detection unit310has a function to find density distribution of the original image around the position where each dot is arranged when the dot image generated by the dot image generation unit302is superimposed on the original image (the details will be described later with reference toFIGS. 6A to 6CandFIGS. 7A to 7C).

The dot line alteration unit311has a function to displace dots included in a certain row of the dot image generated by the dot image generation unit302.

In the composite image generation unit30configured in this manner, an original image is obtained from the original image acquisition unit10, and the dot image generation unit302generates a dot image having dots arranged at equal intervals on the basis of additive information received from the additive information reception unit20.

Then, the original image and the dot image generated by the dot image generation unit302are synthesized by the dot repositioning unit303, and the dots on the synthesized image data are verified by the dot verification unit305. The states (the positions in the First Example) of those dots that are determined to be not extractable are altered by the dot state alteration unit308.

The dots whose state (the position in the First Example) is altered are repositioned in a dot image by the dot repositioning unit303.

Once the verification of the dot image generated by the dot image generation unit302is completed by the dot verification unit305, the dot image as obtained by the repositioning of dots by the repositioning unit303at the time of completion of the verification is sent to the final dot memory unit304as a final dot image.

The image synthesizing unit307synthesizes the original image acquired by the original image reception unit301and the dot image sent to the final dot memory unit304to generate a composite image.

Description will be made of how an original image and a dot image are synthesized, with reference toFIG. 5.

FIG. 5is a schematic diagram showing how an original image and a dot image are synthesized.

As shown inFIG. 5, additive information received by the additive information reception unit20is converted into digital information, whereby numbers “0” and “1” are arranged on the image data (indicated by the reference numeral502).

Dots are arranged at the positions corresponding to “1”, whereby a dot image formed by a plurality of dots is generated (indicated by the reference numeral503).

A dot is represented by a black round spot (circle) as described in relation toFIG. 1. This dot does not mean a pixel as constituent units of a digital image.

The dot may be a black round circle formed by either a single pixel or a plurality of pixels.

A plurality of such dots are arranged to form a dot image as indicated by the reference numeral503.

The processing to generate a dot image from additive information is performed by the dot image generation unit302.

The positions of the dots in the dot image generated above are altered by the composite image generation unit30, and the dot image is finally determined as final image data (which is sent to the final dot memory unit304and indicated by the reference numeral504). This dot image and the original image (indicated by the reference numeral501) are synthesized to generate a composite image (indicated by the reference numeral505).

Description will be made of processing to alter the position of a dot with reference toFIGS. 6 to 9.

First, referring toFIG. 6AtoFIG. 6C, description will be made of processing to alter the positions of dots on the basis of a displacement pattern stored in the displacement pattern memory unit309of the dot state alteration unit308.

FIGS. 6A to 6Care schematic diagrams illustrating processing to alter the position of a dot on the basis of a displacement pattern stored in the displacement pattern memory unit309.FIG. 6Ais a schematic diagram showing an example of a displacement pattern.FIG. 6Bis a schematic diagram showing a dot that exists on the original image and is determined, by the dot verification unit305, to be not extractable, andFIG. 6Cis a schematic diagram showing a dot that is determined to be not extractable and is displaced according to the displacement pattern shown inFIG. 6A.

As shown inFIG. 6A, the displacement pattern memory unit309stores a dot displacement pattern in which numbers indicate the sequence for displacing a dot.

In a first displacement, for example, a dot is displaced rightward from a pixel indicated by “0” to a pixel indicated by “1” by one pixel. The unit of displacement is not limited to one pixel. While the numbers in the displacement pattern indicate the order of the dot displacement, the dot may be displaced by either two or three pixels. Specifically, the rightward displacement from “0” to “1” may mean a displacement by two pixels or a displacement by three pixels.

Further, although the displacement pattern shown inFIG. 6Ais of a size of 5×5 cells, the size of the displacement pattern is not limited to this.

The dot is displaced in accordance with this displacement pattern to find a position where the dot verification unit305determines that the dot is extractable.

For example, as shown inFIG. 6B, when the region where the dot arranged by the dot image generation unit302(indicated by the reference numeral602) overlaps with image data in the original image (indicated by reference numeral601) is so large that the dot verification unit305determines that the dot (indicated by the reference numeral602) cannot be extracted, the dot is displaced in accordance with the displacement pattern ofFIG. 6A.

As a result of the displacement in seven times in accordance with the displacement pattern, the dot verification unit305determines that the dot becomes extractable, and this position is determined as the final displacement position of the dot (indicated by the reference numeral603inFIG. 6C).

Description will be made, with reference toFIGS. 7A to 7C, of processing to displace dots on the basis of densities of an original image detected by the original density detection unit310.

FIGS. 7A to 7Care schematic diagrams showing processing to displace a dot on the basis of densities of an original image detected by the original density detection unit310.FIG. 7Ais a schematic diagram showing a dot arranged in the original image before displacement of the dot.FIG. 7Bis a schematic diagram showing densities of the original image around the dot as detected by the original density detection unit310.FIG. 7Cis a schematic diagram showing the dot that is displaced according to the densities of the original image.

For example, as shown inFIG. 7A, when the original image (indicated by the reference numeral701) overlaps with the dot image (indicated by the reference numeral702) and it is determined by the dot verification unit305that the dot cannot be extracted, the original density detection unit310of the dot state alteration unit308detects original densities of the original image around the non-extractable dot.

The original densities are detected in the region of the original image overlapping with the non-extractable dot and the region around this dot.

The original densities thus detected are indicated for each pixel as shown in FIG.7B. The dot state alteration unit308determines a position where the original density is low, and displaces the dot toward that low density position (as indicated by the arrow inFIG. 7B) (FIG. 7C).

The position to which the dot is displaced is stored, and the displaced dot is rearranged in a new dot image by the dot repositioning unit303.

The regions in the original image where the densities are detected as shown inFIG. 7Bare not limited to the region where the original image overlaps with the dot and the region around the dot. The density may be detected only in the region where the original image overlaps with the dot.

Description will be made, with reference toFIGS. 8A and 8B, of processing to displace a row of dots by the dot line alteration unit311.

FIGS. 8A and 8Bare schematic diagrams showing processing to displace a row of dots by the dot line alteration unit311.

The dot line alteration unit311displaces a row of dots when dots cannot be displaced to an extractable position either by the displacement of the dots according to the displacement pattern stored in the displacement pattern memory unit309, or by the displacement of the dots according to the original densities detected by the original density detection unit310.

As shown inFIG. 8A, the dots in the row801are located at a position overlapped with the original image and are not extractable. When the dots cannot be displaced to an extractable position by displacing the dot by the displacement pattern memory unit309or the original density detection unit310, they are displaced in row by the dot line alteration unit311.

The dots in the row801shown inFIG. 8Aare collectively displaced by the dot line alteration unit311to a position of a dot row802as shown inFIG. 8B.

Next, referring toFIG. 9, description will be made of processing to generate a composite image, including the processing to alter the positions of dots by the dot state alteration unit308.

FIG. 9is a flowchart showing processing to generate a composite image.

When acquiring additive information from the additive information reception unit20(step901), the dot image generation unit302generates a dot image on the basis of on the additive information.

The processing to generating a dot image on the basis of additive information is performed, as shown inFIGS. 4A and 4B, by converting the additive information into digital data of “0” and “1”, drawing the additive information converted into the digital data of “0” and “1” on paper (indicated by the reference numeral502inFIG. 5), and generating a dot image such that dots are drawn on paper at positions corresponding to the digital data of “1” (indicated by the reference numeral503inFIG. 5).

Once a dot image is thus generated (step902), the dot image is synthesized with an original image acquired from the original image reception unit301. The dots in the dot image synthesized with the original image are checked by the dots verification unit305, dot by dot, to determine whether or not the dot can be extracted (step903).

When the dot image is synthesized with the original image, the drawn dots possibly become non-extractable, overlapping with a solid part or a part of characters in the original image.

If a dot is determined to be extractable by the dot verification unit305(YES in step904), the dot keeps the same position as the position where the dot image is generated by the dot image generation unit302(step906).

If a dot is determined to be not extractable by the dot verification unit305(NO in step904), the position of that dot is altered by the dot state alteration unit308(step905).

If the positions of the non-extractable dots cannot be altered by the displacement pattern memory unit309and the original density detection unit310during the alteration of the dot positions, then the alteration of position is performed by the dot line alteration unit311that alters the position of a row of dots drawn in the dot image.

In this manner, if any dots in the dot image generated by the dot image generation unit302cannot be extracted due to the overlapping with the original image, the positions of these dots are altered, and a composite image is generated by synthesizing the dot image and the original image.

Description will be made, with reference toFIG. 10, of processing to extract additive information from a composite image in which a dot image and an original image are synthesized.

FIG. 10is a schematic diagram showing processing to extract additive information from a composite image.

A composite image is fed to the dot extraction unit40(indicated by the reference numeral1001), and dots are extracted from the composite image by the dot extraction unit40(indicated by the reference numeral1002).

The dots in the extracted dot image are projected in the longitudinal and lateral directions (indicated by the reference numeral1003), and lines are drawn through the centers of gravity of the shapes thus obtained, so that grid lines to arrange the dots are obtained (indicated by the reference numeral1004).

Once the grid lines are obtained, the additive information is extracted on the basis of whether there exits a dot near each intersection of the grid lines (indicated by the reference numerals1005and1006).

Specifically, if there is a dot near an intersection, the digital data of “1” is assigned to the position of the intersection, whereas if there is no dot near an intersection, the digital data of “0” is assigned to the position of that intersection.

In this manner, the digital data of “1” and “0” are formed in the image having the grid lines formed therein, and the information of “1” and “0” is extracted as the additive information.

It should be noted that, if there are any non-extractable dots in the dot image generated by the dot image generation unit302, the dot image may be enlarged or reduced by the dot state alteration unit308so that processing is performed to alter the dot image to enable the extraction of dots, and the dot image thus processed may be synthesized with the original image to generate a composite image.

Although the description above is made on the case where the dot verification unit305sends an original image and positional information of dots in a dot image to the dot positional relationship determination unit50to determine whether or not the dots can be extracted, the dot verification unit305may be provided with this function of the dot positional relationship determination unit50to determine whether or not the dots are extractable by comparing the positional relationships.

Further, it may be possible to have a configuration in which components having functions other than the function of the dot alteration unit308, the components including the original image acquisition unit10, the dot extraction unit40, the dot positional relationship determination unit50, and the image synthesizing unit307, is separately provided in another device other than the image processing device that has the dot alteration unit308, and the another device is connected to the image processing device through a communication circuit.

Next, referring toFIG. 11, description will be made of an image processing system in which the functions possessed by the original image acquisition unit10, the dot extraction unit40, the dot positional relationship determination unit50, and the image synthesizing unit307are respectively provided in separate devices connected through a network.

FIG. 11is a schematic diagram showing an image processing system1160in which the functions possessed by the original image acquisition unit10, the dot extraction unit40, the dot positional relationship determination unit50, and the image synthesizing unit307are respectively provided in separate devices connected through a network.

As shown inFIG. 11, the image processing system1160has an image reception device1110, a dot generation device1120, an extractability determination device1130, an image synthesizer1140, and a printer1150connected to each other through a communication circuit1170.

The image reception device1110is formed by a scanner for acquiring an original image, and has an original image transmission unit1111.

The original image transmission unit1111transmits the acquired original image to the extractability determination device1130.

The dot generation device1120has an additive information reception unit20, a dot image generation unit302, a dot repositioning unit303, a dot state alteration unit308, and an interface1121.

The additive information reception unit20is formed by a keyboard that receives additive information input by the user.

The dot image generation unit302generates a dot image on the basis of the additive information received from the additive information reception unit20.

Description of the dot image will be omitted here since it has already been made above.

The dot repositioning unit303performs processing to generate a dot image in which the state of dots is altered by the dot state alteration unit308.

The dot state alteration unit308alters the state of dots in which the extractability determination device1130determines the dots to be not extractable from a composite image of an original image and a dot image.

As described before, the dot state alteration unit308has a displacement pattern memory unit309, an original density detection unit310, and a dot line alteration unit311, and alters the state of dots by means of these components.

The interface1121is an interface that exchanges information with the extractability determination device1130through the communication circuit1170. The interface1121transmits to the extractability determination device1130a dot image in which dots are already repositioned by the dot repositioning unit303, and receives from the extractability determination device1130a dot image that is already determined to be not extractable and information specifying the positions of dots that cannot be extracted.

The extractability determination device1130has an interface1131, a RAM (Random Access Memory)1132, and an extractability determination unit1133.

The interface1131is an interface that exchanges information with the dot generation device1120and the image synthesizer1140through the communication circuit1170.

The interface1131receives a dot image from the dot generation device1120, and transmits, to the dot generation device1120, a dot image determined to be not extractable and information specifying the positions of dots that cannot not be extracted. The interface1131also transmits, to the image synthesizer1140, a dot image determined to be extractable and an original image.

The RAM1132is a rewritable image memory that temporarily stores image data transmitted and received by the interface1131.

The extractability determination unit1133has a function to determine whether or not dots can be extracted from a composite image formed by synthesizing the dot image transmitted by the dot generation device1120and the original image transmitted by the original reception device1110.

The extractability determination unit1133is designed to determine the extractability of dots by actually superimposing and synthesizing the dot image and the original image to generate a composite image, and extracting dots from the composite image thus obtained.

Alternatively, the extractability determination unit1133may be designed to determine whether or not dots can be extracting by comparing the positional relationships between the dots in the dot image and the original image, as described with reference toFIGS. 4A and 4B.

The image synthesizer1140has an interface1141, a RAM1142, and an image synthesizing unit1143.

The interface1141exchanges information with the image reception device1110and the printer1150through the communication circuit1170.

The interface1141receives an original image and a dot image from the extractability determination device1130, and transmits a composite image created by synthesizing the original image and the dot image.

The RAM1142is a rewritable image memory that temporarily stores image data received and transmitted by the interface1141.

The image synthesizing unit1143generates a composite image by superimposing and synthesizing an original image and a dot image.

The printer1150is a printer that is connected to the communication circuit1170and prints out the composite image received from the image synthesizer1140.

Using the image processing system1160configured as described above, the user places an original on the image reception device1110, and inputs additive information to be added to the original by means of the additive information reception unit20of the dot image generation device.

Then, the original image is sent to the extractability determination device1130.

A dot image is generated by the dot generation device1120on the basis of the additive information, and this dot image is also sent to the extractability determination device1130.

The extractability determination device1130determines, on the basis of the received original image and dot image, whether or not dots can be extracted from the superimposingly synthesized image.

If it is determined that the dots cannot be extracted, a dot image in which the dot state is altered is regenerated by the dot state alteration unit308of the dot generation device1120, and fed to the extractability determination device1130.

The extractability determination device1130again determines the extractability, and the dot generation device1120continues the generation of a dot image until the extractability determination device1130determines that the dots can be extracted.

The original image and the dot image that is determined by the extractability determination device1130that the dots can be extracted are sent to the image synthesizer1140, in which they are superimposingly synthesized.

The composite image generated by the image synthesizer1140is transmitted to the printer1150, and is then printed out.

SECOND EXAMPLE

Next, description will be made of a Second Example in which the composite image generation unit30described with reference toFIG. 1has a dot state alteration unit308-1having a function of altering the color of dots.

In the Second Example as well, as described with reference toFIGS. 2A to 2C, a composite image is generated by the composite image generation unit30provided in the system composed of the scanner203and the personal computer204, or in the system comprising only the personal computer205, or in the system formed by the image formation device.

Unlike the First Example, the composite image generation unit30is provided with a dot state alteration unit308-1having a function to alter the color of dots in addition to the function to alter the positions of dots, instead of the dot state alteration unit308for altering the positions of dots.

In the description of the Second Example, the components designated with the same reference numeral as those in the First Example basically have the same functions and configurations, and the description thereof will be omitted. However, the composite image generation unit30in the Second Example has a dot state alteration unit308-1, unlike the composite image generation unit30in the First Example having the dot state alteration unit308.

In the Second Example as well, the dot verification unit305may be designed, like the First Example, to verify the extractability of dots either by a method in which an original image having dots arranged therein is sent to the dot extraction unit40to verify the extractability of dots, or by a method in which an original image and positional information of dots in a dot image are sent to the dot positional relationship determination unit50so that the dot positional relationship determination unit50compares their positional relationships to verify the extractability of the dots.

First, description will be made of the dot state alteration unit308-1provided in the composite image generation unit30.

Like the dot state alteration unit308, the dot state alteration unit308-1alters the dots that are not extractable in a dot image generated by the dot image generation unit302, but is different from the dot state alteration unit308in that the dot state alteration unit308-1has a function to alter the color of dots.

The dot state alteration unit308-1will be described with reference toFIG. 12.

As shown inFIG. 12, the dot state alteration unit308-1has a dot color alteration unit312in addition to a displacement pattern memory unit309and an original density detection unit310.

The dot color alteration unit312has a function to alter the color of dots.

The dot image generation unit302generates dots in the color of black, whereas the dot color alteration unit312alters the color of dots that fall under predetermined conditions into white so as to enable extraction of the dots. If there is any dot that the dot verification unit305cannot extract, this dot is overlapped with the original image. Therefore, the color of the dots are changed from black to white to form white dots on the colored background of the original image, whereby these white dots can be extracted regardless of whether or not those dots are overlapped with the original image.

Next, description will be made, with reference toFIG. 13, of processing to generate a composite image by the composite image generation unit30having the dot state alteration unit308-1.

FIG. 13is a flowchart showing processing to generate a composite image by the composite image generation unit30having the dot state alteration unit308-1.

Upon acquiring additive information from the additive information reception unit20(step1301), the dot image generation unit302generates a dot image on the basis of the additive information.

As described in the First Example with reference toFIG. 5, the processing to generate a dot image on the basis of the additive information is performed by a method in which the additive information is processed to be digitally represented by “0” and “1”, the digitally processed additive information is drawn on paper (indicated by the reference numeral502inFIG. 5), and a dot image (indicated by the reference numeral503) is generated such that dots are drawn at the positions corresponding to “1”. The dots in the dot image thus generated are of black color.

When a dot image is generated in this manner (step1302), the following processing is performed for each dot in the dot image (step1303).

Specifically, the density of the original at a position where a dot is drawn on the original image when synthesized with the dot image is compared with a predetermined threshold value by the original density comparing unit313(step1304).

If the original density at the position where the dot is drawn is equal to or lower than the predetermined threshold value (density ≦ threshold value in step1304), the dot verification unit305checks whether or not the dot can be extracted from the dot image synthesized with the original image at the position where the dot is drawn (step1305).

If the dot verification unit305determines that the dot can be extracted (YES in step1305), the dot is not altered and keeps the same state where the dot is generated by the dot image generation unit302(step1306).

In contrast, if the dot verification unit305determines in step1305that the dot cannot be extracted (NO in step1305), the position of the dot is displaced to a position where extraction is possible by the displacement pattern memory unit309and the original density detection unit310(step1307).

If the original density is equal to or higher than the predetermined threshold value in step1304(threshold value ≦ density in step1304), the color of the dot is altered to white by the dot color alteration unit312, and the dot verification unit305verifies whether or not the white dot can be extracted when overlapped with the original image (step1308).

If the white dot is determined to be extractable (YES in step1308), the dot is stored in the dot repositioning unit303in the state in which the dot is altered to white.

If the white dot is determined to be not extractable (NO in step1308), the position of the dot is displaced by using the displacement pattern memory unit309and the original density detection unit310with the dot remaining white (step1309).

The position of the white dot is displaced by using the original density detection unit310such that the original density detection unit310detects the density of the original in the vicinity of the position where the dot is drawn, and the white dot is displaced to a place where the original density is higher, unlike the case of a black dot.

The dots in the dot image generated by the dot image generation unit302are processed by the dot state alteration unit308-1as described above (step1303).

Upon completion of the processing, the dot image having been processed and stored in the dot repositioning unit303is sent to the final dot memory unit304, and a composite image is generated by the image synthesizing unit307by synthesizing the processed dot image with the original image.

Next, description will be made, with reference toFIG. 14, of processing to extract additive information from a composite image.

FIG. 14is a flowchart showing processing to extract additive information from a composite image generated through the processing by the composite image generation unit30having the dot state alteration unit308-1.

First, black dots are extracted from the composite image (step1401).

Then, white dots, specifically white dots on the colored background, are extracted from the composite image (step1402).

Upon completion of the extraction of the black and white dots, the extracted dots are projected in the longitudinal and lateral directions regardless of the difference in color (black or white). Then, as described in the First Example, lines are drawn through the centers of gravity of the shapes thus obtained, whereby grid lines are drawn on the image.

Once the grid lines are obtained, the digital data of “1” or “0” is assigned to each intersection of the grid lines on the basis of whether there exits the dot near the intersection, whereby the digital data of “1” and “0” are formed in the image (step1403). This data is extracted as the additive information (step1404).

Although the description of the Second Example has been made in terms of an example in which the dot color is altered from black to white by the dot color alteration unit308-1, it is obvious that the dot color may be altered to any other color instead of white.

Further, although the description of the Second Example has been made in terms of an example in which the dot image generation unit302generates black dots, the generated dots may obviously be of any other color.

The dot state alteration unit308-1may be provided with a dot line alteration unit311to displace rows of dots.

Further, it may be possible to have a configuration in which components having functions other than the functions of the dot alteration unit308-1, the components including the original image acquisition unit10, the dot extraction unit40, the dot positional relationship determination unit50, and the image synthesizing unit307, are separately provided in another device other than the image processing device that has the dot alteration unit308-1, and the another device is connected to the image processing device through communication lines. In this case, the system of the Second Example has the same configuration as that of the image processing system1160described in the First Example, except that the system of the Second Example has the dot state alteration unit308-1instead of the dot state alteration unit308of the image processing system1160.

THIRD EXAMPLE

Description will be made of a Third Example in which the composite image generation unit30described with reference toFIG. 1is provided with a dot state alteration unit308-2having a function to alter the shape of dots.

In the Third Example as well, a composite image is generated by the composite image generation unit30provided in the system formed by the scanner203and the personal computer204, or in the system formed only by the personal computer205, or in the system formed by the image formation device, as described with reference toFIGS. 2A to 2C.

Unlike the First Example, the composite image generation unit30has a dot state alteration unit308-2having a function to alter the shape of dots, instead of the dot state alteration unit308for altering the positions of dots.

In the description of the Third Example, the components designated with the same reference numeral as those in the First Example basically have the same functions and configurations, and the description thereof will be omitted However, the composite image generation unit30in the Third Example has a dot state alteration unit308-2, unlike the composite image generation unit30in the First Example having the dot state alteration unit308.

Further, in the Third Example as well, the dot verification unit305may be designed, like the First Example, to verify the extractability of dots either by a method in which an original image having dots arranged therein is sent to the dot extraction unit40to verify the extractability of dots, or by a method in which an original image and positional information of dots in a dot image are sent to the dot positional relationship determination unit50, and the dot positional relationship determination unit50compares their positional relationships to verify the extractability of the dots.

First, description will be made of the dot state alteration unit308-2provided in the composite image generation unit30.

Like the dot state alteration unit308, the dot state alteration unit308-2alters the dots that cannot be extracted when a dot image generated by the dot image generation unit302overlaps with an original image, but is different from the dot state alteration unit308in that the dot state alteration unit308-1has a function to alter the shape of dots.

Referring toFIG. 15, the dot state alteration unit308-2will be described.

As shown inFIG. 15, the dot state alteration unit308-2has a dot creation unit314, and a various dot memory unit315.

The dot creation unit314has a function to create shapes of dots.

The various dot memory unit315stores various shapes of dots.

Next, with reference toFIG. 16, description will be made of processing to generate a composite image by the composite image generation unit30having the dot state alteration unit308-2.

As shown inFIG. 16, once additive information is acquired by the additive information reception unit20(step1601), the dot image generation unit302generates a dot image on the basis of the additive information.

As described in the First Example with reference toFIG. 5, the processing to generate a dot image on the basis of additive information is performed by a method in which the additive information is processed to be digitally represented by “0” and “1”; the digitally processed additive information is drawn on paper (indicated by the reference numeral502inFIG. 5); and a dot image (indicated by the reference numeral503) is generated such that dots are drawn at the positions corresponding to “1.”

Once the dot image is generated in this manner (step1602), the following processing is performed for each dot in the dot image (step1603).

Specifically, a dot to be processed is first synthesized with an original image, and then the dot verification unit305verifies whether or not the dot to be processed can be extracted from the synthesized composite image (step1604).

If the dot verification unit305determines that the dot can be extracted (YES in step1604), the dot is not altered and keeps the state where the dot is generated by the dot image generation unit302(step1605).

In contrast, if the dot verification unit305determines in step1604that the dot cannot be extracted (NO in step1604), the dot is processed by the dot state alteration unit308-2.

Specifically, a different dot shape is determined by the dot creation unit314or the various dot memory unit315(step1606), and the determined different dot shape is stored in the dot repositioning unit303, and dots having the determined different shape is drawn (step1607).

Processing by the dot creation unit314will be described. In the processing, attention is paid to the overlap between the original image and a dot to be processed in the dot image, and a double-size dot is created so as to be able to be extracted even if it is overlapped with the original image. Alternatively, by removing a dot portion that overlaps with the original image, a dot is created such that the created dot is formed by a dot portion that does not overlap with the original image.

Several different shapes of dots are stored in the various dot memory unit315.

These shapes include, for example, a star shape, a rectangular shape, and a triangular shape.

These dots are respectively arranged at positions where dots to be processed are arranged. Additionally, the type of dot is selected such that the dot shapes can be extracted even if overlapped with the original image.

In this manner, the dot state alteration unit308-2performs processing for each dot of the dot image generated by the dot image generation unit302(step1603).

Upon completion of the processing, the dot image having been processed and stored in the dot repositioning unit303is sent to the final dot memory unit304, and the image synthesizing unit307generates a composite image by synthesizing the processed dot image with the original image.

Next, with reference toFIG. 17, description will be made of processing to extract additive information from the composite image.

FIG. 17is a flowchart showing processing to extract additive information from a composite image generated by the composite image generation unit30having the dot state alteration unit308-2.

In the first place, instead of the dots having a different shape determined by the dot state alteration unit308-2, black dots generated by the dot image generation unit302are extracted from the composite image (step1701).

Then, the dot extraction unit40extracts the dots having the different shape from the composite image (step1702).

Then, grid lines are formed by the black dots extracted in step1701and the differently shaped dots extracted in step1702. The difference between the extracted black dots and the differently shaped dots is not taken into consideration to form the grid lines for the extracted dots.

Specifically, the black dots extracted in step1701, and the dots that are extracted in step1702and whose shape are returned to that of black dots are projected in the longitudinal and lateral directions relative to the dot image.

Lines are drawn through the centers of gravity of the projected shapes, whereby grid lines having the dots arranged are obtained.

Once the grid lines are obtained, the additive information is extracted on the basis of whether there exits a dot near each intersection of the grid lines (steps1703and1704).

Furthermore, it may be possible to have a configuration in which components having functions other than function of the dot state alteration unit308-2, such as the original image acquisition unit10, the dot extraction unit40, the dot positional relationship determination unit50, and the image synthesizing unit307, are separately provided in another device other than the image processing device that has the dot alteration unit308-2, and this another device is connected to the image processing device through the communication lines. In this case, the system has the same configuration as that of the image processing system1160described in the First Example, except that the system of the Third Example has the dot state alteration unit308-2instead of the dot state alteration unit308of the image processing system1160.

The present invention is applicable to an image processing device, an image processing system, an image processing method, a recording medium storing a program, and a data signal.

The image processing program according to the present invention may be provided not only by communication means but also by being recorded on a recording medium such as a CD-ROM.