Source: http://www.google.com/patents/US20030179953?ie=ISO-8859-1
Timestamp: 2014-03-14 08:58:10
Document Index: 755346856

Matched Legal Cases: ['Application No. 2001', 'Application No. 2001', 'Application No. 2001', 'Application No. 2001', 'Application No. 2001', 'Application No. 2001', 'Application No. 2001', 'Application No. 2001']

Patent US20030179953 - Image processing apparatus, image processing method, and image processing ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsA first image enlargement processing section enlarges an original image to a specified size to generate an initial enlarged image. A domain block extraction section extracts a domain block image from the original image. A range block extraction section extracts a range block image from the neighborhood...http://www.google.com/patents/US20030179953?utm_source=gb-gplus-sharePatent US20030179953 - Image processing apparatus, image processing method, and image processing programAdvanced Patent SearchPublication numberUS20030179953 A1Publication typeApplicationApplication numberUS 10/359,643Publication dateSep 25, 2003Filing dateFeb 7, 2003Priority dateMar 20, 2002Also published asCN1237778C, CN1445981A, DE60322457D1, EP1347411A2, EP1347411A3, EP1347411B1, US7155069Publication number10359643, 359643, US 2003/0179953 A1, US 2003/179953 A1, US 20030179953 A1, US 20030179953A1, US 2003179953 A1, US 2003179953A1, US-A1-20030179953, US-A1-2003179953, US2003/0179953A1, US2003/179953A1, US20030179953 A1, US20030179953A1, US2003179953 A1, US2003179953A1InventorsKanya IshizakaOriginal AssigneeFuji Xerox Co., Ltd.Export CitationBiBTeX, EndNote, RefManReferenced by (13), Classifications (6), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetImage processing apparatus, image processing method, and image processing programUS 20030179953 A1Abstract A first image enlargement processing section enlarges an original image to a specified size to generate an initial enlarged image. A domain block extraction section extracts a domain block image from the original image. A range block extraction section extracts a range block image from the neighborhood of the correspondence part of the domain block image in the initial enlarged image. A reduced range block preparation section reduces the range block image to the domain size to generate a reduced range block image. An enlarged range block preparation section enlarges the most similar range block image having the highest degree of similarity to an enlargement size to generate an enlarged pseudo domain block image. An enlarged image acquisition section 676 uses each enlarged pseudo domain block image to generate an enlarged image of the original image. Images(18) Claims(25)
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0051] Referring now to the accompanying drawings, there are shown preferred embodiments of the invention. [0052]FIG. 1 is a block diagram to show an image processing system (hereinafter refer to simply as a �system�) 1 comprising an image processing apparatus according to the invention. The system 1 comprises image input terminals 3, an image processing apparatus 5, and image output terminals 7. [0053] The image input terminals 3 can include any number of image sources, such as a personal computer 31, a color scanner 32, a digital camera 33, and a storage medium 34 of a hard disk, for preparing or editing a digital document (hereinafter refer to simply as �document�) DOC. For example, each image input terminal may be a terminal comprising a communication function for acquiring an image via a communication network (not shown). An application program for preparing a document DOC and the like are built in each terminal. Image data representing the document DOC is described in an image format (for example, JPEG, BMP, PNG, etc.,) that can be handled in the image processing apparatus 5. The image input terminal 3 inputs the document DOC to the image processing apparatus 5 forming a part of the system 1. [0054] The image processing apparatus 5 comprises an image data acquisition section 52 for acquiring digital image data representing a document DOC, an image data storage section 54 for temporarily storing image data, an image enlargement processing section 55 for performing enlargement processing of an image to any desired setup resolution, an enlarged image data storage section 58 for storing an enlarged image data, and an image data output section 59 for inputting enlarged image data D10 representing an enlarged image to any of the image output terminals 7. The image processing apparatus 5 may comprise a decompression processing section for decompressing an image if the image acquired by the image data acquisition section 52 is a compressed image. [0055] The image data storage section 54 retains the input image acquired by the image data acquisition section 52, the enlarged image data provided by the image enlargement processing section 55, various intermediate computation results and processing parameters used in enlargement processing of the image enlargement processing section 55, and the like. [0056] The image output terminals 7 can operate together with various functions of the image processing apparatus 5 and comprises a print engine 70 on a raster output scan (ROS) basis for operating the system 1 as a digital print system, a display 80 for operating the system 1 as an image display system, and the like. [0057] The print engine 70 has a print output processing section 72 for performing predetermined printout processing for the enlarged image data D10 output from the image processing apparatus b, a laser light source 74 for emitting a light beam, a laser drive section 76 for controlling, namely, modulating the laser light source 74 in accordance with data output from the print output processing section 72, and a polygon mirror (rotating polygon mirror) 78 for reflecting the light beam emitted from the laser light source 74 toward a photosensitive member 79. [0058] The print output processing section 72 generates data representing a plurality of separation colors, preferably at least three separation colors in accordance with a known art for the enlarged image data D10 representing an enlarged image and renders the data (expands the data to raster data). For example, from a YCrCb color system represented by decompression color correction digital data D10, at least three (preferably, four) data pieces are mapped into a CMY color system or a CMYK color system, for example, and raster data subjected to color separation for printout is generated. [0059] In such conversion processing to raster data, the print output processing section 72 performs undercolor removal (UCR) of performing a subtractive process of CMY components of a color image or gray component replacement (GCR) of replacing the CMY components subjected to a subtractive process partially with K component. Further, the print output processing section 72 may linearize color separation or perform similar processing to adjust a toner image of an output image prepared in response to output data (for instance, in CMYK). [0060] According the configuration, the print engine 70 reflects the light beam emitted by the laser light source 74 on a plurality of races on the polygon mirror 78 for exposing the photosensitive member 79 to the light and performs scanning to form a latent image on the photosensitive member 79. When a latent image is foamed, the image is developed according to any of a large number of known methods in the technical field, and the color image enlarged by the image processing apparatus 5 is output as a visible image. [0061] A color image not subjected to enlargement processing can also be output as a visible image. When a color image is output as a visible image, the data representing the image includes at least three (preferably, four) color separation data pieces (for example, C, M, Y, K), and each color is processed as a separate image face or in a brightness-chrominance format. [0062] The display 80 comprises a display output processing section 82 for performing predetermined output processing in accordance with the enlarged image data D10 output from the image processing apparatus 5 and a display section 84 of a CRT, liquid crystal display (LCD), organic EL, or the like for displaying a visible image based on the data output from the display output processing section 82. The display output processing section 82 may be built in a personal computer main unit 86 used together with the display section 84, for example, as software or hardware. The display output processing section 82 generates data representing a plurality of separation colors, preferably at least three separation colors in accordance with a known art for the enlarged image data D10 input from the image processing apparatus 5 and renders the data (expands the data to raster data). [0063] For example, mapping from the YCrCb color system represented by the enlarged image data D10 into an RGB color system, for example, is performed and raster data subjected to color separation for display is generated. In such conversion processing to raster data, the display output processing section 82 may perform color correction processing responsive to the taste of the operator. According to the configuration, the display 80 outputs the color image enlarged by the image processing apparatus 5 as a visible image. A color image not subjected to enlargement processing can also be output as a visible image. [0064] A personal computer (PC) can also be used as the print output processing section 72 or the display output processing section 82. The personal computer 31 as the image input terminal 3 may be used as the display 80. [0065]FIG. 2 is a block diagram to show details of a first embodiment of the image enlargement processing section 55 of the image processing apparatus 5. The image enlargement processing section 55 comprises an image acquisition section 550 for acquiring an image, a control section 552 for controlling the whole of the image enlargement processing section 55, a memory section 554 for temporarily storing data generated in processing of each functional part in the image enlargement processing section 55, and an image output section 558 for outputting an enlarged image generated in the image enlargement processing section 55 to the outside. The image enlargement processing section 55 also comprises a first image enlargement processing section 560 for performing first-stage enlargement processing and a second image enlargement processing section 660 for performing second-stage enlargement processing using the enlarged image generated in the first image enlargement processing section 560, the first and second image enlargement processing sections being functional parts involved in image enlargement processing. [0066] The image acquisition section 550 inputs digitalized image data from the outside of the image enlargement processing section 55 and transfers the image data to the memory section 554. The memory section 554 retains the image data input from the image acquisition section 550, image data after enlargement required for performing enlargement processing, and various intermediate computation results, processing parameters and the like used in enlargement processing. The first image enlargement processing section 560 first enlarges the image to be processed, retained in the memory section 554. [0067] The second image enlargement processing section 660 performs equal-magnification or reduction processing based on a predetermined processing algorithm for the enlarged image provided by the first image enlargement processing section 560, thereby generating an image enlarged relative to the original image. The processing contents of the first image enlargement processing section 560 and the second image enlargement processing section 660 will be described later in detail. The image output section 558 outputs the image data enlarged by the second image enlargement processing section 660 and the like to the outside of the image enlargement processing section 55. [0068] The control section 552, the first image enlargement processing section 560, the second image enlargement processing section 660, or the like in the image enlargement processing section 55 shown in FIG. 2 may exist as a processing program module on computer or some or all of the sections may be implemented as dedicated hardware. [0069] The second image enlargement processing section 660 has a large number of parts common to functional parts of image enlargement processing proposed in Japanese Patent Application No. 2001-341432 by the applicant of the invention, and the processing contents are also basically the same. However, they differ in range block setting object or size. The second image enlargement processing section 660 comprises added functional parts responsive thereto, as specifically described below. [0070] The second image enlargement processing section 660 comprises a domain block extraction section 662 for extracting a domain block image of size D (main scanning direction X subscanning direction=MD�ND pixels; MD=ND also possible) of first block unit from an original image, and a range block extraction section 664 for extracting a plurality of range block images each of size R0 (main scanning direction X subscanning direction=MR0�NR0 pixels; MR0=NR0 also possible) of second block unit to the neighborhood of the domain block image of the original image. The second image enlargement processing section 660 also comprises a reduced range block preparation section 666 for reducing each of the range block images extracted by the range block extraction section 664 to the same size is that of the domain block image to generate a plurality of reduced range block images. [0071] In the present specification, the term �block unit� is used to indicate a plurality of blocks characterized by the block size. [0072] The second image enlargement processing section 660 also comprises a similarity degree determination section 668 for using each of the reduced range block images generated by the reduced range block preparation section 666 to determine the degree of similarity between each range block image and the domain block image extracted by the domain block extraction section 662. The second image enlargement processing section 660 also comprises an enlarged pseudo domain block preparation section 670 for performing enlargement processing of the range block image determined to have a higher degree of similarity with the domain block image (in the examples �highest degree of similarity�) by the similarity degree determination section 668 among the range block images and generating an enlarged pseudo domain block image of the same size as that of an enlarged domain block image at an enlargement ratio r specified for the domain block image (size r*D) The second image enlargement processing section 660 also comprises an enlarged image acquisition section 676 for using each enlarged pseudo domain block image generated by the enlarged pseudo domain block preparation section 670 to acquire an enlarged image provided by enlarging the original image at a setup enlargement ratio. [0073] The second image enlargement processing section 660 further comprises a complexity degree determination section 669 for determining the degree of complexity of each range block image. For example, the complexity degree determination section 669 determines whether or not the range block image contains a large number of peaks and valleys, in other words, contains much high-frequency component. The similarity degree determination section 668 references the degree of complexity of the range block image determined by the complexity degree determination section 669 and determines the degree of similarity. The enlarged pseudo domain block preparation section 670 references the degree of complexity of the range block image determined by the complexity degree determination section 669 and determines the pixel values of the enlarged pseudo domain block image. [0074] The enlarged image acquisition section 676 has a block image combining unit 678 for acquiring the enlarged pseudo domain block images provided by the enlarged pseudo domain block preparation section 670 and combines the acquired enlarged pseudo domain block images to generate an enlarged image at an enlargement ratio set for the original image, and an overlap processing unit 686 for finding the pixel values of the pixels of the overlap duplicately processed accompanying overlap processing based on the pixel values of the pixels of the overlap. [0075] The block image combining unit 678 stores the acquired enlarged pseudo domain block images in a predetermined area of the image data storage section 54, for example, thereby generating the enlarged image. The overlap processing unit 686 finds an average value or a median value of the pixel values of the overlap, for example, and adopts the found value as the value of the pixel. [0076] The domain block extraction section 662 divides the original image into domain block images each of the MD�ND size and selects any one of the domain block images as a notable block image. The range block extraction section 664 selects all range block images each of the MR0�NR0 size from among block images of surrounding G X G size containing the domain block image extracted by the domain block extraction section 662 for each notable block image from the original image. [0077] The reduced range block preparation section 666 uses a known technique of linear interpolation or bilinear, projection, etc., for example, to reduce all range block images each of the MR0�NR0 size provided by the range block extraction section 664 to reduced range block images each of MD�ND size, the same size as that of the range block image. The similarity degree determination section 668 selects the reduced range block image most similar to the domain block image extracted by the domain block extraction section 662, for example, the reduced range block image having the most similar pixel values and pattern as a whole from among the reduced range block images provided by the reduced range block preparation section 666, and adopts the reduced range block image as the most similar range block image (optimum range block image). [0078] The enlarged pseudo domain block preparation section 670 uses a known technique of linear interpolation or bilinear, projection, etc., for example, to project the most similar range block image selected by the similarity degree determination section 668 to the size rD (enlarged block unit) and further again converts the pixel values based on the relationship between the domain block image and the range block image (in the example, similarity relationship), thereby preparing an enlarged pseudo domain block image and assigns the image as an enlarged block image to the domain block image. [0079] That is, the second image enlargement processing section 660 uses the relationship between each domain block image and the range block image existing to the neighborhood of the domain block image to find the enlarged pseudo domain block image provided by enlarging the range block image, and replaces the enlarged domain block image with enlarged pseudo domain block image, thereby performing block image enlargement processing. [0080] The second image enlargement processing section 660 also comprises an edge enhancement processing section 671 for performing edge enhancement processing for the enlarged pseudo domain block image provided by the enlarged pseudo domain block preparation section 670 in a predetermined condition, and an iterated processing control section 672 for iterating processing of the domain block extraction section 662 to the enlarged image acquisition section 676, which will be hereinafter also referred to as local collage processing, as many times as a predetermined number of times. [0081] To begin with, a description will be given with an example wherein the domain block extraction section 662 extracts a domain block image of MD�ND=2�2 (domain size D=2) every processing and shifts the domain block image one pixel in the main scanning direction or the subscanning direction each time overlap processing is performed and the range block extraction section 664 generates a range block image of MR0�NR0=5 (range size R0=5) larger than the enlarged domain block image at enlargement ratio r=2 (MD2�ND2=4�4) for the extracted domain block image. That is, a description will be given with an example wherein processing in which the domain block extraction section 662 enlarges the domain block image of 2�2 size (domain size D=2) to the block image of 5�5 size and the image is assigned to the correspondence positions of a twice enlarged image is executed four times corresponding to all overlaps. [0082] Embodiments described later are fitted as enlargement techniques particularly for a gray image; similar processing may be performed for a color image. In this case, it is advisable to adopt a technique of preparing a color image equivalent to a gray image with a 256-step gradation, for example, for data of each color (for example, R, G, B) representing that color image, enlarging each color image, and finally combining the images. [0083]FIG. 3 is a drawing to describe an example of processing in the reduced range block preparation section 666 (with use of projection). The reduced range block preparation section 666 projects and reduces all range block images each of 5�5 size generated by the range block extraction section 664 to reduced range block images each of 2�2 size, the same size as that of the domain block image. [0084] For example, as shown in FIG. 3, the pixel values are weighted and added based on the area ratio when 5�5 size is projected to 2�2, whereby projection reduction is executed. Letting the pixel values of the 5�5 size be {Pij|i, j=1, 2, 3, 4, 5} and the pixel values of the 2�2 size after reduction be {Qij|i, j=1, 2}, Q11, Q21, Q12, and Q22 are given according to expression (1). To reduce 5�5 to 2�2, the result becomes the same value regardless of projection or linear interpolation or bilinear. [0085]FIG. 4 is a drawing to describe an example of processing in the enlarged pseudo domain block preparation section 670 (with use of projection). The enlarged pseudo domain block preparation section 670 uses the area ratio when the most similar range block image of 5�5 size selected by the similarity degree determination section 668 is projected to enlarged domain block size rD (enlarged domain block)=4�4 size, and weights and adds the pixel values based on the area ratio when 5�5 size is projected to 4�4 in the same manner as the method used in the reduced range block preparation section 666, for example, as shown in the figure, thereby performing calculation of projection reduction. [0086] Letting the pixel values of the 5�5 size be {Pij|i, j=1, 2, 3, 4, 5} and the pixel values of the 4�4 size after reduction be {Qij|i, j=1, 2, 3, 4}, the pixel values after reduction are given according to expression (2). To reduce 5�5 to 4�4, the result also becomes the same value regardless of projection or linear interpolation or bilinear. [0087]FIG. 5 is a drawing to show an example of overlap amounts of pixel values after enlargement when overlap processing is performed. Here, overlap processing of shifting domain block image one pixel in the main scanning direction or the subscanning direction is shown. According to the overlap processing, if domain block images are extracted and a procedure described later is executed for all domain block images, the domain block image overlap amounts in the original image become values as given in FIG. 5. [0088] The overlap processing unit 686 projects the values to the correspondence positions in the enlarged image, divides the values entered in the enlarged image memory area of the image data storage section 54 by the values, and outputs the resultant image to the image output section 558 as an enlarged image after the nth iterated enlargement processing (called the nth enlarged image). When an additional iterated processing instruction is given from the iterated processing control section 672, the nth enlarged image is input to the range block extraction section 664. [0089]FIG. 6 is a drawing to describe an example of processing in the edge enhancement processing section 671. Here, for 4�4 block {Pij|i, j=1, 2, 3, 4}, pixel minimum value minp, pixel maximum value maxp, average value av as an evaluation index value, and median value 1 are set as in the following expression (3): [0090] At this time, edge enhancement pixel value qij (i, j=1, 2, 3, 4) is obtained according to the following calculation expression (4). Expression (4) means that the maximum value and the minimum values in block are calculated, a pixel value larger than the average value of the maximum and minimum values is converted into a larger value in response to the distance, and a smaller pixel value is converted into a smaller value in response to the distance. qij=av+f((pij−av)/l)*l (4) [0091] Here, a function shaped like a letter S with an origin O as the center as shown in FIG. 6 is used as the edge enhancement function f. For example, a function of expression (5) can be used. Any other function can also be used as f(x), and edge enhancement parameters can be defined unique to each function. f(x)=x(l−x*x)*α+x(α=0.0 to 0.5) (5) [0092] Use of expression (5) means that the pixel values in block are converted according to the nonlinear function for enhancing edges. The variable α is a parameter for defining the strength of edge enhancement, in which case it can take a value ranging from 0.0 to 0.5. Adjustment is made in the range of α=0.0 to 0, 5, whereby the degree of edge enhancement can be controlled. As α is increased, the S letter shape of the function is built up and thus edges can be made sharper. If a is set to 0.0, substantially edge enhancement is not conducted and when α is set to 0.5, the strongest edge enhancement effect is given. [0093] Use of expression (5) means that a larger pixel value than the average value in block is converted into a larger value and a smaller pixel value is converted into a smaller value. Therefore, in the next iterated processing, brightness value conversion according to the least squares method is again performed for the block with the edges enhanced, so that only the edge portions are enhanced and other portions are not affected. [0094]FIG. 7 is a drawing to show the relationships among domain block image, range block image, reduced range block image, and enlarged pseudo domain block image to be processed in the image processing apparatus 5 of the first embodiment. As shown in the figure, in the original image, a notable block of a predetermined pixel size is set as a domain block and a search block larger than the notable block is set as a range block. When the range block is set, in the embodiment, preferably a plurality of range blocks are set to the neighborhood of the portion corresponding to the notable block of an enlarged image at the specified magnification rather than the original image itself. [0095] The degree of similarity between the domain block image and each range block image is examined, the range block having a higher degree of similarity (preferably the highest degree of similarity) is selected, pixel value conversion is executed as required, and the image is placed as the enlarged image corresponding to the notable block. That is, a search is made for a similar block from the surroundings of the position corresponding to the notable block of the enlarged image corresponding to the original image for each local block of the original image (collage). This processing is repeated for the whole Of the original image as the setup position of the notable image (namely, the domain block) is switched in order, whereby finally the image enlarged at the magnification set for the original image is provided. [0096]FIG. 8 is a drawing to show the whole flow of the enlargement processing technique in the image enlargement processing section. Here, domain block image, range block image, reduced range block image, and enlarged pseudo domain block image are set with the relationships as shown in FIG. 7, one enlarged image is generated for each time, and this process is repeated n times. That is, first the first image enlargement processing section 560 generates enlarged image 0 as an initial enlarged image. The range block extraction section 664 extracts range blocks from the enlarged image 0 and other functional sections perform predetermined processing, thereby generating first enlarged image 1 from the original image and 0th enlarged image 0. After this, an �n+1�st enlarged image is generated from the original image and the nth enlarged image. That is, the enlarged image is used as a local nearby block and the same processing is repeated. At this time, a coefficient for sharpening the edges is multiplied as previously described with reference to FIG. 6. Accordingly, as the number of iterations is increased, while the edges become sharper, the image converges gradually on a high-quality image faithful to the original image. [0097]FIG. 9 is a flowchart to show an example of a processing procedure in the image processing apparatus 5 of the first embodiment, particularly a processing procedure focusing attention on the image enlargement processing in the second image enlargement processing section 660. The processing procedure will be discussed also with reference to FIGS. 7 and 8. [0098] To begin with, to start enlargement processing, it is assumed that the image data to be processed, acquired by the image data acquisition section 52 is already stored in the memory section 554. Then, the image enlargement processing section 55 first reserves a memory area for an r-times (in the example, twice) enlarged image in the memory section 554, and initializes the area to �0� (S10) as preparation for iterated enlargement processing. It also reserves a template memory area of the same size as the twice enlarged image size and initializes the area to �0.�
[0099] The image enlargement processing section 55 sets initial parameters. The initial parameters include, for example, enlargement ratio, block image size of image read, the number of computation processing times to perform overlap processing, image read start offset for each processing, the number of local collage processing iterations n, and the like. In the embodiment, the parameters are set as follows: Enlargement ratio=twice, domain block image size=2�2 pixels, range block image size=3�3 pixels, horizontal offset of image read start=one pixel, vertical offset of image read start=one pixel, the number of overlap computation processing times=two (main), two (sub), and the number of iterations n−5. [0100] Next, the first image enlargement processing section 560 enlarges twice the original image stored in the memory section 554 according to the nearest neighbor to generate initial twice enlarged image data and stores the data in twice enlarged image memory (S12). Next, the second image enlargement processing section 660 starts the first enlargement processing, namely, image enlargement processing of local collage processing (S14). [0101] First, the domain block extraction section 662 extracts all domain block images each of 2�2 Size from the original image (S120) and selects any one from among the domain block images as a notable block image (S140), as shown in FIG. 7. [0102] Next, the range block extraction section 664 extracts a range block image of 5�5 size so as to include the 4�4 block in the twice enlarged image memory corresponding to the notable block image from the twice enlarged image (S16). Specifically, as shown in FIG. 7, the range block extraction section 664 extracts all range block images of 5�5 size containing at least one pixel of a position, the position where the pseudo enlarged block is to be placed in the initial enlarged image corresponding to the position of the notable block image, from the block image of surrounding 6�6 size, for example, surrounding the domain block image (notable block image). Thereby, in the example, four range block images in total are extracted by the range block extraction section 664. [0103] Then, as shown in FIG. 3, the reduced range block preparation section 666 uses projection or linear interpolation or bilinear to reduce all range block images of 5�5 size selected by the range block extraction section 664 to generate reduced range block images of 2�2 size (S180). [0104] Next, the similarity degree determination section 668 compares each reduced range block image with the domain block image to determine the degree of similarity therebetween. For example, pixel value conversion is performed for each reduced range block image generated by the reduced range block preparation section 666, the reduced range block image having the pixel values and pattern most similar to those of the domain block image is selected, and the range block image corresponding to the reduced range block image, namely, the range block image on which the selected reduced range block image is based is adopted as the most similar range block image (S200). [0105] For example, as for pixel values d11, d21, d12, and d22 of the domain block image, pixel average value Dv=(d11+d21+d12+d22)/4 and pixel standard deviation VDv=Σ(dij−Dv){circumflex over ( )}2 (�{circumflex over ( )}� denotes exponentiation and ij denotes pixel position) are found. Next, as for pixel values r11k, r21k, r12k, and r22k of every reduced range block image (k denotes reduced range block image; k=1, . . . , 4), pixel average value Rvk=(r11k+r21k+r12k+r22k)/4 and pixel standard deviation VRvk=Σ(rijk−Rvk){circumflex over ( )}2 are found. [0106] Next, conversion coefficients ak and bk and conversion error Ek=Σ(dij−ak*rijk−bk){circumflex over ( )}2 in least square approximation of the pixel values of reduced range block image to the pixel values of the domain block image corresponding to the corresponding notable block in first-order conversion or linear transformation az+b are found. In the least squares method, ak, bk, and Ek can be found directly according to the following calculation expression (6): [0107] A given limitation is placed on the value of ak across the board regardless of the degree of complexity of the image in the range block image of 5�5 size. Here, the following conditional expression (7) is used: −10≦ak≦10 (7) [0108] Alternatively, the degree of complexity of the range block image determined by the complexity degree determination section 669 may be referenced for determining the degree of complexity. For example, a limitation may be placed on the allowable value of ak in response to the degree of complexity of the image in the range block image. When the image in the range block image is complicated and contains much high-frequency component, if it is adopted as range block image, a false component occurs in the enlarged image and thus preferably as the image is complicated, the reference degree to the image should be lessened. [0109] Next, whether or not each ak (k=1, . . . 4) is contained in the allowable value range mentioned above is checked. Only those contained in the range are collected to a set G. Next, E=min {Ek|k ∈G} is set and a=ak and b=bk are set for k with E=Ek. The range block pointed to by the k is most similar to the domain block. [0110] In fact, bk is not required for determining Ek and thus after k with Ek becoming the minimum is found and finally ak is determined, bk may be calculated. As the bk value, the following expression (8) having the effect of superposing an error with domain block for each pixel in block rather than the constant value of the expression given above can also be used: bk=bijk=dij−ak*rijk (8) [0111] If bk is previously calculated according to expression (8), reproducibility of the original image can be furthermore enhanced. The reason why bijk is described is that the value varies from one pixel to another in the domain block. In the embodiment, bk is determined based on expression (8) considering the change amount for each pixel in the latter. [0112] Next, the enlarged pseudo domain block preparation section 670 uses a known technique, such as linear interpolation or bilinear or projection, to project and reduce the most similar range block image of 5�5 size selected in the similarity degree determination section 668 to the enlarged domain block size, namely, 4�4 size to prepare an enlarged pseudo domain block image (S220). For example, the most similar range block image of 5�5 size is projected to the 4�4 size. At this time, the enlarged pseudo domain block preparation section 670 may calculate using the area ratio when the original 5�5 block is projected to 4�4 as shown in FIG. 4 in the same manner as the method used in the reduced range block preparation section 666. [0113] Next, the pixel values of the image projected to the 4�4 size are again converted based on the relationship between the domain block image and the range block image to prepare an enlarged pseudo domain block image, and the result is adopted as twice enlarged 4�4 block of 2�2 domain block (enlarged pseudo domain block). For example, for all pixels z of 4�4 block, pixel value conversion az+b is performed according to conversion coefficients a and b found in the similarity degree determination section 668, and the result is adopted as enlarged pseudo domain block of 2�2 domain block. All pixel values of the 4�4 block are added to the domain block correspondence location of the enlarged image memory area in the memory section 554. [0114] If an error is superposed on the bk value in the similarity degree determination processing in the similarity degree determination section 668, in the enlargement process, bk assigned to each dot position of the domain block image is projected and is switched for each dot. [0115] Next, the iterated processing control section 672 determines whether or not the current local collage processing is at the last time (S230). If the number of iterations does not equal the initially setup number of iterations, namely, if the current local collage processing is not at the last time, the edge enhancement processing section 671 is commanded to perform edge enhancement processing (NO at S230). On the other hand, if the current local collage processing is at the last time, edge enhancement processing is passed (YES at s230). [0116] Upon reception of command from the control section 552, the edge enhancement processing section 671 performs edge enhancement processing for the 4�4 enlarged pseudo domain block image provided by the enlarged pseudo domain block preparation section 670 (S234). For example, as shown in FIG. 6, the edge enhancement processing section 671 increases a larger pixel value than intermediate value av of the pixel values in the block and decreases a smaller pixel value than av, thereby performing edge enhancement processing. A 4�4 block image resulting from performing edge enhancement for the 4�4 enlarged pseudo domain block image is output and is added to the correspondence position of template image. [0117] Next, the iterated processing control section 672 determines whether steps S120 to S234 have been performed for all domain block images (S240). If a domain block image not subjected to the processing exists, control returns to step S140, a notable block image is set to the domain block image, and steps 160 to S234 are repeated (NO at S240). On the other hand, if steps S120 to S234 have been performed for all domain block images (YES at S240), the enlarged image corresponding to the original image is stored in the enlarged image data storage section 58 and the enlarged image is updated. [0118] Next, if steps S120 to S234 have been performed for all domain block images (YES at S240), the overlap processing unit 686 checks the number of computation times of overlap processing (S300). If it is less than the setup number of computation times, the processing starting at step S120 is again started at the position of adding the image read start offset to the top address of image (NO at S300). That is, whenever control returns to step S120, the domain block extraction section 662 adds the image read start offset, reads domain block images in the setup domain block image size from the position of adding the offset to the top address of image stored in the image data storage section 54, and sets any of the read domain block images to a notable block image. After this, other sections repeat similar processing to that described above. [0119] On the other hand, if the number of computation times of overlap processing is set to two or more and the number of times the above-described processing has been performed reaches the setup number of overlap computation times (YES at S300), the overlap processing unit 686 performs average processing of referencing the pixel weighting shown in FIG. 5, finding the average value of image duplicately processed (overlap part) accompanying the overlap processing, and adopting the found value as the value of the pixel (S320). The value is projected to the correspondence position in the template image, the value entered in the template image memory area is divided by the value, and the resultant image is stored in the enlarged image memory for update. The first time of image re-enlargement processing (iterated enlargement processing) of local collage is now complete. [0120] When the number of computation times of overlap processing is set to one, namely, overlap processing is suppressed, the average processing is not required and one enlarged image read from the enlarged image data storage section 58 is output intact. That is, only when execution of overlap processing is set, the second image enlargement processing section 660 shifts the block image read start position by an arbitrary value relative to the original image, performs enlargement processing more than once, and adopts the average value as pixel data for duplicate (overlap) pixels, thereby providing the final enlarged image. Accordingly, block image distortion can be reduced. [0121] Next, the iterated processing control section 672 determines whether or not the number of iterations reaches the predetermined number of times n (S16). If the predetermined number of times is not reached, the iterated processing control section 672 commands the domain block extraction section 662, the overlap processing unit 686, etc., to iterate the processing using the twice enlarged image prepared by the collage processing (NO at S16). [0122] In the iterated processing, the domain block size and the range block size need not be set to the same as those at the first time and may be changed. Here, the domain block size is set to 3 and the range block size is set to 7. The again setup domain block size and range block size, the original image, and the enlarged image provided in the first enlargement (already stored in the enlarged image memory) are used to again perform the above-described collage processing. At this time, four types of 7�7 range blocks containing 6�6 pixels on the enlarged image corresponding to the 3�3 domain block on the original image can be taken as shown in FIG. 10. [0123] The enlarged image used in the second enlargement is already subjected to the edge enhancement processing of the edge enhancement processing section 671 and thus the density of the original image is not faithfully reproduced. However, the original image is approximated again by the least squares method in the second enlargement and thus a density correction is made at the time. Consequently, the density characteristic of the original image can be faithfully reproduced while the edges are made sharp. Upon completion of the second iteration, then the third iteration, the fourth iteration, . . . , are executed. In the example, the first to fourth iterations (a total of five times of collage processing) are executed. At this time, block size combinations and the edge enhancement parameter as listed in Table 1 given below are used; [0124] Preferably, the edge enhancement parameter of the last fifth iteration is always set to 0.0. The reason why the parameter is set to 0.0 is that if the pixel values resulting from performing least square approximation of the original image are not used at the termination of the last iteration, the density characteristic becomes different from that of the original. If edge enhancement is not executed at the last fifth time, the edges are already reproduced sufficiently to be sharp by the four iterations. This means that the edge parts can be enlarged sharply. [0125] In the first embodiment, sharpness of edges can be built up not only by the fractal technique, but also by the block size ratio of 2D�R0, the edge enhancement processing, and the iterated processing while referencing the once enlarged image. In addition, noise can also be removed as the iterated processing is performed, and a very high-quality enlarged image can be generated. Particularly in the first to third enlargement, the relation of 2D<R0 holds between the domain size D and the range size R0, and projection reduction of R0 ->2D is performed in the enlarged pseudo domain block preparation processing in the enlarged pseudo domain block preparation section 670. [0126] That is, the R0 size block larger than the actually required 2D size is adopted and is reduced to the 2D size and thus the effect of particularly making it possible to easily concatenate obscure thin lines on the original image on the enlarged image can be provided and consequently the element of restoration rather than simple enlargement can be added. [0127] In the processing procedure of the first embodiment, the domain block size D is set to 3 and the range block size R0 is set to 6 in the fourth enlargement and thus if a range block is selected so as to contain a block on the enlarged image corresponding to the domain block, only one can be taken. [0128] In such a case, as shown in FIG. 11, a frame of width 1 may be put on the enlarged image corresponding to the domain block, and a total of nine 6�6 blocks contained therein may be referenced. In the first embodiment, doing so at the fourth time, the image already sufficiently converges at the fifth time and thus the block itself on the enlarged image corresponding to the domain block is adopted as the range block. That is, in this case, search for the block where the least square error becomes the minimum is not substantially made. Of course, in every block size combination, a frame of width n may be put on the surrounding of the block on the enlarged image corresponding to the domain block and the range blocks may be referenced from the inside. [0129] If the range block size R0 is smaller than the enlarged pseudo domain block size D, for example, if the domain block size D is 3 and the range block size R0 is 5, range blocks may be selected only from the inside of the block on the enlarged image corresponding to the domain block, as shown in FIG. 12. Generally, the enlargement technique can select range blocks sufficiently well approximated if search is made for range blocks in a very small range. [0130] In the first embodiment, both domain and range blocks are squares, but either or both of domain and range blocks may be made rectangular, of course. For example, the range block 3�4 may be adopted for the domain block size 2�3 or the range block 4�4 may be adopted for the domain block size 2�3. [0131] The edge enhancement parameter α may be switched for each block. For example, the parameter may be set to a large value where the value of the domain block standard deviation VDv is large (for example, an edge part, etc.,); the parameter may be set to a small value or 0.0 where the value of the standard deviation VDv is small (for example, a flat part, etc.,). This means that the edge enhancement parameter a may be switched in response to the edge degree. Accordingly, only the edge parts can be enhanced efficiently, resulting in a more appropriate image. [0132] If the edge enhancement parameter α is set to 0.0, the processing routine is executed although the edges are not actually enhanced, and the processing speed is not improved. Therefore, preferably the edge enhancement processing routine is skipped instead of setting the edge enhancement parameter a to 0.0, whereby the processing speed is improved. This also applies to the case where the edge enhancement parameter α is set to 0.0 in other embodiments. [0133]FIG. 13 is a diagram to describe a second embodiment of image enlargement processing section 55 and is a block diagram to show details of a first image enlargement processing section 560. [0134] The first image enlargement processing section 560 of the second embodiment is a functional section for performing image enlargement processing proposed in Japanese Patent Application No. 2001-341432 by the applicant of the invention. The first image enlargement processing section 560 uses a technique of combining the concepts of fractal enlargement and linear, interpolation or bilinear, searching for a range block of an intermediate size between the domain block size and the post-enlarged domain block size according to a fractal technique, and enlarging the range block to the objective enlarged domain block size by linear interpolation or bilinear, thereby reproducing sharp step edges by the fractal enlargement and reproducing an image with less texture part crush by the linear interpolation or bilinear. [0135] The image enlargement processing of the second embodiment uses the enlargement processing proposed in Japanese Patent Application No. 2001-341432 as a function section for preparing an initial twice enlarged image. In the enlargement processing of the first image enlargement processing section 560, the point of leaving some blurring in the whole of the enlarged image is corrected as a second image enlargement processing section 660 performs enlargement processing, whereby while occurrence of image quality degradation caused by noise, jaggies, block distortion, etc., is prevented, edge parts are enlarged more sharply than those in the related art. [0136] The first image enlargement processing section 560 has a basic configuration similar to that of the second image enlargement processing section 660 although it does not comprise an edge enhancement processing section 671 or an iterated processing control section 672. Functional parts of the second image enlargement processing section 660 corresponding to those of the first image enlargement processing section 560 are denoted by reference numerals 5** so as to correspond to reference numerals 6**. However, the first image enlargement processing section 560 differs from the second image enlargement processing section 660 in processing as described later. The first image enlargement processing section 560 and the second image enlargement processing section 660 may share the corresponding functional parts for making the circuit scale compact without providing the first and second image enlargement processing sections as separate bodied. The difference between the first image enlargement processing section 560 and the second image enlargement processing section 660 will be discussed. [0137] To begin with, a range block extraction section 564 selects as a range block image, an MR1�NR1 (in the correspondence with the above-given example, 3�3) block containing an MD1�ND1 (in the above-given example, 2�2) domain block in the original image extracted by a domain block extraction section 562. That is, while a range block extraction section 664 of the second image enlargement processing section 660 references a range block from a previously enlarged image, the range block extraction section 564 selects a range lock from the original image itself. [0138] The range block extraction section 664 extracts a range block so as to satisfy the relation of R0≧r*D, but the range block extraction section 564 extracts a range block so as to satisfy the relation of r*D>R1>D. This means that the size R1 of the first block unit is larger than the size D of the first block unit and is smaller than the enlarged block unit provided by enlarging the size D (first block unit) at a preset enlargement ratio. [0139]FIG. 14 is a drawing to describe an example of processing in an enlarged range block preparation section 570 (with use of projection). An enlarged pseudo domain block preparation section 670 projects a 5�5 range block image to 4�4 size for reduction. For the enlarged range block preparation section 570 to generate an initial twice enlarged image (0th enlargement processing), processing of enlarging a 3�3 range block image to 4�4 size becomes necessary. However, also in this case, projection, linear interpolation or bilinear, etc., may be used. [0140] For example, the enlarged range block preparation section 570 uses the area ratio when the most similar range block image of 3�3 size selected by a similarity degree determination section 568 is projected to size rD=4�4 size, and weights and adds the pixel values based on the area ratio when 3�3 size is projected to 4�4, for example, as shown in the figure, thereby performing calculation of projection enlargement. Letting the pixel values of the 3�3 size be {Pij|i, j=1, 2, 3} and the pixel values of the 4�4 size after enlargement be {Qij|i, j=1, 2, 3, 4}, the pixel values after enlargement are given according to expression (9). To enlarge 3�3 to 4�4, the result also becomes the same value regardless of projection or linear interpolation or bilinear. [0141] Since the first image enlargement processing section 560 does not have the functional part corresponding to the edge enhancement processing section 671, edge enhancement processing is not performed for the enlarged range block image generated by the enlarged range block preparation section 570. To adopt shared circuitry with the second image enlargement processing section 660, edge enhancement parameter α of the edge enhancement processing section 671 may be set to 0.0, as described earlier. [0142] Other functional parts perform similar processing to that of the functional parts of the second image enlargement processing section 660. At the stage at which the twice enlarged image provided in the 0th enlargement processing of the first image enlargement processing section 560 is entered in enlarged image memory, the second image enlargement processing section 660 repeats steps S120 to S320 of the first embodiment with the same parameters as those of the first embodiment. Therefore, as a whole, the parameters listed in Table 2 given below are used through a total of five iterations in addition to the 0th enlargement processing. The term �original� enclosed in parentheses under range block size means referencing range blocks from the original image, and indicates processing in the first image enlargement processing section 560. The term �enlarged� means referencing range blocks from the �n−1�st enlarged image, and indicates processing in the second image enlargement processing section 660. This also applies to other tables given later. [0143] According to the second embodiment, the initial 0th enlargement processing is performed by the method proposed in Japanese Patent Application No. 2001-341432 by the applicant of the invention rather than nearest neighbor, so that good image quality is already provided at the 0th time stage. That is, jaggy occurrence is suppressed and an enlarged image less blurred is provided in the process of generating the initial twice enlarged image and at the same time, occurrence of noise-like garbage and fine-split-like pixel value staining in a step edge part can be prevented. Further, the second image enlargement processing section 660 at the later stage generates an enlarged image by iterating local collage processing, so that edge parts can be enlarged sharply and the image can be converged on a more ideal image. [0144] In the enlargement processing of the first image enlargement processing section 560 in the second embodiment, other modifications proposed in Japanese Patent Application No. 2001-341432 can be applied in addition to the processing described in the second image enlargement processing section 660 of the first embodiment, needless to say. Other modifications proposed in Japanese Patent Application No. 2001-341432 may be applied to the second image enlargement processing section 660. [0145] Next, a third embodiment of image enlargement processing will be discussed. Here, an image enlargement processing section 55 comprises a first image enlargement processing section 560 as in the second embodiment. [0146] In the third embodiment, block size change processing of separating edge and texture parts is performed in addition to change in the enlargement block size, edge enhancement parameter a, and the number of iterations in the second embodiment. To begin with, the original image is enlarged twice with basic parameters listed in Table 3 given below in a similar manner to that in the second embodiment: [0147] In the third embodiment, the number of iterations is reduced to three, because the 0th image is previously prepared with high quality according to a similar technique to that in the second embodiment rather than nearest neighbor and thus the number of iterations required for the image to converge may be lessened. The edge enhancement parameter α is taken large as �0.4� or sufficiently sharpening the edges with a small number of iterations. [0148] In the third embodiment, as the relation between domain size D and range size R0, the relation of 2D≧R0 is satisfied and particularly at the 0th time and the first time, 2D>R0. To use such parameters, when an R0 size range block is projected to an enlarged pseudo domain block of 2D size, enlargement processing of projection is performed. At this time, proper blurring is added and thus particularly in a texture part, unnatural dot concatenation does not appear and good reproduction can be provided. In a step edge part, blurring once occurs as the projection enlargement is executed, but the edge part is sharpened by the immediately following edge enhancement processing (with the parameter set to a high value), so that the step edge part is not degraded (jaggies and blurring do not occur). [0149] In the first embodiment, the block size of 2D<R0 is selected and thus restoration of a thin line is high, but disadvantage in that busy pattern concatenation in the texture part is made intentionally, resulting in unnatural appearance on the enlarged image may appear. In contrast, in the method according to the third embodiment, the balance between the texture part and the step edge part becomes better as compared with the first embodiment. [0150] Generally, the relation between the domain size D and the range size R0 and the effect of the relation on the image quality are as listed in Table 4 given below. The evaluation of the step edge part varies depending on whether or not edge enhancement processing and iterated processing are performed. [0151] In the third embodiment, the block size of 2D>R0 is used and thus problems of poor thin line concatenation and slightly noticeable jaggies occur. [0152] Next, a fourth embodiment of image enlargement processing will be discussed. Here, an image enlargement processing section 55 comprises a first image enlargement processing section 560 as in the second embodiment. [0153]FIG. 15 is a drawing to show examples of edge detection filters used in enlargement processing of the fourth embodiment. Separate filters are used for detecting horizontal and vertical edges. [0154] The fourth embodiment is intended for solving the image quality problem of a thin line part in the third embodiment. Thus, in the fourth embodiment, the edge detection filters shown in FIG. 15 are used to extract any desired specific part of a thin line part, etc., and when the desired specific part is extracted, domain block size D is switched to 3 and range block size R0 is switched to 7 and enlargement is executed with parameters as listed in Table 5 given below; [0155] In the enlargement processing of the fourth embodiment, a 3�3 domain block is extracted at the first twice enlargement time. At this time, the edge detection filters shown in FIG. 15 are used to filter the 3�3 domain block. If the absolute values of values provided as a result of filtering are predetermined numbers or more in both vertical and horizontal directions in edge strength and further the value of pixel standard deviation VDv provided in a similarity degree determination step is a predetermined number or more, the part is assumed to be a step edge part or a thin line part and the block sizes are switched to domain block size D=3 and range block size R0=7 for processing; otherwise, the domain block size D is set to 3 and the range block size R0 is, set to 5 for processing. [0156] The edge detection filters enable reasonably strong edge parts to be reproduced more sharply according to domain block size D=3 and range block size R0=7. This means that the image can be enlarged with higher quality by changing the block sizes in edge parts for processing. Of course, the edge enhancement parameter α may be switched between an edge part and any other part. [0157] More accurately a step edge part and a thin line part are extracted and the block sizes are switched to domain block size 3 and range block size 7 for enlargement, whereby a higher-quality enlarged image can be provided. [0158] In the example, the processing parameters are changed in response to the extracted part only when the first twice enlargement is executed. However, a similar technique may also be applied at the second or later iterated processing. The detection filter specifications may be changed each time. [0159] Next, a fifth embodiment of image enlargement processing will be discussed. Here, an image enlargement processing section 55 Comprises a first image enlargement processing section 560 as in the second embodiment. In the fifth embodiment, a four-time enlarged image rather than a twice enlarged image is prepared. [0160] To prepare a four-time enlarged image, twice enlargement processing is performed twice according to the method of the third embodiment. This means that a twice enlarged image is again enlarged twice to provide a four-time enlarged image. The first twice enlargement and the second twice enlargement differ only in used pixel value conversion parameter bk as listed in Table 6 given below: [0161] This effect is as follows: At the first time, the pixel value conversion parameter bk is adopted for each pixel, whereby a twice enlarged image faithful to the original image is provided. At the second twice enlargement, bk is adopted uniformly in the block, whereby the edges produced by the first enlargement are enlarged more smoothly at the second enlargement. The method of the fifth embodiment can be used to provide a four-time enlarged image of high quality. [0162] To use bk=Dv−ak*Rvk, step edges can be enlarged sharply with less noise; in contrast, texture crush becomes remarkable particularly when the domain block size is large. This depends on the difference between linear approximation in batch and linear approximation while the shift amount is adjusted for each pixel when the pixel values in the domain block are approximated by the pixel values in the range block. [0163] Thus, particularly in the first twice enlargement, it is better to use bk=bijk=dij−ak*rijk. At the stage at which the first enlargement processing terminates, texture parts are already enlarged and become step edge parts to soma extent and almost no texture parts exist. Thus, in the second enlargement, bk=Dv−ak*Rvk is used to enlarge the step edge parts more smoothly. [0164] Thus, for example, to repeat twice enlarging an image n times to prepare a 2{circumflex over ( )}n size image, it is advisable to adopt bk=bijk−dij−ak*rijk (expression (8)) for the first twice enlargement and bk=Dv−ak*Rvk (expression (6)) for the remaining twice enlargement. [0165] In addition, for example, in the second twice enlargement, a simple average of the values or a weighted average method may be adopted. Accordingly, the image can be prevented from becoming picture-tinted, and natural image quality can be provided. The weighted average of the two may be used stepwise. [0166]FIG. 16 lists the processing in the fifth embodiment with respect to general integer m-time enlargement and is a drawing to show examples of enlargement ratio combinations. In the examples shown in the figure, if the specified enlargement ratio can be represented by the product of two or more values (for example, the specified enlargement ratio is 6, 8, 9, etc.,), the enlargement ratio is divided for enlarging an image. The enlargement ratio that can be divided into two pieces is also divided into three or more pieces. Further, the enlargement processing can basically produce the highest effect when twice enlargement is executed. Therefore, in 2{circumflex over ( )}n-time enlargement ({circumflex over ( )} denotes exponentiation), processing of repeating twice enlargement n times is the best and thus if possible, such a combination is set. [0167] If the user specifies a prime magnification of 5 times or 7 times, the value cannot furthermore be divided and thus processing of dividing the enlargement ratio for processing, thereby improving the image quality cannot be performed. In this case, a method of repeating twice enlargement for three times to enlarge the image eight times and then reducing the image to any desired size by projection reduction, is adopted as shown in a modification of image enlargement processing proposed in Japanese Patent Application No. 2001-341432 by the applicant of the invention. [0168] Accordingly, the processing speed is sacrificed, but the method is greatly superior to the enlargement technique in the related art in image quality, and can provide a high-quality image. That is, when enlargement ratio K specified by the user is large, if the specified enlargement ratio K is divided into a combination of smaller enlargement ratios and enlargement repetition processing of applying the smaller enlargement ratios in order is performed, mosaic image quality degradation (like a block image) that can occur if the magnification is large can be decreased. This applies not only to prime magnifications, but also to magnifications other than 2{circumflex over ( )}n-times (for instance, six times). The way in which twice enlargement is repeated as much as possible and if the image becomes larger than any desired size, it is reduced to the desired size is the most desirable in point of the image quality. [0169] That is, the enlargement ratio K specified by the user is first changed to nearest 2{circumflex over ( )}n times (K≦2{circumflex over ( )}n) and then twice enlargement is repeated n times and for K<2{circumflex over ( )}n, reduction to K/2{circumflex over ( )}n is executed so that the enlargement ratio becomes the specified magnification K as indicated under �magnification combination to provide best image quality.� Since such processing involves a trade-off between the processing time and the image quality, magnifications may be combined appropriately in response to the processing time or the image quality to which a higher priority is assigned. For example, for 9 to 15 times, four-time enlargement processing may be repeated twice to generate a 16-time enlarged image and then the image may be reduced to a predetermined size. [0170] On the other hand, for example, if an image enlarged 2*2*2 times is reduced to ⅝ in five-time enlargement, memory is occupied more than necessary and the processing time is also taken. Therefore, as a well balanced combination of the processing time and the image quality, for example, as shown in the figure, an image enlarged 2*2 times is reduced to ⅝ and further the image is doubled, whereby the memory and the processing time can be used efficiently. In this case, some detail may be lost as compared with the method of 2*2*2->⅝, but the basic image quality does not involve any problem. In general rational number q-time enlargement, for example, an integer n satisfying q<n is found and the image is enlarged n times and then is enlarged q/n times. [0171] Next, a sixth embodiment of image enlargement processing will be discussed. The sixth embodiment provides a system fitted particularly for a color image. The first to fifth embodiments are examples of enlargement techniques concerning gray images. To apply the embodiments to color images, for example, for an RGB image, a technique of preparing separate 256-step gray images for R, G, and B and enlarging the images and then finally combining the images can be adopted. To use this method, however, KGB edge positions may minutely shift in an edge part and noise of R, G, or B or a mixed color thereof may occur. [0172] This problem can be lessened by adopting a technique of determining the similarity degree on each of R, G, and B planes of a notable block, determining the range block search position based on the R, G, or B image having a higher similarity degree, and finding the pixel values of enlarged image based on the determined range block search position. [0173] Thus, means is adopted for executing steps S120 to S200 (from domain block extraction to similarity degree determination) described above for the R, G, and B images and calculating the optimum range block position for each notable block and then calculating least square coefficients a and b between the notable block and the optimum range block in each of R, G, and B and performing optimization approximation of each color. [0174] Alternatively, a technique of searching for the similarity degree as for the R, G, or B image with the maximum pixel standard deviation VDv and adopting the same position for the remaining two colors may be used. In this method, the pixel standard deviation VDv is already calculated at step S200 (see FIG. 9) and thus the actual search needs to be made only for the color of R, G, or B with the maximum pixel standard deviation VDv, so that the search processing time is reduced to a third. [0175] To provide this control, when the input image is a color image, a control section 552 controls a domain block extraction section 662, a range block extraction section 664, a reduced range block preparation section 666, and a similarity degree determination section 668. This also applies to a first image enlargement processing section 560. [0176] A pseudo gray image Y taking the sun of RGB signals (for instance, Y=R+G+B, 0.3R+0.6G+0.11) may be found and may be used to perform processing to similarity degree determination. That is, only the range block positions are made the same in RGB and least square approximation of each RGB range block to RGB of notable block is conducted. If the means is used, the above-mentioned noise scarcely appears and although the reference block is made the same in RGB, pixel value conversion is executed with the optimum least square coefficients and thus the original image can be held faithful. To perform the processing, the memory capacity required for the processing and the time consumed for block search can be reduced to each a third, so that the memory efficiency can be enhanced and the processing can also be speeded up. [0177] To generate a pseudo gray image, a configuration comprising a correspondence image generation section for providing a correspondence image corresponding to a color image based on color images corresponding to color components of the color image represented by a plurality of color components may be adopted, for example, as in modification of image enlargement processing proposed in Japanese Patent Application No. 2001-341432 by the applicant of the invention. Each of the enlarged image acquisition section 576 and the enlarged image acquisition section 676 may have a color enlarged image generation section 592 for combining images enlarged for colors into a color enlarged image. [0178] The pseudo gray image Y provided by adding the color data representing color image at an adequate addition ratio has been used assuming that it can be considered that only the neighborhood extremely near to notable block image is adopted as a search range and large color change does not occur in the search range. If the search range is taken large, color change occurs and thus it is feared that a false signal may occur in the enlarged image. In this case, if the similarity degree is determined based on the distance on the color space and the pseudo gray image Y is corrected based on the determination result, the fear of occurrence of a false signal in the enlarged image is eliminated if the search range is taken large. [0179] As described above, the enlargement processing methods of the embodiments use the concept of the fractal compression (enlargement) in the related arts in the portion of approximating a domain block by a range block of a larger size than the domain block (different in density if necessary). However, the enlargement processing methods of the embodiments are base on the assumption of image continuity that a range block similar to a notable block (domain block) exists in the same orientation (direction) to the neighborhood of the notable block (domain block), and differ in philosophy from the fractal compression techniques in the related art based on the standpoint that an image is globally self-similar. In addition, the enlargement processing methods of the embodiments also differ from the fractal compression techniques in the related arts in that in searching for a range block, a range block is selected from the neighborhood of the block corresponding to a domain block in the once enlarged image rather than the original image. [0180] For enlargement based on the fractal compression techniques in the related arts, iterated projecting is performed based on the fixed-point theorem of contraction map for convergence. Thus, the pixel value conversion efficient a (corresponding to a contraction ratio) must basically be −1<a<1. In contrast, the enlargement processing methods of the embodiments do not use the iterated convergence processing in the sense of fractal. Thus, the condition −1<a<1 is not required and as described in the similarity degree determination section, the pixel value conversion parameters can be allowed under wider conditions, resulting in large improvement in the image quality. [0181] The enlargement processing methods of the embodiments further differ from the fractal compression techniques in the related arts in that a once enlarged image is referenced and while a range block similar to the domain block is selected out of the enlarged image, re-enlargement processing is performed. As particularly preferred mode, the enlarged image thus generated is used and similar processing is iterated, so that the image quality improvement effect is built up and the effect of the iterated processing on the image quality improvement is extremely large. In addition, if edge enhancement processing is performed at an intermediate point of iteration, the edge strength at the enlargement time can also be controlled easily and effectively. [0182] Therefore, the enlargement processing methods of the embodiments use the fractal technique in a part, but the provided enlarged image is not entered in the definition of attractor of fractal theory and therefore the enlargement differs in sense from the enlargement of a fractal compression image. Although the enlargement processing methods of the embodiments have different portions from the fractal concept in the related arts, the most useful concept of the fractal techniques (the concept of approximating a domain block by a range block larger than the domain block) forms an important element in the enlargement processing methods of the embodiments and largely contributes particularly to reproduction of sharpness of edges. [0183]FIG. 17 is a drawing to show an example of the hardware configuration to form an image processing apparatus 5 as software using a CPU and memory, namely, using an electronic computer. [0184] The image processing apparatus 5 comprises a CPU 902, ROM (Read-Only Memory) 904, RAM (Random Access Memory) 906, and a communication I/F (interface) 908. It may also comprise a record and read unit for reading and recording data from a storage medium, such as a hard disk drive 914, a flexible disk (FD) drive 916, or a CD-ROM (Compact Disk ROM) drive 918. The hard disk drive 914, the FD drive 916, or the CD-ROM drive 918 is used to register program data to cause the CPU 902 to perform software processing. The communication I/F 908 serves as an interface for transferring communication data to and from a communication network such as the Internet. [0185] The basic configuration and operation of the described image processing apparatus 5 can be made similar to those of the embodiments described above. A program for causing the computer to execute the above-described processing is distributed through a record medium such as CD-ROM 922, or may be stored on an FD 920 rather than the CD-ROM 922. An MO drive may be provided for storing the program on an MO disk or may be stored on any other storage medium such as flash memory, or more specifically, on a nonvolatile semiconductor memory card 924. Further, the program may be downloaded from another computer such as a server computer, via the communication network such as the Internet, so that the program is obtained or updated. [0186] An optical record medium such as a DVD, a magnetic record medium such as MD, a magneto-optical record medium such as PD, a tape medium, and semiconductor memory such as an IC card or a miniature card, can be used as record media in addition to the FD 920 and the CD-ROM 922. [0187] Some or all functions of the processing in the image processing apparatus 5 described as the embodiments can be stored on the FD 920 or on the CD-ROM 922, as a record medium example. Therefore, the following program and the storage medium storing the program can be provided. [0188] For example, the program for the image processing apparatus 5, namely, software installed in the RAM 906, comprises the functional parts of domain block extraction section 562, 662, range block extraction section 564, 664, reduced range block preparation section 566, 666, similarity degree determination section 568, 668, enlarged range block preparation section 570, enlarged pseudo domain block preparation section 670, enlarged image acquisition section 576, 676, block image combining unit 578, 678, and overlap processing unit 586, 686, like the image enlargement processing section 55 described above. [0189] The software is stored on a portable storage medium such as CD-ROM or FD, for example, as a printer driver or a device driver, or may be distributed via a computer network. [0190] For example, to implement the image processing apparatus 5 as a computer, the CD-ROM drive 918 reads the data or the program from the CD-ROM 922 and passes the data or the program to the CPU 902. The software is installed in the hard disk drive 914 from the CD-ROM 922. The hard disk drive 914 stores the data or the program read by the FD drive 916 or the CD-ROM drive 918 and the data prepared as the CPU 902 executes the program, and reads the stored data or program and passes the data or program to the CPU 902. [0191] The software stored in the hard disk drive 914 is read into the RAM 906 and then is executed by the CPU 902. For example, the CPU 902 executes the above-described processing based on the programs stored in the ROM 904 and the RAM 906 as storage medium examples, whereby the functions for the image enlargement processing described above can be provided as software. [0192] Although the invention has been described with the embodiments, it is understood that the technical scope of the invention is not limited to the embodiments. Various changes or improvements can be added to the embodiments and forms to which such changes or improvements are added are also included in the technical scope of the invention. The embodiments do not limit the invention defined by the claims and all combinations of features described in the embodiments are not necessarily indispensable for the solution means of the invention. [0193] For example, the similarity degree determination section 568 makes a comparison between a reduced range block image and a domain block image, thereby determining the degree of similarity therebetween, but a domain block may be enlarged to the same size as a range block and a comparison may be made between the enlarged domain block and the range block image, thereby determining the degree of similarity therebetween. [0194] To set a range block to the neighborhood of a domain block, a plurality of range blocks are previously extracted to the neighborhood of the domain block and a range block having a high degree of similarity with the domain block is selected from among the range blocks, but any other technique may be used to set a range block to the neighborhood of a domain block. For example, image features are previously analyzed and from the image characteristic, the direction of the range block to be set may be found for each domain block. [0195] In the fourth embodiment, considering only the edge characteristic of the domain block image features, parts are separated and enlargement processing is performed with the parameters fitted for the extracted parts, but the invention is not limited to it. For example, considering also the busy characteristic and the flat characteristic, parts maybe separated and enlargement processing may be performed with the parameters responsive to each characteristic. [0196] In the embodiments, the second image enlargement processing section 660 repeats the local collage processing more than once, but may perform the processing only once. [0197] In each of the embodiments, the configuration of using enlarged image data to perform print processing and display has been described, but the invention is not limited to it. For example, the invention can also be applied to various machines and systems for handling images, such as a copier comprising the color scanner 32, the image processing apparatus 5, and the print engine 70 in one piece. [0198] As described above, according to the image processing apparatus of the invention, while the concept of the fractal enlargement technique is used, a range block is selected from the neighborhood of the block corresponding to the domain block in the once enlarged image rather than the original image and when the final enlarged image of the original image is generated, equal-magnification or reductive projection processing is performed. [0199] Thus, the concept of fractal can be used to prevent occurrence of image quality degradation such as blurring, jaggies, and block distortion, the elements of image quality improvement such as sharp edge reproduction, more accurate reproduction of a texture part, restoration of thin lines, and noise removal can be executed at the same time with high quality, and an enlarged image of very high quality can be generated. The advantage is still more enhanced as edge enhancement processing and iterated convergence processing are performed in combination. [0200] To use several-time iterated processing, the processing time is increased, but it is made possible to make range block search in each enlargement in a very narrow range, so that the processing can be more speeded up in the portion and consequently high-speed processing can be accomplished. Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7355610 *Aug 26, 2004Apr 8, 2008Seiko Epson CorporationMethod and apparatus for expanding image data to create enlarged images for displayUS7526137Nov 12, 2003Apr 28, 2009Fuji Xerox Co., Ltd.Image processing apparatus, image processing method, image processing program, and storage mediumUS7564594 *May 10, 2005Jul 21, 2009Funai Electric Co., Ltd.Digital multifunctional imaging apparatusUS7650048 *Sep 13, 2005Jan 19, 2010Noritsu Koki Co., Ltd.Image processor and image processing methodUS7773831 *Apr 19, 2006Aug 10, 2010Agfa-Gevaert N.V.Method for visual inspection of size-reduced digital imageUS7859552Jan 24, 2007Dec 28, 2010Sony CorporationImage processing apparatusUS8059920 *Mar 27, 2006Nov 15, 2011Realtek Semiconductor Corp.Method and apparatus for pixel interpolationUS8098960 *Apr 23, 2007Jan 17, 2012Fuji Xerox Co., Ltd.Image processing apparatus, computer readable medium storing program, image processing method, and computer data signalUS8334880Aug 30, 2010Dec 18, 2012Sony CorporationImage processing apparatusUS20090003712 *Mar 25, 2008Jan 1, 2009Microsoft CorporationVideo Collage PresentationUS20090148064 *Dec 5, 2007Jun 11, 2009Egan SchulzCollage display of image projectsUS20120182287 *Jan 14, 2011Jul 19, 2012Himax Media Solutions, Inc.Stereo image displaying methodEP1814076A1 *Jan 31, 2007Aug 1, 2007Sony CorporationImage processing apparatus* Cited by examinerClassifications U.S. Classification382/298International ClassificationH04N1/393, G06T3/40, H04N1/409Cooperative ClassificationG06T3/403European ClassificationG06T3/40ELegal EventsDateCodeEventDescriptionMay 27, 2010FPAYFee paymentYear of fee payment: 4Feb 7, 2003ASAssignmentOwner name: FUJI XEROX CO., LTD., JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ISHIZAKA, KANYA;REEL/FRAME:013749/0924Effective date: 20030206RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google