Abstract:
A multifunction apparatus and method for enhancing store binary image data, is disclosed. The method includes retrieving the stored binary image data, converting the binary image data into higher-resolution image data, determining image enhancement processes, and applying the image enhancement processes to the higher-resolution image data to produce an enhanced image. The method further includes determining output format of the enhanced image and outputting the enhanced image.

Description:
BACKGROUND  
       [0001]     1. Field  
         [0002]     The present disclosure relates to digital document production equipment and, more specifically, to the enhancement of binary images stored in digital document production equipment.  
         [0003]     2. Description of Related Art  
         [0004]     Digital document production equipment is very common in today&#39;s office environment. Generally, such equipment, which includes printers, copiers, facsimiles, and other multifunction (MF) machines, is configured to capture text and images as digital image data and either reproduce the captured text and images on media based on the digital image data or format the digital image data in a manner suitable for transport across a network.  
         [0005]     By way of example, consider the case of MF machines having digital copying capabilities, where original documents bearing images to be reproduced on paper sheets are typically loaded into the tray of a document handler. The documents are drawn one sheet at a time and moved relative to an image sensor that records reflected light from a series of small areas in the original image as the image moves past the sensor to yield a set of digital signals.  
         [0006]     The digital signals are subsequently converted into binary image data. The binary image data is then compressed and stored in memory and, upon printing, the stored compressed binary image data is read out of memory, decompressed, and forwarded to an output device, such as, for example, an image output terminal (IOT) to print the scanned image on a sheet.  
         [0007]     With regard to the quality of the reproduced image itself, some MF machines include user-selectable image enhancement options that are applied to the continuous tone image prior to binarization. Such continuous tone image formats are of higher resolution and typically comprise 8-bits (or higher) per pixel that represent greyscale or color images in the form of continuously varying tonal ranges. The user-selected enhancement options adjust image features and artifacts by manipulating and/or transforming the continuous tone image data. The enhanced continuous tone image data is then typically binarized and then supplied to the IOT. This results in an output image that has higher image quality and/or that has the user-selected image enhancement options applied to the input/scanned image.  
         [0008]     More sophisticated MF machines offer a “store and retrieve” option, whereby stored image data may be later accessed and retrieved for future and different usage as originally intended. Upon selection of this option, the image data is stored in memory and may include the user-selected image enhancement options&#39; information (i.e., image metadata). However, as a practical matter, because memory storage space remains at a premium and processing speed is an important factor, the image data is stored in the compressed binary image data format—rather than the continuous tone image formats. As a result, upon retrieval, new image adjustments and enhancements effected by the user-selectable options cannot be applied. Because binary image data is limited in its ability to accommodate image enhancements and improvements, the use of the “store and retrieve” feature becomes limited. For example it may force users to either re-copy the original image or settle for lower fidelity reproductions of the previously stored image.  
       SUMMARY  
       [0009]     A system and method of enhancing binary image data are provided. In one embodiment, the method comprises retrieving the stored binary image data, converting the binary image data into higher-resolution image data, determining at least one image enhancement process, and applying the image enhancement process to the higher-resolution image data to produce an enhanced image. The method further includes determining output format of the enhanced image and outputting the enhanced image. The higher resolution image data may be of the continuous tone type.  
         [0010]     Another embodiment includes an apparatus capable of enhancing stored binary image data. The apparatus includes an image processing system module configured to perform image data conversions and enhancements, a memory module configured to store binary image data and metadata indicative of image attributes, an image output terminal module configured to output an image, a network interface module configured to enable communications with a network, and a controller The controller module is configured to retrieve the stored binary image data from the memory module, initiate the conversion of the binary image data into higher-resolution image data by the image processing system, determine image enhancement processes, direct the image processing system to apply the image enhancement processes to the higher-resolution image data to produce an enhanced image, determine output format of the enhanced image, and output the enhanced image. The image may be output to an image output terminal module in the form of a printer for printing the image. Also, the image may be transmitted to a network via a network interface module or sent to a remote fax destination through a fax interface module.  
         [0011]     This embodiment may also, as an alternative, include the application of image enhancement processing, with the use of the metadata, to be performed in the background at times when the system is not busy and the storing of the subsequently processed image back into an Electronic Precollation Memory for sending of the additionally enhanced image to the IOT at a later time of the users choosing. Thus, immediate output of the image to a functional module is not necessary, and it may be output to a memory awaiting use by a functional module.  
         [0012]     Other objects, features, and advantages will become appreciated from the foregoing detailed description, the accompanying drawings, and the appended claims.  
     
    
     BRIEF DESCRIPTION OF DRAWINGS  
       [0013]     The accompanying drawings, which are incorporated in and constitute a part of the present patent specification, depict corresponding embodiments of the invention, by way of example only, and it should be appreciated that corresponding reference symbols indicate corresponding parts. In the drawings:  
         [0014]      FIG. 1  depicts a block diagram associated with the principal digital copying features of a MF machine; and  
         [0015]      FIG. 2  depicts a system and method of applying image enhancement and image format manipulation options to binary image data. 
     
    
     DETAILED DESCRIPTION  
       [0016]      FIG. 1  depicts a block diagram associated with the principal digital copying features of a MF machine  100 . Such an apparatus is intended to cover scanners, printers, copiers, facsimiles, or other multifunction machines that are capable of reproducing images and documents. Moreover the particular apparatus disclosed is merely an exemplary embodiment and, in no way, is it intended to be limiting.  
         [0017]     As illustrated in  FIG. 1 , MF machine  100  comprises controller module  102 , a user interface (UI) module  112 , a network interface (I/F) module  116 , an image input terminal (IIT) module  104 , an image processing system (IPS) module  106 , an electronic pre-collation system (EPC) module  108  with associated memory  110 , and an image output terminal (IOT) module  110 .  
         [0018]     Controller module  102  is configured to manage and control the overall digital copier functionality of MF machine  100  as well coordinate communications and operations between the various modules. Controller  102  may, thus, comprise micro-processing circuitry, application-specific integrated circuitry (ASIC), or similar logic circuitry capable of processing information and instructions, responding to information requests, communicating with various associated modules, and executing commands. In so doing, controller  102  is configured to operate with executable instructions, such as software and/or firmware code, that effect the processes associated with the embodiments of the present invention.  
         [0019]     To illustrate the interoperability of some of the various modules (e.g., image input terminal (IIT) module  104 , image processing system (IPS) module  106 , an electronic pre-collation system (EPC) module  108 , memory  110 , and image output terminal (IOT) module  110 ), consider that original documents bearing images to be reproduced are moved relative to image input terminal (IIT)  104  that optically reads or scans the original image. IIT  104  includes an image sensor that records reflected light from a series of small areas in the original image as the image moves past the sensor to yield a set of digital signals.  
         [0020]     The digital signals are subsequently converted, by an image processing system (IPS)  106 , into binary image data. It will be appreciated that the binary image data comprises lower resolution binary data formats. That is, for black and white images (such as black text on white background), the binary image data represents of the on/off state of white content in the image pixels and, therefore, has a 1-bit per pixel resolution. For color original images, the binary image data represents the on/off state of each of binary cyan, magenta, yellow, and black (CMYK) content of the image pixels. The IPS  106  may use any known technique for processing the image, including applying transfer curves, linear and non linear filters, or color transformation matrices or tables to the image. The IPS  106  then compresses the binary image data and stores the data in the memory  110  associated for example with electronic pre-collation system (EPC)  108 .  
         [0021]     EPC  108  is configured to store images and documents in electronic form and pre-collate the document pages. For typical copying tasks, the stored compressed binary image data is read out of EPC memory  110 , decompressed, and forwarded to image output terminal (IOT)  114  to print the scanned image on a sheet. That is, the IOT  114  prints the image onto a sheet of paper or other substrate medium.  
         [0022]     Returning to  FIG. 1 , UI module  112  is configured to enable users to enter operation commands, or the like, and includes a user input section  112 A and display section  112 B. The display section  112 B may comprise a liquid crystal display (LCD), for example, while user input section  112 A may comprise buttons. Moreover, both user input section  112 A and display section  112 B may comprise a touch panel. In accordance with embodiments of the present invention, user-selectable image enhancement options as well as store and retrieve options are communicated to controller module  102  via UI module  112 .  
         [0023]     Finally, network interface (I/F) module  116  is configured to communicate and transport information to and from network  120 . That is, MF machine  100  may be coupled to network  120  for remotely accepting and performing printing tasks as well as being able to transport digital image data to a client across network  120 .  
         [0024]      FIG. 2  depicts process  200  directed to effect image enhancements of stored, compressed, binary image data, in accordance with embodiments of the present invention. For the sake of brevity, it is assumed that a prior copy task has been initiated and that the “store and retrieve” option for future reproductions has been selected by the user, via UI module  112 , so that the original image has been scanned by IIT module  104  and the compressed binary image data has been stored in EPC memory  110 .  
         [0025]     As depicted in task  202 , the retrieval option is selected, so that the binary image data is accessed, uncompressed, and retrieved from EPC memory  110  as well as image metadata. Image metadata may include attribute information, such as, copy settings, segmentation tag maps, as well as image processing parameters, such as prior image enhancement adjustment information. Metadata may be included as part of the image data so that when it is converted to continuous tone there is extra information to undo/do certain processing for the retrieval. For example, one part of the metadata information could be Original Type mode (Photo, Text, Mixed) that the user had selected while scanning. This apriori information could be used to apply suitable look up table in the contone restoration process. Other examples of such metadata for user-selected settings may include original sub-type, background suppression, contrast enhancement, dynamic range adjustment, brightness adjustment, sharpness adjustment, hue adjustment, chrome adjustment, color balance, and saturation adjustment. Also metadata could include data to direct further processing of the image (for example the background suppression) so that at a later time the user through the store and recall feature could select an image and the metadata would indicate that background suppression has been applied.  
         [0026]     In task  204 , the binary image data is converted to continuous tone image data. That is for black and white images, the binary image data may be converted from the 1-bit per pixel data to an 8-bit per pixel greyscale image data, while for color images, the binary 4 planes of 1-bit per pixel CMYK image data may be converted to 32-bit (i.e., 8 bits per color plane) per pixel color image data. Such a conversion, may include methods such as the one using look up tables as described in U.S. Pat. No. 6,343,159, the entirety of which is incorporated herein by reference. Alternatively such a conversion may include methods such as the one using a digital filtering approach described in patent application Ser. No. 11/126,970, the entirety of which is incorporated herein by reference.  
         [0027]     In task  206 , process  200  determines whether user-selectable image enhancement options have been selected, via UI  112 , for the retrieved image. If so, the user-selected image enhancement information is identified, in task  208 , and provided for processing to task  212 . If user-selectable image enhancement options have not been selected, automatic enhancement features are identified, in task  210 , and provided for processing to task  212 . The automatic enhancement features may be based, for example, on the stored image metadata.  
         [0028]     As noted above, image enhancement may involve adjusting image features and artifacts by manipulating and/or transforming the continuous tone image data. Whether user-selected or automatically-provided, image enhancement may include, for example, original type, original subtype, background suppression, contrast enhancement, dynamic range adjustment, brightness adjustment, sharpness adjustment, hue adjustment, chroma adjustment, color balance adjustment, and saturation adjustment. Such enhancement processes are known and need not be detailed herein. Image enhancement may involve adaptive dynamic range adjustment via methods described in the patent application Ser. No. 11/275,078, which is incorporated herein by reference.  
         [0029]     In task  212 , continuous tone image data is processed by applying the user-selected or automatically-provided image enhancement information. For color images, this may include color space conversions. That is, 32-bit per pixel color image data, which resulted from the CMYK conversion in task  204 , may be transformed back to an improved version of the original color space (e.g., a device independent color space such as Lab or YCbCr color spaces). In particular, the image metadata may include attribute information regarding the conversion of the original color space to continuous tone CMYK. This metadata may then be retrieved from EPC memory  110  and exploited to perform an as accurate as possible reverse transform to achieve the original color space. The user-selected or automatically-provided image enhancement information may then be applied to the original color space, thereby rendering an enhanced, higher fidelity version of the image. The enhanced original color space image may then be converted back to continuous tone 32 bit per pixel CMYK for processing or left in the original color space or converted to a 24 bit per pixel standard color space such as RGB.  
         [0030]     Based on user-selectable input, such as, for example, via UI  112 , process  200  then determines, at task  214 , whether the enhanced image data is to be outputted as an enhanced continuous tone image or as an enhanced binary image. If the enhanced continuous tone image output is selected, then the enhanced continuous tone image is forwarded to an output device in the appropriate color space, in task  220 . The output device may include IOT  114 , in which the enhanced continuous tone image is reproduced on a sheet. Alternatively, the enhanced continuous tone image may be exported to a network  120  file system or e-mailed to a recipient or sent to remote fax destination through the fax interface module, thereby allowing the “store and retrieve” feature to operate as a “scan-to-file” task.  
         [0031]     If, in task  214 , the enhanced binary image output is selected, the enhanced continuous tone image is converted, in task  218 , as an enhanced binary image. That is, techniques, such as, error diffusion, dithering, and/or thresholding or any other type of halftoning are applied to the enhanced continuous tone image to generate the enhanced binary image. This task also enables previously stored color images to be translated into black and white images. The enhanced binary image is then forwarded to an output device, as described above, in task  220 .  
         [0032]     In this manner, a stored binary image may be enhanced and adjusted for future reproductions. Moreover, the elements of MF machine  100  may be configured to effect the process described above. In one embodiment, for example, controller module  102  may be modified with executable instructions and commands in conjunction with IPS module  106 , EPC module  108 , memory  110 , and/or UI  112 , to perform the above-identified process of enhancing stored binary images.  
         [0033]     It will be appreciated that various of the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Also, various alternatives, modifications, variations or improvements are also intended to be encompassed by the following claims.