Image processing apparatus and image forming apparatus

An image processing apparatus includes a character recognition section, a translation section, an image processing section, a selection acceptance section, and a control section. The character recognition section performs character recognition processing on image data. The translation section translates an original text obtained through the character recognition processing performed by the character recognition section into a predetermined language and creates a translated text. The image processing section generates a replaced image in which a text portion of an original image shown in the image data is replaced from the original text by the translated text. The selection acceptance section accepts an instruction of selecting, as an output target, either one or both of the original image shown in the image data and the replaced image. The control section performs, in accordance with the accepted instruction, processing of outputting an output target image selected as the output target.

INCORPORATION BY REFERENCE

This application claims priority to Japanese Patent Application No. 2017-250232 filed on Dec. 26, 2017, the entire contents of which are incorporated by reference herein.

BACKGROUND

The present disclosure relates to image processing apparatuses and image forming apparatuses and particularly relates to a technique of superimposing a text resulted from character recognition processing as a transparent text on image data of a source document.

There is a technique of performing a character search on a source document by performing character recognition processing on an image data of the source document and saving text data resulted from the character recognition processing in association with the image data. In PDF (portable document format) files, for example, a PDF file having a transparent text exists: in the transparent text, the text data is added to image data as the transparent text.

As another example, there is also a technique of performing OCR (optical character recognition) processing on RAW image data being read in from a scanner, translating OCR text data obtained through the processing into another language (for example, from English to Japanese), and integrating the RAW image data, the OCR text data, and a translated text obtained through the translation to output as a PDF file. It is possible to perform a character search in both English and Japanese through the just-mentioned technique.

SUMMARY

A technique improved over the aforementioned technique is proposed as one aspect of the present disclosure.

An image processing apparatus according to one aspect of this disclosure includes a character recognition section, a translation section, an image processing section, a selection acceptance section, and a control section. The character recognition section performs character recognition processing on image data. The translation section translates an original text obtained through the character recognition processing performed by the character recognition section into a predetermined language and creates a translated text. The image processing section generates a replaced image in which a text portion of an original image shown in the image data is replaced from the original text by the translated text. The selection acceptance section accepts an instruction of selecting, as an output target, either one or both of the original image shown in the image data and the replaced image. The control section that performs, in accordance with the instruction accepted by the selection acceptance section, processing of outputting an output target image selected as the output target.

An image forming apparatus according to another aspect of this disclosure includes the image processing apparatus described above and an image forming unit that forms an image on a recording medium. When the selection acceptance section accepts user selection of selecting the both images as the output target, the image processing section creates print data with respect to any of: simplex printing for two pages under which one of the both images is printed on one page and the other one of the both images is printed on the other page; consolidated printing under which the both images are consolidated into one page in form of 2 in 1; and duplex printing under which one of the both images is arranged at a front side of one page and the other one of the both images is arranged at a back side of the one page. By causing the image forming unit to form the output target image containing the both images, the control section performs the processing of outputting.

DETAILED DESCRIPTION

Hereinafter, a detailed description will be given of an image processing apparatus and an image forming apparatus according to an embodiment of the present disclosure with reference to the drawings.FIG. 1is a functional block diagram schematically showing an essential internal configuration of the image forming apparatus1as an image processing apparatus1A according to an embodiment of the present disclosure.

The image forming apparatus1a multifunction peripheral having a plurality of functions such as a copy function, a printer function, a scanner function, and a facsimile function. The image forming apparatus1includes a control unit10, a document feed unit6, a document reading unit5, an image forming unit12, an HDD92, a fixing unit13, a paper feed unit14, an operation section47, and a network interface section91. The image processing apparatus1A corresponds to the configuration excluding the image forming unit12, the fixing unit13, and the paper feed unit14of the image forming apparatus1shown inFIG. 1.

Description will be given of the case where the image forming apparatus1performs document reading operation. The document reading unit5optically reads a source document conveyed from the document feed unit6or an image of a source document placed on platen glass, and then generates image data. The image data generated by the document reading unit5is saved on, for example, an un-illustrated image memory.

Next, description will be given of the case where the image forming apparatus1performs image forming operation. Based on image data such as the image data generated through the document reading operation and the image data received from a computer, which serves as an external device20, connected to the network, the image forming unit12forms a toner image on a recording sheet, which serves as a recording medium, fed from the paper feed unit14.

The fixing unit13fixes the toner image onto the recording sheet through thermal compression. The recording sheet onto which the fixing processing is applied is discharged to an output tray. The paper feed unit14has a paper feed cassette.

The operation section47receives from an operator for various types of operation and various types of processing executable by the image forming apparatus1, instructions such as image forming operation execution instruction. The operation section47includes a display section473that displays, for example, an operation guide to the operator. The display section473is formed into a touch panel, which permits the operator to touch buttons and keys displayed on a screen to operate the image forming apparatus1.

The network interface section91performs transmission and reception of various pieces of data to and from the external device20such as a PC (personal computer) and a server in a local area or on the Interne. The network interface section91is an example of the communication unit in What is claimed is.

The control unit10is composed of a processor, a RAM (random access memory), a ROM (read only memory), and an exclusive hardware circuit. The processor is, for example, a CPU (central processing unit), an ASIC (application specific integrated circuit), or an MPU (micro processing unit). The control unit10includes a control section100, an operation acceptance section101, a character recognition section103, a translation section104, a generating section105, a synthesizing section106, and an image processing section107.

The control unit10, through operation based on a control program installed in the HDD92, functions as the control section100, the operation acceptance section101, the character recognition section103, the translation section104, the generating section105, the synthesizing section106, and the image processing section107. However, each of the above-mentioned control section100and other sections can be formed of a hardware circuit without depending on the operation performed by the control unit10in accordance with the control program. Hereinafter, the same applies to this embodiment unless otherwise specified.

The control section100is in charge of overall operation control of the image forming apparatus1. The control section100is connected to the document feed unit6, the document reading unit5, the image forming unit12, the fixing unit13, the paper feed unit14, the operation section47, and the network interface section91to perform driving control of these sections.

The operation acceptance section101accepts operation input from the user via the operation section47. Furthermore, the operation acceptance section101includes a selection acceptance section102. Details of the selection acceptance section102will be explained later.

The character recognition section103performs character recognition processing such as OCR (optical character recognition) processing on RAW image data obtained through the reading by the document reading unit5and RAW image data saved on, for example, the HDD92, and creates original text data (hereinafter referred to as original text as needed) in which a character image contained in the RAW image data is converted into text.

The translation section104translates the original text obtained through the processing performed by the character recognition section103into a predetermined language (for example English) and creates translated text data (hereinafter referred to as translated text as needed). Execution of a translation application included in the control program enables the translation section104to perform the function of the translation.

Based on the RAW image data obtained through the reading by the document reading unit5, the generating section105generates data in a PDF format (hereinafter referred to also as PDF data).

The synthesizing section106synthesizes the original text obtained through the processing performed by the character recognition section103into the PDF data generated by the generating section105as a transparent text and generates the PDF file having the transparent text. Furthermore, the synthesizing section106synthesizes the translated text obtained through the translation performed by the translation section104into the PDF data.

The image processing section107generates a replaced image in which a text portion of an original image shown in the RAW image data obtained through the reading by the document reading unit5is replaced from the original text by the translated text.

Next, with reference to a flowchart shown inFIG. 2, description will be given of an example of operation processing performed at the control unit10of the image forming apparatus1as the embodiment of the image processing apparatus1A according to the embodiment with reference to a flowchart shown inFIG. 2.FIG. 3is a diagram for explaining detection of a text area.FIG. 4is a diagram for explaining an example of a hierarchical structure of a PDF file having a transparent text.

When the operation acceptance section101accepts from the user an instruction to start reading the source document, the control section100controls the document reading unit5to thereby cause the document reading unit5to read the source document (step S1).

Then, based on the RAW image data D1obtained through the reading by the document reading unit5(seeFIG. 3), the character recognition section103uses a known technique and detects a text region (for example, the upper-left positional coordinate of the bounding rectangle of each region and the width and the height of the bounding rectangle) (step S2). The character recognition section103performs the character recognition processing on the RAW image data D1within the detected text region and creates the text data (step S3).

The generating section105uses a known technique and finds, from the RAW image data D1obtained through the reading by the document reading unit5, the upper-left positional coordinates C1and C2, the widths W1and W2, and the heights H1and H2of the RAW image data D1for each of the text regions E1and E2. Then the generating section105generates PDF data D2(seeFIG. 4) from the RAW image data D1(step S4).

The synthesizing section106synthesizes an original text D3into the PDF data D2generated by the generating section105as the transparent text so that a character position indicated by the PDF data D2is arranged at the same arrangement position with a character position shown in the original text D3obtained through the processing performed by the character recognition section103(seeFIG. 4) (step S5). The synthesizing section106thereby generates a PDF file F1having the transparent text. As shown inFIG. 4, in the PDF file F1, the PDF data D2and a first layer L1are integrated. The original text D3is embedded in the first layer L1as the transparent text.

Subsequently, based on the original text D3, the translation section104translates a character string (the original text) indicated by the original text D3into the predetermined language (a language different from the language of the original text) (step S6) to thereby create a translated text D4(seeFIG. 5).

Then the synthesizing section106calculates the character size with which an image of a character string shown in the translated text D4having been obtained through the translation by the translation section104can fit within the text regions E1and E2(FIG. 3) in a layout of being displayed at the display section473or being printed by the image forming unit12(step S7).

In the present embodiment, in generating an image for printing or an image for transmission having the translated text D4arranged in the same layout with the PDF data D2, the image processing section107sets the character size of each character image shown in the translated text D4in a size with which when the translated text D4is set to be arranged at the same position with the character position indicated by the original text D3, the translated text D4can fit within the text region E1or E2of the original text D3corresponding the translated text D4.

The synthesizing section106synthesizes the translated text D4and the character size data D5, which indicates the calculated character size, into the PDF file F1composed of the PDF data D2and the original text D3(step S8). The control section100saves the PDF file F1created by the synthesis in the HDD92(step S9).

FIG. 5is a diagram for explaining another example of the hierarchical structure of the PDF file having transparent texts. As shown inFIG. 5, the synthesizing section106integrates, as the PDF file F1, the PDF data D2, the first layer L1, and a second layer L2. The translated text D4is embedded in the second layer L2as the transparent text and the character size data D5is also embedded therein.

When the original text is translated, if the original text and the translated text are of the same character size, character string length of the original text differs from that of the translated text. For example, when Japanese is translated into English, the character string in English becomes longer than that of Japanese. Therefore, in the case where the translated text is in the same character size with the original text, when the image showing the translated text is laid out to be displayed on the display section473or to be printed by the image forming unit12, the translated text exceeds the size of the text regions E1and E2. In order to have the image showing the translated text to be fit within the text regions E1and E2(seeFIG. 3), the synthesizing section106calculates the character size with which the image showing the translated text can fit within the text regions E1and E2(FIG. 3).

Hereinafter describes processing of outputting when the PDF file F1is the output target.

(1) When the operation acceptance section101accepts from the user an instruction to print the PDF F1, the control section100causes the display section473to display an operation screen T1as shown inFIG. 6. The operation screen T1includes selection buttons B1to B3formed thereon, and “ORIGINAL TEXT”, “TRANSLATED TEXT”, and “ORIGINAL TEXT+TRANSLATED TEXT” are displayed on the selection buttons B1to B3, respectively.

The selection button B1is for accepting from the user an instruction to select as a print target the original image having the original text. The selection button B2is for accepting from the user an instruction to select as the print target a translated text image in which as for the text portion the original text is replaced with the translated text. The selection button B3is for accepting from the user an instruction to select as the print target the both images (the original image and the translated text image).

(1-1) When the selection button B1is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select as the print target the original image, as shown inFIG. 7A, the control section100uses the PDF data D2to cause the image forming unit12to form on the recording sheet P1the original image G1that the PDF data D2shows.

(1-2) When the selection button B2is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select the translated text image as the print target, the image processing section107generates the image for printing on which the translated text D4embedded in the second layer L2is arranged in the same layout with the PDF data D2. At this point, the image processing section107sets the position of the translated text D4to be arranged at the same position with the character position indicated by the original text D3. The image processing section107enlarges or reduces the character size of the character image generated on the basis of the translated text D4in accordance with the character size data D5embedded in the second layer L2so that a group of the character image generated on the basis of the translated text D4can fit within the corresponding.

Then, the image processing section107generates the image for printing on which the image showing the translated text created by enlarging or reducing the character size as described above is arranged at the text regions E1and E2of the original image shown in the PDF data D2in place of the original text. The control section100uses the generated image for printing and causes the image forming unit12to form on the recording sheet P2a translated text image G2on which the translated text is arranged at the text portion (the text regions E1and E2) as shown inFIG. 7B.

Here, since the translated text fits within the text regions E1and E2as the character size is enlarged or reduced as shown inFIG. 7B, the layout of the image remain the same even if the translated text is arranged at the text portion in place of the original text.

(1-3) When the selection button B3is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select the both images (the original image G1and the translated text image G2) as the print target, the image processing section107generates, in the same manner as the above (1-2), the image for printing on which the image showing the translated text created by enlarging or reducing the character size is arranged, in place of the original text, at the text regions E1and E2of the original image shown in the PDF data D2. The control section100uses the PDF data D2and the generated image for printing, and causes the image forming unit12to form on the recording sheet P2the both of the original image G1and the translated text image G2on which the text portion has been replaced with the translated text.

As a mode that the control section100causes the image forming unit12to form the both images onto the recording sheet, there are, for example: (a) “simplex printing for two pages”, as shown inFIG. 8A, under which the original image G1is printed on the recording sheet P3and the translated text image G2is printed on another sheet, i.e., a recording sheet P4; (b) “printing with consolidating on one page in form of [2 in 1]”, as shown inFIG. 8B, under which the original image G1is printed on the left half of a recording sheet P5and the translated text image G2is printed on the right half of the same recording sheet P5; and (c) “duplex printing”, as shown inFIG. 8C, under which the original image G1is printed on a front side P61of a recording sheet P6and the translated text image G2is printed on a back side P62of the same recording sheet P6.

The control section100follows the selection instruction inputted from the user through the operation section47and selectively executes any of the above (a), (b), and (c). For example, the control section100causes the display section473to display an operation screen T2as shown inFIG. 9so that the user can arbitrarily select the printing method in accordance with the operation performed on the operation screen T2. The operation screen T2includes selection buttons B11to B13formed thereon: the selection buttons B11to B13display “SIMPLEX PRINTING FOR TWO PAGES”, “PRINTING WITH CONSOLIDATING ON ONE PAGE IN FORM OF [2 IN 1]”, and “DUPLEX PRINTING”, respectively.

When accepting operation from the user on any of the selection buttons B11to B13, the selection acceptance section102accepts: based on the operation performed on the selection button B11, the instruction to print two pages by the simplex printing; based on the operation performed on the selection button B12, the instruction to consolidate two pages into one page in form of [2 in] 1 and print; and based on the operation performed on the selection button B13, the instruction to print two pages with the duplex printing. The control section100causes the image forming unit12to perform image formation (printing) in accordance with content of the instructions received by the selection acceptance section102.

d(2) When the operation acceptance section101accepts from the user the instruction to transmit the PDF file F1to the external device20determined in advance, the control section100causes the display section473to display an operation screen T3as shown inFIG. 10. The operation screen T3includes selection buttons B21to B23displayed thereon: the selection buttons B21to B23display “ORIGINAL TEXT”, “TRANSLATED TEXT”, and “ORIGINAL TEXT+TRANSLATED TEXT”, respectively.

(2-1) When the selection button B21is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select the original image G1as a transmission target, the control section100transmits to the external device20determined in advance a file including the PDF data D2(or a file including the PDF data D2to which a first layer L2is synthesized) through the network interface section91.

(2-2) When the selection buttons B22is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select the translated text image G2as the transmission target, the image processing section107generates, in the same manner as the above (1-2), the image for transmission on which the image showing the translated text D4created by enlarging or reducing the character size is arranged, in place of the original text, at the text regions E1and E2of the original image shown in the PDF data D2. The control section100transmits through the network interface section91the generated image for transmission to the external device20determined in advance.

(2-3) When the selection button B23is operated by the user and the selection acceptance section102accepts through the touch panel the instruction to select the both images (the original image G1and the translated text image G2) as the transmission target, the image processing section107generates the image for transmission on which the translated text created by enlarging or reducing the character size in the same manner as the above (1-2) is arranged at the text regions E1and E2of the original image shown in the PDF data D2in place of the original text. The control section100transmits through the network interface section91the PDF data D2and the generated image for transmission to the external device20determined in advance.

As a method to transmit the both images (the PDF data D2and the data for transmission) to the external device20, there are, for example: (d) “arrange in two pages” under which the original image G1is arranged in one page and the translated text image G2is arranged in another one page; and (e) “arrangement with consolidating on one page in form of [2 in 1]” under which the original image G1is arranged in the left half of one page and the translated text image G2is arranged in the right half of the same page.

The control section100follows a selection instruction inputted from the user through the operation section47and selectively executes either of these (d) and (e). For example, the control section100causes the display section473to display an operation screen T4as shown inFIG. 11so that the user can arbitrarily select the transmission method in accordance with the operation performed on the operation screen T4. The operation screen T4includes selection buttons B31and B32formed thereon: the selection buttons B31and B32display “TRANSMISSION IN TWO PAGES” and “TRANSMISSION WITH CONSOLIDATING ON ONE PAGE IN FORM OF [2 IN 1]”, respectively.

When accepting operation from the user on either of the selection buttons B31and B32, the selection acceptance section102accepts: based on the operation performed on the selection button B31, the instruction to arrange the both images on two pages and transmit; and based on the operation performed on the selection button B32, the instruction to consolidate the both images into one page in form of [2 in 1] and transmit. The control section100transmits the PDF data D2and the data for transmission to the external device20determined in advance through the network interface section91in accordance with content of the instructions received by the selection acceptance section102.

According to the embodiment described above, not only the original image but also the image having the translated text can be output targets for printing and transmission, so that convenience for the user is improved.

In the technique described in the above BACKGROUND, being able to search characters not only in English of the original language but also in Japanese of other language is convenient. However, in the above technique, the image to be obtained in printing a PDF file is the original image (the image showing English, which is the original text, in the above technique) shown in the RAW image data: it is not the image showing the translated text (Japanese in the above technique).

In contrast, in the present embodiment, not only the original image but also the image having the translated text is to be outputted for printing or transmission. This can improve user's convenience.

In addition, in the above embodiment, the RAW image data obtained through the reading by the document reading unit5is targeted for processing, but the target is not limited to such the RAW image data. For example, the RAW image data saved on the HDD92by reception from the external device20(so-called box-saving) may be targeted for processing.

In this case, when no job is being performed by the image forming apparatus1, the character recognition section103, the translation section104, the generating section105, the synthesizing section106, and the image processing section107may be arranged to perform the processing starting from the character recognition up to the creation of the translated text.

The disclosure is not limited to the foregoing embodiment, but may be modified in various manners. Moreover, although the image processing apparatus1A according to the foregoing embodiment of the disclosure is exemplified by the multifunction peripheral, the disclosure is equally applicable to different image processing apparatuses having the copy function and scanner function.

Furthermore, the configuration and processing described in the above embodiment with reference toFIGS. 1 to 11are merely illustrative of the present disclosure and the present disclosure is not intended to be limited to the above configuration and processing.