Photoprinter that utilizes stored templates to create a template-treated image

A photoprinter includes an image input unit through which an original image is configured to be inputted; a display unit configured to display an image; a printing unit configured to print the image displayed on the display unit; an operation input unit adapted to receive an instruction from a user; a template storage unit configured to store a template including an outer guide and an inner guide; and a control unit operatively connected to the image input unit, the display unit, the printing unit, the operation input unit, and the template storage unit. The control unit is configured to create a template-treated image from the original image by displaying a template over the original image on the display unit, and trimming an area of the original image outside the outer guide of the template and performing segmentation around the inner guide.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Japanese Patent Application No. 2005-025949. The entire disclosure of Japanese Patent Application No. 2005-025949 is hereby incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to a photoprinter. More specifically, the present invention relates to a photoprinter capable of creating identification photographs such as passport photographs.

2. Background Information

The idea of employing image processing in devices that are specifically designed to take identification photographs has already been proposed.

Although the increased popularity of digital cameras and photoprinters allows people to take photographs at home with relative ease, people who need identification photographs still need to use image photographing devices specifically designed to take identification photographs like those described above, because of the photograph size and face image size restrictions of identification photographs. Consequently, it is time-consuming and costly for a user to have to avail himself/herself to such image photographing device.

Therefore, it would be evidently more convenient if a user could easily process one's own photograph in order to create an identification photograph. In order to create an identification photograph, it is necessary to trim the background of the photograph. There are existing photoprinters that enable a user to process data acquired using an image capturing device, trim unnecessary data, and add text to the photograph. However, there are no photoprinters that allow a user to easily create an identification photograph.

SUMMARY OF THE INVENTION

The present invention provides a photoprinter that enables a user to obtain a photograph having a predetermined size and a predetermined background in a simple fashion from a digital photograph.

The present invention achieves the aforementioned object by offering a photoprinter having the following constituent features.

A photoprinter includes an image input unit through which an original image is configured to be inputted; a display unit configured to display an image; a printing unit configured to print the image displayed on the display unit; an operation input unit adapted to receive an instruction from a user; a template storage unit configured to store a template including an outer guide and an inner guide; and a control unit operatively connected to the image input unit, the display unit, the printing unit, the operation input unit, and the template storage unit. The control unit is configured to create a template-treated image from the original image by displaying a template over the original image on the display unit, and trimming an area of the original image outside the outer guide of the template and performing segmentation around the inner guide.

With such photoprinter, when an original image is inputted to the photoprinter, the original image can be displayed on the display unit with a template being displayed over the original image. The outer guide of the template is for designating the size of the template-treated identification photograph, while the inner guide of the template is for approximately indicating the outer contour of the person in the photograph, such that segmentation can be performed around the inner guide. The portion of the photograph between the outer guide and the inner guide can be erased as background content.

As a result, with the present invention, a photograph taken with a digital camera can be inputted to the photoprinter through the image input unit, such that the unnecessary portions of the photograph can be trimmed and erased using an identification photograph template, and the resulting identification photograph can be printed out. As a result, an identification photograph can be obtained easily without bothering to go to a photography studio or other photographing facility.

In the photoprinter, the operation input unit preferably has a key, an operation of which results in at least one of an instruction to move the template displayed on the display device and an instruction to change a size of the template displayed on the display device.

With this photoprinter, the user of the photoprinter can adjust the position and/or size of the template. The size of the image can be adjusted by adjusting the size of the outer guide of the template, while the area in which the segmentation is to be conducted can be adjusted by moving or enlarging/reducing the inner guide of the template.

In the photoprinter the template storage unit is preferably configured to store a plurality of different templates, each template including an outer guide and an inner guide, the operation input unit is configured to receive a selection of a template by the user from among the plurality of templates stored in the template storage unit, and the control unit is further configured to create the template-treated image from the original image by trimming an area of the original image outside an outer guide of the selected template and performing segmentation around its inner guide.

With such photoprinter, a user of the photoprinter can select the most appropriate template for trimming the background portion from a particular image by using the operation input unit to acquire the desired template from the template storage unit. For example, templates can be prepared which have outer rectangular guide designed for passport photographs, license photographs, resume photographs, etc. Similarly, templates having different shapes of inner guide can be prepared, such as Ω-shape for males and U-shape for females.

In the photoprinter, the template storage unit is preferably further configured to store a face template, and the control unit is further configured to extract a face image from the original image displayed on the display device based on the face template, and display the template over the extracted face image.

With such photoprinter, the time and effort required to adjust the template manually can be reduced. For example, patterns of a person's eyes, nose, and mouth and these patterns can be used to detect the features of a subject's face to determine the position of the subject's face.

In the photoprinter, the control unit is preferably further configured to adjust a size of the template such that the extracted face image fits inside the inner guide of the template.

With such photoprinter, the time and effort required to adjust the template manually can be reduced. Similarly to automatic positioning of the template described above, the automatic adjustment of the size of the template can be accomplished by establishing patterns that correspond to the shapes of a person's eyes, nose, and mouth.

In the photoprinter, the outer guide of the template has a rectangular shape, and the inner guide of the template has a curved shape.

With the present invention, a photograph taken with a digital camera can be inputted to a photoprinter through an image input unit, such that unnecessary portions of the photograph can be trimmed and erased using a photograph template, and the resulting photograph having a predetermined size and a predetermined background can be printed out. As a result, a photograph of a predetermined size with a predetermined background, such as identification photographs, can be obtained easily without having to go to a photography studio or other photographing facility.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1is a block diagram of the internal components of a photoprinter in accordance with a first embodiment of the present invention andFIG. 2is a diagrammatic view of a photoprinter in accordance with the first embodiment.

As shown inFIG. 1, a photoprinter10in accordance with this embodiment includes a manual operation unit6configured to issue instructions for operating the photoprinter10, a control unit3configured to execute operations in accordance with the instructions from the manual operation unit6, an image input unit1, a display device2, an image storage unit5, a printer unit7, and a template storage unit14. The control unit3includes conventional components such as an input interface circuit, an output interface circuit, and storage devices such as a ROM (Read Only Memory) device and a RAM (Random Access Memory) device. The control unit3is operatively connected to the image input unit1, the display device2, the image storage unit5, the printer unit7, and the template storage unit14so as to be able to selectively control any of the units connected thereto.

The manual operation unit6is configured such that an identification photograph creating mode for creating identification photographs can be selected, which triggers the control unit3to execute an identification photograph creation routine (seeFIGS. 3 and 4, discussed later). As will be described later, the manual operation unit6also has keys associated with moving the template up and down (vertically) and left and right (horizontally) and keys associated with enlarging and reducing the template. For example, the manual operation unit6might be provided with cursor keys8like those shown inFIG. 2.

The image input unit1is configured to receive original image data from an outside source. In this embodiment, the image input unit1is configured to be connected to a computer9and receive image data from there or configured to receive image data from a card-type storage medium with a card reader. Details of such card reader and card-type storage medium will now be described herein since such card reader and card-type storage medium are well known in the art. In this embodiment, data of an image such as one shown inFIG. 5are received from a computer9via the image input unit1. However, the image input unit1can also be connected to, for example, a data storage card for a digital camera.

Controlled by the control unit3, the display device2displays the image of the data obtained from the image input unit1. The manual operation unit6is configured such that a user can select a prescribed image while viewing the display device2.

Controlled by the control unit3, the image storage unit5can store the selected image and also store the same image after it has been processed (as described later).

The printer unit7prints the image. In other words, when an instruction to print is issued from the manual control unit6, the control unit3executes control of the printer unit7such that the printer unit7prints the image displayed on the display device2.

The template storage unit14stores a variety of templates. A template is acquired and displayed on the display device2through control operations executed by the control unit3.

FIG. 6shows an example of what is displayed on the display device2when the identification photograph creating mode is selected. Each of the templates includes an outer rectangular guide12and an inner curved guide13. The outer rectangular guide12of a template is designed to correspond to the size of passport photograph, license photograph, resume photograph, or other identification photograph with a predetermined size, such that the area outside the outer rectangular guide12can be trimmed. The inner curved guide13is provided so as to approximately fit with the contour of the subject. The inner curved guide13serves as guidance when the background of the original image data is erased by segmentation as described later. Thus, the inner curved guide13only needs to fit with the contour of the subject approximately.

In the template storage unit14, a plurality of inner curved shapes13are stored, such as Ω-shaped one for males and a U-shaped one for females. There are keys that are provided on the manual operation unit6so that the user can move the template vertically or horizontally, and that enlarge or reduce the image with manual operations. The template displayed on the display device22can be altered in position and size by the control unit3, to which the user issues instructions to move and/or reduce/enlarge the template through the manual control unit6.

The control unit3is configured to control the various devices (as mentioned earlier) and includes an image processing unit4. In the identification photograph creating mode, the image processing unit4trims the area outside the outer rectangular guide12of the template, erases the background of the original image, applies a certain color to the background, and creates a composite image, which is a template-treated image and can be used as an identification photograph and have a background of a specific color.

The image storage unit5is configured to store the composite images created by the image processing unit4in response to commands from the control unit3to do so. The printer unit7is configured to print composite images created by the image processing unit4. Where the image shown inFIG. 5is the original image, the resulting composite image printed image might be, for example, the one shown inFIG. 7.

FIGS. 3 and 4are flowcharts of the main control routine to be executed by the control unit3in the first embodiment. In step S1, the control unit3checks if any of the original images inputted to the image input unit1has been selected for processing. If the user has selected an image using the manual operation unit6(Y), the control unit3proceeds to step S2. If no particular image has been selected (N), the control unit3waits until an image is selected.

In step S2, the control unit3displays the image selected using the manual operation unit6on the entire screen of the display device2. In this embodiment, the image shown inFIG. 5is received through the image input unit1as the original image and displayed on the display device2.

In step S3, the control unit3determines if the identification photograph creating mode has been selected. More specifically, the control unit3determines if it has received a signal from the manual operation unit6indicating that the identification photograph creating mode has been selected. If the identification photograph creating mode is selected (Y), the control unit3proceeds to step S4. If not (N), the control unit3proceeds to step S14to print the image selected in step S1. Although it is possible with the photoprinter of the present embodiment to perform image processing other than the processing for creating identification photographs before the image is printed, details of such other image processing will not be discussed herein.

In step S4, the outer rectangular guide12and the inner curved guide13of the template are displayed over the image selected in step S1using the manual operation unit6. For example, the image might appear as shown inFIG. 6. As shown inFIG. 6, the outer rectangular guide12of the template is generally square-shaped, the inner curved guide13has an upper half that is generally round. The template is displayed over the image selected in step S1using the manual operation unit6. Although there are a plurality of templates stored in the template storage unit14(seeFIG. 1), one default template out of those templates is displayed at a default location in step S4.

In step S5, the control unit3determines if a change of the template is requested. If so (Y), the control unit3proceeds to step S6. If not (N), the control unit3skips step S6and proceeds to step S7shown inFIG. 4. The photoprinter10is configured such that the user can select a template using the cursor keys8of the manual operation unit6when the photoprinter10is in the identification photograph creating mode.

In step S6, the control unit3acquires a different template from the template storage unit14and replaces the template currently displayed on the display device2with the newly selected one.

In step S7shown inFIG. 4, the control unit3determines if an instruction has been issued to move the outer rectangular guide12of the template vertically or horizontally, or to enlarge or reduce the outer rectangular guide12. More specifically, the control unit3determines if a signal has been received from the manual operation unit6indicating that a user has moved the outer rectangular guide12vertically or horizontally or that the user has enlarged or reduced the outer rectangular guide12. If such signal has been received from the manual operation unit6(Y), the control unit3proceeds to step S8. If such signal has not been received (N), the control unit3proceeds to step S9. The size of the outer rectangular guide12of the template is not allowed to be reduced to such a degree that it intersects with the inner curved guide13of the template. The user performs the movement, enlargement, and reduction of the outer rectangular guide13using, for example, the cursor keys8of the manual operation unit6shown inFIG. 2.

In step S8, if the outer rectangular guide12is moved vertically or horizontally or if the size of the outer rectangular guide12is changed in step S7, the control unit3re-displays the outer rectangular guide12of the template in its new position and size. Here, the outer rectangular guide12has a shape that is designated for a particular use, such as passport picture, driver's license picture, or resume picture. Thus, when the user changes the size of the outer rectangular guide12in step S7, the outer rectangular guide12is proportionally enlarged and reduced while maintaining the ratio between its vertical length and lateral length.

In step S9, the control unit3determines if an instruction has been issued to move the inner curved guide13of the template vertically or horizontally, or to enlarge or reduce the inner curved guide13. More specifically, the control unit3determines if a signal has been received from the manual operation unit6indicating that a user has moved the inner curved guide13vertically or horizontally, or that the user has enlarged or reduced the inner curved guide13. If such signal has been received from the manual operation unit6(Y), the control unit3proceeds to step S10. If such signal has not been received (N), the control unit3proceeds to step S11. When the inner curved guide13of the template is moved or enlarged/reduced, the inner curved guide13is not allowed to intersect with the outer rectangular guide12of the template.

In step S10, if the inner curved guide13is moved vertically or horizontally, or if the size of the inner curved guide13is changed in step S9, the control unit3re-displays the inner curved guide12of the template in its new position and size.

In step S11, the control unit3asks the user of the photoprinter10whether a preview of the identification photograph should be displayed so as to proceed with the printing. If the user chooses to display a preview and proceed with the printing (Y), the control unit3proceeds to step S12. If the user does not choose to display a preview (N), the control unit3proceeds to step S4, where the original image and the default template are displayed again.

In step S12, the image processing unit4of the control unit3performs the trimming and segmentation on the image. During the trimming, an area of the original image outside the outer rectangular guide12is cut off. Also, the image processing unit4performs segmentation on the image around the inner curved guide13of the template. As a result of the trimming, the background11, which is the image other than the subject, is erased, and is replaced with a predetermined color such as white. While various segmentation technologies are well known in the art, any of such segmentation technologies can be utilized in the photoprinter of the present embodiment. Thus, further details of such trimming or segmentation will not be discussed herein. Examples of segmentation methods are shown in U.S. Pat. Nos. 6,608,929 and 6,813,379, and U.S. Patent Application Publication Ser. No. 2003/0219157, which are incorporated herein by reference.

After the image processing, the control unit3displays a print preview of the template-treated identification photograph. The resulting composite photograph can be, for example, as shown inFIG. 7. This image is a composite image created by the image processing unit4in response to instructions from the control unit3, and only includes a region within the outer rectangular guide12of the template, with the background11being white.

In step S13, the control unit3determines if an instruction to print has been issued from the manual operation unit6. More specifically, the control unit3determines if the user has instructed with the manual operation unit6to print the image. If so (Y), the control unit3proceeds to step S14. If it receives an instruction not to print (N), the control unit3returns to step S4.

In step S14, the control unit3stores the composite image created by the image processing unit4in the image storage unit5.

In step S15, the control unit3instructs the printer unit7to print the image stored in the image storage unit5and ends the routine. The resulting photograph thus printed is, for example, as shown inFIG. 7.

Second Embodiment

The second embodiment is different from the first embodiment in that that the position and the size of the template are adjusted automatically instead of manually by the user as in the first embodiment.

FIG. 8is a block diagram of the internal components of a second embodiment. The control unit50of the second embodiment is similar to the control unit3of the first embodiment, except that the control unit50further includes a face image extracting unit51, an automatic template arranging unit52. Furthermore, an automatic template adjusting unit53is included in the automatic template arranging unit52. Still furthermore, the template storage unit64of the second embodiment is similar to the template storage unit14of the first embodiment, except that a face template storage unit54is included inside the template storage unit64. The automatic adjustment of the position and the size of the template is performed using the face image extracting unit51, the automatic template arranging unit52, the automatic template adjusting unit53, and the face template storage unit54.

The face template storage unit54stores a face template therein. The face image extracting unit51is configured to acquire the face image template from the face template storage unit54and extract a face image from the original an image inputted through the image input unit1, and determine the position of the face image.

FIG. 9is a partial flowchart of a routine for arranging the image template in accordance with the second embodiment. This partial routine replace steps S4to S10of the main routine of the first embodiment.

The partial flow chart shown inFIG. 9is started when the identification photograph creating mode is selected in step S3shown inFIG. 3, when the user chooses not to display a preview of the identification photograph in step S11shown inFIG. 4, or when the user chooses not to print the identification photograph in step S13.

In step S101of the routine, the control unit50determines if it has returned from step S11or S13shown inFIG. 4, in other words whether this is the first time the routine ofFIG. 9is performed on this original image data. If the control unit50has returned from step S11or S13(Y), the control unit50skips steps S102to S105and proceeds to step S106. The first time the routine is executed, the result of step S101is N and the control unit50proceeds to step S102.

In step S102, the face image extracting unit51obtains eyes, nose, and mouth pattern data from the face template storage unit54. The pattern data includes data regarding the relative positioning of the eyes, nose, and mouth.

In step S103, the face image extracting unit51identifies a position in the original image received from the image input unit1where the pattern of an eye, nose, or mouth can be found. When such position is identified, the face image extracting unit51stores such position. If a plurality of such positions is found, the face image extracting unit51recognizes those positions as a face image. While various face image recognition technologies are well known in the art, any of such face image recognition technologies can be utilized in the photoprinter of the present embodiment. Examples of such face recognition technologies are disclosed in U.S. Pat. Nos. 5,309,228, 5,629,752, and 6,549,899, and U.S. Patent Applications Ser. Nos. 2001/0005222, 2002/0191818, and 2004/0119851, which are incorporated herein by reference. Since these face image recognition technologies are well known in the art detailed explanation thereof will be omitted herein.

In step S104, the automatic template arranging unit52positions a template in one of the face positions extracted by the face image extracting unit51. Although the template storage unit64stores a plurality of templates therein, at this point, one default template is displayed with the outer rectangular guide12and the inner curved guide13each having a default size.

In step S105, the automatic template adjusting unit53adjusts the size of the template based on the extracted face image. Since the approximate size of the face image can be derived from the eye, nose, and mouth pattern, the size of the inner circular guide13of the template can be determined based on the size of the face image. While various face size matching technologies are well known in the art, any of such face size matching technologies, such as the face recognition technologies discussed above, can be utilized in the photoprinter of the present embodiment. Since these face size matching technologies are well known in the art detailed explanation thereof will be omitted herein.

In step S106, the control unit50determines if a change of the template is requested. If so (Y), the control unit50proceeds to step S107. If not (N), the control unit50skips steps S107and S108and proceeds to step S109. The photoprinter10is configured such that the user can select a template using the cursor keys8of the manual operation unit6when the photoprinter10is in the identification photograph creating mode.

In step S107, the control unit50changes the template and displays it on the display device2.

In step S108, the template size is adjusted in the same manner as in step S105, such that the inner curved guide13of the template approximately matches the face image extracted in step S103.

In step S109, the control unit50determines if a change in the position of the template is requested. The user may wish to change the position of the template where, for example, the face image extracting unit51recognized two or more faces in step S103. In this manner, a single face image can be selected when a photograph having images of two or more people is used as the original image. More specifically, if two or more face position data are obtained (i.e., if two or more face images are recognized) in step S103, then the cursor keys8can be used in a manner different from the selection of the template in step S106to selected a desired face from among the plurality of face images in the original data. If a change in the position of the template is requested (Y), the control unit50changes the position of the template in step S107. Otherwise (N), the control unit50skips steps S110and S111and proceeds to step S11shown inFIG. 4.

In step S110, the control unit50changes the position of the template based on the face position data where that has been changed in step S109.

In step S111, the template size is adjusted in the same manner as in step S105, such that the inner curved guide13of the template approximately matches the face image extracted in step S103.

After step S111, the control unit50proceeds to step S11. As clearly seen inFIG. 4, the routine shown inFIG. 9is repeated when the user chooses when the user chooses not to display a preview of the identification photograph in step S11shown inFIG. 4, or when the user chooses not to print the identification photograph in step S13.

As used herein, the following directional terms “forward, rearward, above, downward, vertical, horizontal, below and transverse” as well as any other similar directional terms refer to those directions of a device equipped with the present invention. Accordingly, these terms, as utilized to describe the present invention should be interpreted relative to a device equipped with the present invention.