System and method for customizing figurines with a subject's face

A system and method of making an at least partially customized figure emulating a subject is disclosed which involves obtaining at least two two-dimensional images of the face of the subject from different perspectives; and processing the images of the face with a computer processor to create a three dimensional model of the subject's face; scaling the three dimensional model and applying the three dimensional model to a predetermined template adapted to interfit with the head of a figure preform that comprises at least a head. The template is printed and installed on the head portion of the figure preform.

FIELD

The present disclosure relates to a system and method for customizing figurines with a subject's face.

BACKGROUND

Three dimensional scanners can be used to create a three dimensional model of a person or object, and various manufacturing technologies such as numerically controlled machining, stereolithography, or three dimensional printing can be used to print the object, However, it can be time consuming and expensive to manufacture an entire object in this fashion. Moreover the choice of materials is usually limited, and the object typically must be made of a single material.

SUMMARY

Embodiments of the present invention provides a system and method for making an at least partially customized figure emulating a subject, using the subject's specific facial geometry. According to one preferred embodiment, a method of making an at least partially customized figure emulating a subject comprises obtaining at least two two-dimensional images of the face of the subject from different perspectives, and processing the at least two two-dimensional images of the face of the subject with a computer processor to create a three dimensional model of the subject's face. The three dimensional model of the subject's face is scaled to a predetermined size using a computer processor, and applied to a predetermined template having a predetermined perimeter adapted to interfit with the head of a figure preform that comprises at least a head. The template with the three dimensional model of the subject's face is printed on a three dimensional four color printer; and installed on the head portion of the figure preform.

According to another preferred embodiment, a system for making an at least partially customized figure emulating a subject comprises an imaging system for obtaining at least two two-dimensional images of the face of the subject from different perspectives, and a computer processor programmed for processing the at least two two-dimensional images of the face of the subject to create a three dimensional model of the subject's face. The same or a different processor can also scale the three dimensional model of the subject's face to a predetermined size using a computer processor, and apply the model to a predetermined template having a predetermined perimeter adapted to interfit with the head of a figure preform that comprises at least a head. The system further comprises a three dimensional color printer for printing the template with the three dimensional model of the subject's face.

Embodiments of this invention also provide a method of at least partially customizing a standard figure having at least a head, with the face of a subject. According to one preferred embodiment, a method of customizing a standard figure with the face of a subject comprises obtaining at least two two-dimensional images of the face of the subject from different perspectives, and processing the at least two two-dimensional images of the face of the subject with a computer processor to create a three dimensional model of the subject's face. The three dimensional model of the subject's face is scaled to a predetermined size using a computer processor, and applied to a predetermined template having a predetermined perimeter adapted to be mounted on the head of the standard figure. The template with the three dimensional model of the subject's face is printed on a three dimensional four color printer; and installed over the face of the standard figure.

According to another preferred embodiment, a system for at least partially customizing a standard figure with the face of a subject comprises an imaging system for obtaining at least two two-dimensional images of the face of the subject from different perspectives, and a computer processor programmed for processing the at least two two-dimensional images of the face of the subject to create a three dimensional model of the subject's face. The same or a different processor can also scale the three dimensional model of the subject's face to a predetermined size using a computer processor, and apply the model to a predetermined template having a predetermined perimeter adapted to be mounted on the head of a selected figure. The system further comprises a three dimensional color printer for printing a mask based upon the template with the three dimensional model of the subject's face.

DETAILED DESCRIPTION

A preferred embodiment of a method of making an at least partially customized figure emulating a subject according to the principles of this invention is indicated schematically inFIG. 1. As shown inFIG. 1this method can comprise at step22obtaining at least two two-dimensional images of the face of the subject from different perspectives. At step24at least two two-dimensional images of the face of the subject are processed with a computer processor to create a three dimensional model of the subject's face. At step26the three dimensional model of the subject's face is scaled to a predetermined size using a computer processor. At step28the three dimensional model of the subject's face is applied to a predetermined template having a predetermined perimeter adapted to interfit with the head of a figure preform that comprises at least a head. At step30the template with the three dimensional model of the subject's face is printed on a three dimensional color printer. At step32the printed template is installed on the head portion of the figure preform.

The step of obtaining at least two two-dimensional images of the face of the subject from different perspectives can be done with one or more cameras. These cameras are preferably digital cameras. A single camera could be used, and either the subject or the camera repositioned to obtain images from different perspectives. Preferably, multiple cameras are used to simultaneously capture images of the subject from multiple perspectives and so that the relationship between the perspectives is known. Suitable multiple camera image capturing systems include those available from Digiteyezer, 12 Rue Vivienne, Paris 75002 France (http://www.digiteyezer.com) or Direct Dimensions, 10310 S. Dolfield Road, Owings Mills, Md. 21117 (http://www.shapeshot.com).

The images could also be captured by a single moving camera. This allows for near simultaneously acquisition of the images and also allows the relationship between the multiple perspectives to be known. For example a single camera could be mounted on a track to move around a semicircle to capture images of the user from at least two different perspectives. The camera could alternatively include position or inertial sensors (for example an iPhone) so that its movement can be tracked as images are captured, facilitating the use of hand held camera.

The processing of two-dimensional images of the face of a subject to create a three dimensional model of the subject's face is well known, and examples of software for this purpose include facegen, available from Singular Inversions, 2191 Yonge Street, Suite 3412, Toronto, ON. M4S 3H8, CANADA (http://www.facegen.com), or software available for Dimensional Imaging, 1 Ainslie Road, Glasgow, Scotland UK, G52 4RU (http://www.di3d.com/index.php). The scaling of the three dimensional model of the subject's face resizes the image to the appropriate size. This can be accomplished by increasing or decreasing the image to a particular size or size range. The scaling can also be based upon resizing the image to make one or more inter-anatomical distances a particular value, or to be within a particular range of values. For example, through processing particular anatomical features including the location of a portion of one or more of the hair line, eye brows, eyes, ears, nose, mouth, and chin. The model can then be scaled based upon one or more dimensions between these anatomical features. The image can be scaled uniformly, or the image can be scaled differently in different directions. For example, the image can be scaled uniformly so that a particular inter-anatomic distance, such as the distance between the inside corners of the eyes, is a particular dimension, or is within a certain dimensional range. Alternatively the model can be scaled differently in different directions. Thus, the model can be scaled horizontally based upon a first inter-anatomical dimension, and the model scaled vertically based upon a second inter-anatomical dimension. Thus the model can be scaled horizontally so that the distance between, for example, inner corners of the eyes is a particular dimension, or in a particular range of dimensions, and the model can be scaled vertically so that the distance between, for example the tops of the eyebrows and the bottom of the chin, is a particular dimension, or in a particular range of dimensions.

The scaling factor or factors are preferably determined based upon the particular template, which in turn is based upon the figure preform with which the template will be used. The figure can be doll, an action figure, a figurine or statue, etc. These images can also be used as avatars in computer and online applications such as games.

Alternatively the scaling can be accomplished by using providing a template that includes anchor points for anchoring various anatomical features, such as the eyes, eyebrows, ears, nose, and mouth. Thus these individual anatomical features can be appropriately positioned on the template for the particular application.

Instead of, or in addition to, scaling, the size and the positions of the individual anatomical features can be adjusted. For example in many dolls the eyes are disproportionately large compared to other facial features. An accurate translation of human anatomy to such a doll may not be aesthetically pleasing. In many dolls the locations of the individual anatomical features are likewise stylistically positioned, such that an accurate translation of human anatomy to such a doll would not be aesthetically pleasing.

Individual anatomical features can be resized relative to the other anatomical features. For example, the size of the eyes can automatically be increased or decreased by a particular amount, or by a particular ratio. Alternatively the size can be increased or decreased to a particular size or to be within a particular size range. In other embodiments two different anatomical features are differentially resized. For example, for a particular application, it might be desired to increase the size of the eyes by 25% and to increase the size of the mouth by 15%, in another application it might be desired to increase the size of the eyes by 20% and reduce the size of the mouth by 10% such that features are features relative to various.

Individual anatomical features can be repositioned relative to the other anatomical features. For example, the positions of the eyes can automatically be increased to increase their spacing, or decreased to decrease their spacing. This increase or decrease can be by a particular amount, or by a particular ratio. Alternatively the positioned can be moved to a particular position. Some or all of the anatomical features can be repositioned, and this positioning can involve movement in the same or in different directions.

In some embodiments both the size of the features and their positions can be changed relative to other features. Alternatively the resizing and repositioning can be accomplished by providing a template that includes anchor points for anchoring various anatomical features, such as the eyes, eyebrows, ears, nose, and mouth. Thus these individual anatomical features can be appropriately positioned and resized on the template for the particular application.

In accordance with some embodiments, the user can manipulate the model before three dimensional printing. This can be conveniently done by a computer with conventional image manipulation tools, including blemish removal tools, blending tools, blurring and sharpening tools, coloring tools, etc., Additional options for modifications, including jewelry and tattoos can be provided. This allows the user to idealize his or her own images. In addition age regressing or age progressing software can be applied, either to the images before the generation of the model or to the model itself. This allows the user to select an appearance at a past age or at a future age.

The template can be printed on a three dimensional color printer, such as those available from Z Corporation, 333 Three D Systems Circle, Rock Hill, S.C. 29730 USA. A four color printer is preferred because of its ability to accurately render colored objects with little or no need for retouching. One or more coatings can be applied to the printed template, to improve its surface finish, for example to provide a matte or a gloss finish. The one or more coatings can also improve the “feel” of the template.

FIGS. 5 through 7show a mask402and the head404of a of a figure preform. The head404has a recess406, with a perimeter408, specifically adapted to receive the mask402. The mask402has a perimeter410that corresponds to the perimeter408of the recess406. The rear face of the mask is shaped to fit in the recess406. The particular template used to form the mask402includes the required perimeter and the required rear profile to fit with the head of the particular preform. A plurality of templates can be provided so that an appropriate template is available for each a plurality of preforms.

FIGS. 8 through 12show a mask452and the head454of a figure preform. As shown inFIGS. 10-12, the mask has a perimeter460adapted to interfit with a recess for in the head454of a figure preform. This perimeter can include a cutout adapted to receive the neck of the head454of the figure preform, As shown inFIG. 10, the rear face of the mask452is adapted to fit in the recess in the head454. The particular template used to form the mask452includes the required perimeter and the required rear profile to fit with the head of the particular preform. A plurality of templates can be provided so that an appropriate template is available for each a plurality of preforms.

FIGS. 13 through 15show a mask502and the head504of a of a figure preform. The head504has a recess506, with a perimeter508, specifically adapted to receive the mask502. The mask502has a perimeter510that corresponds to the perimeter508of the recess506. The rear face of the mask is shaped to fit in the recess506. The particular template used to form the mask502includes the required perimeter and the required rear profile to fit with the head of the particular preform. A plurality of templates can be provided so that an appropriate template is available for each a plurality of preforms.

FIGS. 16 through 20show a mask552and the head554of a of a figure preform. The head554has a recess556, with a perimeter558, specifically adapted to receive the mask552. The mask552has a perimeter510that corresponds to the perimeter558of the recess556. The rear face of the mask is shaped to fit in the recess556. The particular template used to form the mask552includes the required perimeter and the required rear profile to fit with the head of the particular preform. A plurality of templates can be provided so that an appropriate template is available for each a plurality of preforms.

FIGS. 21 through 23show a mask602and the head604of a of a figure preform. The head604has a profile specifically adapted to receive the mask602. The mask602has a perimeter that tapers to fit flush against the surface of the head604. The rear face of the mask is shaped to fit over the profile of the head604. The particular template used to form the mask602includes the required perimeter and the required rear profile to fit with the head of the particular preform. A plurality of templates can be provided so that an appropriate template is available for each a plurality of preforms.

A preferred embodiment of a system for making an at least partially customized figure emulating a subject according to the principles of this invention is indicated generally as100inFIG. 2. The system100comprises an imaging system102for obtaining at least two two-dimensional images of the face of the subject from different perspectives. The system further comprises a computer processor104programmed for processing the at least two two-dimensional images of the face of the subject to create a three dimensional model of the subject's face. The processor104can also scale the three dimensional model of the subject's face to a predetermined size and apply the model to a predetermined template having a predetermined perimeter adapted to interfit with the head of a figure preform that comprises at least a head. The system102further comprises a three dimensional color printer106for printing the template with the three dimensional model of the subject's face.

A method of at least partially customizing a standard figure having at least a head, with the face of a subject according to the principles of this invention is indicated generally as200inFIG. 3. As shown inFIG. 3this method comprises at step202obtaining at least two two-dimensional images of the face of the subject from different perspectives. At step204the at least two two-dimensional images of the face of the subject are processed with a computer processor to create a three dimensional model of the subject's face. At step208the three dimensional model of the subject's face is scaled to a predetermined size using a computer processor. At step210the model is applied to a predetermined template having a predetermined perimeter adapted to be mounted on the head of the standard figure. At212the template with the three dimensional model of the subject's face is printed on a three dimensional color printer. At214the printed template is installed over the face of the standard figure.

The step of obtaining at least two two-dimensional images of the face of the subject from different perspectives can be done with one or more cameras. These cameras are preferably digital cameras. A single camera could be used, and either the subject or the camera repositioned to obtain images from different perspectives. Preferably, multiple cameras are used to simultaneously capture images of the subject from multiple perspectives and so that the relationship between the perspectives is known. Suitable multiple camera image capturing systems include those available from Digiteyezer, 12 Rue Vivienne, Paris 75002 France (http://www.digiteyezer.com) or Direct Dimensions, 10310 S. Dolfield Road, Owings Mills, Md. 21117 (http://www.shapeshot.com). The images could also be captured by a single moving camera. This allows for near simultaneously acquisition of the images and also allows the relationship between the multiple perspectives to be known. For example a single camera could be mounted on a track to move around a semicircle to capture images of the user from at least two different perspectives. The camera could alternatively include position or inertial sensors (for example an iPhone) so that its movement can be tracked as images are captured.

The processing of two-dimensional images of the face of a subject to create a three dimensional model of the subject's face is well known, and examples of software for this purpose include facegen, available from Singular Inversions, 2191 Yonge Street, Suite 3412, Toronto, ON. M4S 3H8, CANADA (http://www.facegen.com), or software available for Dimensional Imaging, 1 Ainslie Road, Glasgow, Scotland UK, G52 4RU (http://www.di3d.com/index.php).

The scaling of the three dimensional model of the subject's face resizes the image to the appropriate size. This can be accomplished by increasing or decreasing the image to a particular size or size range. The scaling can also be based upon resizing the image to make one or more inter-anatomical distances a particular value, or to be within a particular range of values. For example, through processing particular anatomical features including the location of a portion of one or more of the hair line, eye brows, eyes, ears, nose, mouth, and chin. The model can then be scaled based upon one or more dimensions between these anatomical features. The image can be scaled uniformly, or the image can be scaled differently in different directions. For example, the image can be scaled uniformly so that a particular inter-anatomic distance, such as the distance between the inside corners of the eyes, is a particular dimension, or is within a certain dimensional range. Alternatively the model can be scaled differently in different directions. Thus, the model can be scaled horizontally based upon a first inter-anatomical dimension, and the model scaled vertically based upon a second inter-anatomical dimension. Thus the model can be scaled horizontally so that the distance between, for example, inner corners of the eyes is a particular dimension, or in a particular range of dimensions, and the model can be scaled vertically so that the distance between, for example the tops of the eyebrows and the bottom of the chin, is a particular dimension, or in a particular range of dimensions.

The scaling factor or factors are preferably determined based upon the particular template, which in turn is based upon the figure preform with which the template will be used. The figure can be doll, an action figure, a figurine or statue, etc.

Alternatively the scaling can be accomplished by using providing a template that includes anchor points for anchoring various anatomical features, such as the eyes, eyebrows, ears, nose, and mouth. Thus these individual anatomical features can be appropriately positioned on the template for the particular application.

Instead of, or in addition to, scaling, the size and the positions of the individual anatomical features can be adjusted. For example in many dolls the eyes are disproportionately large compared to other facial features. An accurate translation of human anatomy to such a doll may not be aesthetically pleasing. In many dolls the locations of the individual anatomical features are likewise stylistically positioned, such that an accurate translation of human anatomy to such a doll would not be aesthetically pleasing.

Individual anatomical features can be resized relative to the other anatomical features. For example, the size of the eyes can automatically be increased or decreased by a particular amount, or by a particular ratio. Alternatively the size can be increased or decreased to a particular size or to be within a particular size range. In other embodiments two different anatomical features are differentially resized. For example, for a particular application, it might be desired to increase the size of the eyes by 25% and to increase the size of the mouth by 15%, in another application it might be desired to increase the size of the eyes by 20% and reduce the size of the mouth by 10% such that features are features relative to various.

Individual anatomical features can be repositioned relative to the other anatomical features. For example, the positions of the eyes can automatically be increased to increase their spacing, or decreased to decrease their spacing. This increase or decrease can be by a particular amount, or by a particular ratio. Alternatively the positioned can be moved to a particular position. Some or all of the anatomical features can be repositioned, and this positioning can involve movement in the same or in different directions.

In some embodiments both the size of the features and their positions can be changed relative to other features. Alternatively the resizing and repositioning can be accomplished by providing a template that includes anchor points for anchoring various anatomical features, such as the eyes, eyebrows, ears, nose, and mouth. Thus these individual anatomical features can be appropriately positioned and resized on the template for the particular application.

In accordance with some embodiments, the user can manipulate the model before three dimensional printing. This can be conveniently done by a computer with conventional image manipulation tools, including blemish removal tools, blending tools, blurring and sharpening tools, coloring tools, etc. Additional options for modifications, including jewelry and tattoos can be provided. This allows the user to idealize his or her own images. In addition age regressing or age progressing software can be applied, either to the images before the generation of the model or to the model itself. This allows the user to select an appearance at a past age or at a future age.

The template can be printed on a three dimensional color printer, such as those available from Z Corporation, 333 Three D Systems Circle, Rock Hill, S.C. 29730 USA. A four color printer is preferred because of its ability to accurately render colored objects with little or no need for retouching. One or more coatings can be applied to the printed template, to improve its surface finish, for example to provide a matte or a gloss finish. The one or more coatings can also improve the “feel” of the template.

FIGS. 24 through 29show a mask652and the head654of a standard figure, such as a commercially available doll or action figure. The mask652has a perimeter that tapers to fit flush against the surface of the head654. The rear face of the mask652is shaped to fit over the profile of the head654. The rear face can have a concave shape to accommodate the existing facial features on the head654, or the rear face can have a negative image of the existing facial features to receive the facial features. The particular template used to form the mask652includes the required perimeter and the required rear profile to fit with the head of the particular figure. A plurality of templates can be provided so that an appropriate template is available for each a plurality of available figures.

FIG. 30shows the mask652, described above, marked with possible anatomical measures for scaling a three dimensional model with a template. Through image processing it is possible to identify particular anatomical locations and use these locations as landmarks. As shown inFIG. 30, the inside corners of the eyes can be identified on the model and anchored to corresponding points on the template for example points A and B, or the distance between the inside corners of the eyes can be scaled to the distance A B on the template. Alternatively, the outside corners of the mount can be identified on the model and anchored to corresponding points on the template, for example points C and D, or the distance between the outside corners of the mouth can be scaled to the distance CD on the template. Alternatively lines, for example the line identifying the upper edges of the eyebrows and the line identifying the edge of the chin can be identified and anchored to corresponding lines on the template, for example lines E and F, or the distance between these lines can be scaled to the distance between lines E and F on the template.

As described above, and shown inFIG. 31, a template700can be provided with a plurality of anchor points that can anchor locations, sizes, or both locations and sizes. For example template700can have anchors702and704for anchoring and sizing the eyes from the model, anchor706for anchoring the nose from the model, anchor708for anchoring and sizing the mouth, and anchors710and712for anchoring and sizing the ears form the model. The use of a template with anchors allows the features to be individually resized and repositioned, to be appropriate for the particular figure preform or the particular figure with which the face will be applied.

FIGS. 32-33,FIGS. 34-35, andFIGS. 36-37show embodiments of masks made in accordance with the principles of this invention adapted for mounting on standard, commercially available dolls, such are Barbie® and American Girl® dolls.

A preferred embodiment of a system for at least partially customizing a standard figure with the face of a subject according to the principles of this invention in indicated generally as300inFIG. 4. The system300comprises an imaging system302for obtaining at least two two-dimensional images of the face of the subject from different perspectives. The system300further comprises a computer processor304programmed for processing the at least two two-dimensional images of the face of the subject to create a three dimensional model of the subject's face. The processor304can also scale the three dimensional model of the subject's face to a predetermined size, and apply the model to a predetermined template having a predetermined perimeter adapted to be mounted on the head of a selected figure. The system further comprises a three dimensional color printer306for printing a mask based upon the template with the three dimensional model of the subject's face. This mask can be secure over a conventional doll.

Embodiments of this invention allow a user to make a customized figure, such as a doll, figurine, statue, that have a representation of the user's face, or an idealized or stylized version of the user's face. Other embodiments of this invention allow a user to customize a standard doll with a mask containing a representation of the user's face, or an idealized or stylized version of the user's face. These embodiments allow a user to include himself or herself, as well as his or her friends in their play.