# Patent

## Title
System and method to derive structure from image

## Abstract

A method and system creates a printed substrate suitable for conversion into a three-dimensional object. A template generator identifies a printing template having die line data representing a cutting path and folding position data representing a folding path. Foreground image data representative of a first image is automatically applied the selected printing template to define a target location for the first image, and also to define a second die line around a portion of the target location to form a second cutting path based on the foreground image data. A printer prints the first image onto a substrate at the target location, a cutting device cuts the substrate along the first cutting path and the second cutting path, and a scoring device scores the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object.

## Background
BACKGROUND
The disclosed embodiments relate generally to methods and systems for creating printed objects having three-dimensional structure.
Printing systems are no longer limited to devices that print text and images on two-dimensional substrates. Today, structural printing systems must be able to print text and images on a substrate, and also perform structural functions such as cutting, perforating or, and scoring for folds so that the resulting substrate can be manipulated into a three-dimensional structure. Greeting cards, pop-up books, and packages are examples of printed substrates that can move from a flat structure to a three dimensional structure through manipulation of folds, creases, cuts and perforations.
Current structural printing systems implement a set of instructions and can mass-produce similar items, but the systems have limited ability to customize print jobs with structural features. These limitations can cause delays in assembly time as the system is reprogrammed or manually manipulated to change images and/or substrates.
This document describes systems that solve one or more of the problems listed above.
SUMMARY
In an embodiment, a method of creating a printed substrate suitable for conversion into a three-dimensional object includes identifying a printing template. The template includes first die line data representing a first cutting path and folding position data representing a folding path. The embodiment also includes receiving foreground image data representative of a first image, automatically applying the first image data to the selected printing template to define a target location for the first image, defining a second die line around a portion of the target location to form a second cutting path based on the first image data, using a printing device to print the first image on the substrate at the target location, cutting the substrate along the first cutting path and the second cutting path, and scoring the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object. Any or all of the steps may be implemented via a computer program instructions on a computer-readable medium that instruct a processing device to perform the steps.
Optionally, the defining may include defining the second die line to form the second cutting path so that when the substrate is folded into the three-dimensional object, a foreground image corresponding to the first image will be presented in front of and set off from a background portion of the substrate. Also, the target location may be positioned to place the image along the folding path, and if so the defining may include defining the second die line to form the second cutting path to correspond to a boundary of the first image that is present on a first side of the folding path and not to any boundary of the first image that is present on the opposite side of the cutting path and the scoring will them not apply a crease to the first image along the folding path. The method also may include selecting a background image and printing the background image onto the background portion of the substrate.
Alternatively, defining the second die line may include automatically detecting an edge of the first image by image processing, and setting the die line to correspond to a portion of the detected edge.
Optionally, the target location may be positioned to place the image along the folding path; the defining may include receiving a user input that selects the second die line, and the scoring does not apply a crease to the image along the folding path.
Optionally, the method may include, before the printing presenting, via a visual display, a preview of the identified printing template and foreground image data to be printed. It also may include receiving an adjusted target location, presenting via the visual display a revised preview based on the adjusted target location wherein the foreground image data has been moved to the adjusted target location, and receiving a user acceptance of the adjusted target location. Defining of the second die line may then be based on the adjusted target location.
Optionally, after identifying the printing template, the method also may include displaying the printing template to a user, and displaying a candidate image to the user. If so, receiving the foreground image data may include receiving a selection of the candidate image from the user via dragging and dropping the candidate image onto the template.
Optionally, the method may include selecting a background image and printing the background image onto the substrate so the background image so that the background image does not overlap the first image.
In an alternate embodiment, a system for creating a printed substrate suitable for conversion into a three-dimensional object includes a template generator containing program instructions to identify a printing template having first die line data representing a first cutting path and folding position data representing a folding path. The instructions also are to receive foreground image data representative of a first image, automatically apply the foreground image data to the selected printing template to define a target location for the first image, and define a second die line around a portion of the target location to form a second cutting path based on the foreground image data. The system also includes a printer configured to print the first image onto a substrate at the target location; a cutting device configured to cut the substrate along the first cutting path and the second cutting path, and a scoring device configured to score the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object.
Optionally, the system also includes a display device configured to display a preview of the identified printing template and foreground image data to be printed, and a user input configured to receive an adjusted target location. The display is also configured to display a revised preview based on the adjusted target location wherein the foreground image data has been moved to the adjusted target location.
Optionally, the system also includes a display device configured to display a preview of the identified printing template and foreground image data to be printed, and a user input configured to receive a candidate image selection. The display device is also configured to display a revised preview based on the candidate image selection.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates an exemplary printed flat substrate that can be cut and folded to exhibit three-dimensional features.
FIG. 2 illustrates the substrate of FIG. 1 after is has been printed and folded.
FIG. 3 depicts exemplary elements of a system for creating a three-dimensional, printed substrate.
FIG. 4 is a flowchart showing steps that may be following in a method of creating a three-dimensional printed substrate.



DETAILED DESCRIPTION
Before the present embodiments are described, it is to be understood that this invention is not limited to the particular systems, methodologies or protocols described, as these may vary. Also, the terminology used herein is for the purpose of describing particular embodiments and is not intended to limit the scope of the present disclosure, which will be limited only by the appended claims.
As used in this description and in the appended claims, the singular forms “a,” “an,” and “the” include the plural reference unless the context clearly dictates otherwise. Unless defined otherwise, all technical and scientific terms used herein have the same meanings as commonly understood by one of ordinary skill in the art. As used herein, the term “comprising” means “including, but not limited to.”
As used in this document, a “computing device” is a device including a processor and memory for executing computer-readable instructions and processing data. An “image” is a set of graphics, text, numbers, designs, colors, or other indicia that may be printed onto a substrate. A “printing device” is an electronic device that is capable of receiving commands and printing text and/or images on a substrate. Printing devices may include, but are not limited to, network printers, production printers, copiers and other devices that apply text and images to a substrate using ink or toner. Printing devices may also perform a combination of functions such as printing and scanning, in which case such devices may be considered to be multifunctional devices. Printing devices may create two-dimensional documents or three-dimensional items such as packages.
Referring to FIG. 1, a three-dimensional printed object 100 includes various images printed on a substrate 105, such as cardstock, paper, cardboard, or other printable material. FIG. 1 shows a card 100 in the form of a printed flat, and the card 100 may form a three-dimensional object when folded across various fold lines. The card 100 includes a foreground image 110 and optionally one or more background images 115. The border of the object is defined by an exterior cutting path 120 (shown as a solid line in FIG. 1). The card also includes one or more interior cutting paths 130 (shown as dashed lines with cross-hatching) that allow a rear portion 135 of the card to be moved away from the foreground image, creating a three-dimensional feature. The card also may include creases 140 that serve as guides for filing the card to create additional three-dimensional features. In this manner, when cut and folded, the card 100 may exhibit three-dimensional features as shown in FIG. 2.
Referring to FIG. 3, the card or another three-dimensional object may be created using a printing template generator 300, a printing device 310, a cutting device 320 and a scoring device 330. The template generator 300 may be a computing device or any other device containing a processor and computer-readable memory that receives and implements program instructions to generate a printing template. The template may be obtained from a template database 305, or it may be generated anew based on user or data input. The template includes die line data that representing the positions and sizes of one or more cutting paths for a substrate (see lines 130 in FIG. 1). The template also includes folding position data one or more positions on the substrate along which a crease, line or other indicator should be applied to create a folding path (see lines 140 in FIG. 1). The template receives foreground image data representative of a foreground image (110 in FIG. 1), automatically applies the foreground image data to the printing template to define a target location for the first image. The template generator 300 also defines a second die line (132 in FIG. 1) around a portion of the target location to form a second cutting path.
The system includes a printing device 310. The printer 310 receives information from the template generator and prints the first image onto a substrate at the target location, along with any other content and/or background images. The system also includes a cutting device 320 that receives the die line data from the template generator 300 and cuts the substrate along the defined cutting paths. The system also includes a scoring device 300 that applies creases, folds, lines, or other indicators along the folding paths based on folding line data received from the template generator.
The system also may include a display device 340 that displays a preview of the selected printing template and foreground image data to be printed. The system also may include a user input 350, such as a keyboard, data input, touch screen, communications port, or other input mechanism that receives information such as selections of displayed items and/or uploaded image data.
FIG. 4 is a flowchart illustrating exemplary steps in a method of generating a three-dimensional document. Referring to FIG. 4, the method may include selecting a printing template (step 401). The printing template is a data file that defines certain features of a printed substrate, such as boundary definitions, size, shape, and other features. The printing template includes data identifying the location of one or more die lines, and each die line can be used by a cutting device to cut boundary lines, and other cuts into the document along cutting paths (see lines 120 and 130 in FIG. 1). The printing template also includes data identifying the location of one or more folding paths, and each folding path can be used by a scoring device to embed one or more creases, folds, lines marking where a human should fold a document, or other indicia along folding paths (see line 140 in FIG. 1). The printing template may be selected by a user from a menu of available templates, it may be automatically selected from a template database by a computing device based on one or more variables, or it may be uploaded by a user or received from an external source.
The method may then receive foreground image data (step 403) representative of a first image (see image 110 in FIG. 1) to be printed on the substrate. The foreground image may be an image uploaded by a user, or selected by a user from a menu of available images, or it may be automatically uploaded into the template based on variables or criteria available to the processor. The foreground image data is automatically applied to the selected printing template to define a target location for the first image (step 407). Optionally, the system also may receive background image data (step 405), whether by user selection, user upload, selection based on criteria, or simply because the background image data is part of the printing template. The background image data is also made part of the printing template. The method also includes defining a die line around a portion of the foreground image at the target location to form a cutting path (line 132 in FIG. 1) based on the foreground image data (step 409).
A printing device then uses the printing template to print (step 411) onto a substrate (step 411) the first image at the target location, and optionally the background image and any other content that is to be printed onto the substrate. A cutting device cuts the substrate along each cutting path (step 413), and a scoring device establishes creases, folds or folding lines along each folding path (step 415). The resulting printed, cut, and scored substrate can then be folded into a three-dimensional object.
When folded into a three-dimensional object, the foreground image will be presented in front of and set off from a background portion of the substrate, as shown in FIG. 2.
If the target location is positioned to place the image along a folding path, as shown in FIG. 1 the die lines may be defined so that the cutting path 132 around the foreground image corresponds to a boundary of the image that is present above, i.e., on a first side, of the folding path and not to any boundary of the image that is present on the opposite side of the cutting. Similarly, in this situation the scoring may not apply a crease along the foreground image. Alternatively, the die lines may be defined so that the foreground image is not positioned along a fold, but rather is positioned to fold out from or lift up from the background. The cutting path around the foreground image may be identified based on predetermined criteria, based on image processing techniques such as edge detection, or other criteria. Thus, the image serves to pop up from the substrate when it is folded into a three dimensional object.
Referring again to FIG. 4, optionally before the printing, the method may include presenting (step 417), via a visual display, a preview of the selected printing template and foreground image data to be printed. A user may then adjust (step 419) various features of the printing template, such as the target location or an alternate foreground image. The user may be permitted to drag and drop additional foreground images or other content onto the template. The adjusted template may again be displayed (step 417) until the user accepts the printing template. The adjusted template may include a revised preview based on the adjusted target location so that the foreground image data has been moved to the adjusted target location, or a new image is presented along with a new cutting path around the foreground image. The foreground image may be displayed so that it is never overwritten by a portion of the background image, i.e., the background image does not overlap the foreground image.
In some embodiments, computer-readable code may contain instructions that instruct a processor to cause any or all of the steps described above to be performed. The processor may be in communication with the printing device, cutting device, and/or scoring device, or the software may be installed on a computer-readable medium such as in a memory, or as firmware in any of the devices.
It will be appreciated that various of the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims.

## Claims

1. A method of creating a printed substrate suitable for conversion into a three-dimensional object, comprising:
generating, by a template generator, a printing template, the template comprising first die line data representing a first cutting path and folding position data representing a folding path;
receiving foreground image data representative of a first image;
automatically applying the first image data to the selected printing template to define a target location for the first image;
by the template generator, defining a second die line around a portion of the target location to form a second cutting path based on the first image data;
receiving from the template generator, by a system comprising a printing device, a cutting device and a scoring device, information comprising the target location, the first die line data, the folding position data, and data defining the second die line;
printing onto a substrate, by the printing device, the first image at the target location; and
cutting, by the cutting device, the substrate along the first cutting path and the second cutting path; and
scoring, by the scoring device, the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object.

2. The method of claim 1, wherein the defining comprises defining the second die line to form the second cutting path so that when the substrate is folded into the three-dimensional object, a foreground image corresponding to the first image will be presented in front of and set off from a background portion of the substrate.

3. The method of claim 1, wherein:
the target location is positioned to place the image along the folding path;
the defining comprises defining the second die line to form the second cutting path to correspond to a boundary of the first image that is present on a first side of the folding path and not to any boundary of the first image that is present on the opposite side of the cutting path; and
the scoring does not apply a crease to the first image along the folding path.

4. The method of claim 1, wherein:
the target location is positioned to place the image along the folding path;
the defining comprises receiving a user input that selects the second die line; and
the scoring does not apply a crease to the image along the folding path.

5. The method of claim 1, further comprising, before the printing:
presenting, via a visual display, a preview of the identified printing template and foreground image data to be printed;
receiving an adjusted target location;
presenting, via the visual display, a revised preview based on the adjusted target location wherein the foreground image data has been moved to the adjusted target location; and
receiving a user acceptance of the adjusted target location;
wherein the defining of the second die line is based on the adjusted target location.

6. The method of claim 1, wherein, after identifying the printing template, the method also comprises:
displaying the printing template to a user; and
displaying a candidate image to the user;
wherein the receiving of the foreground image data comprises receiving a selection of the candidate image from the user via dragging and dropping the candidate image onto the template.

7. The method of claim 1, further comprising:
selecting a background image; and
printing the background image onto the substrate so the background image so that the background image does not overlap the first image.

8. The method of claim 2, further comprising:
selecting a background image; and
printing the background image onto the background portion of the substrate.

9. The method of claim 1, wherein defining the second die line comprises automatically detecting an edge of the first image by image processing, and setting the die line to correspond to a portion of the detected edge.

10. A system for creating a printed substrate suitable for conversion into a three-dimensional object, comprising:
a template generator containing program instructions to:
identify a printing template, the template comprising first die line data representing a first cutting path, and folding position data representing a folding path;
receive foreground image data representative of a first image;
automatically apply the foreground image data to the selected printing template to define a target location for the first image; and
define a second die line around a portion of the target location to form a second cutting path based on the foreground image data;

a printer configured to print the first image onto a substrate at the target location;
a cutting device configured to cut the substrate along the first cutting path and the second cutting path; and
a scoring device configured to score the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object.

11. The system of claim 10, further comprising:
a display device configured to display a preview of the identified printing template and foreground image data to be printed; and
a user input configured to receive an adjusted target location;
wherein the display is also configured to display a revised preview based on the adjusted target location wherein the foreground image data has been moved to the adjusted target location.

12. The system of claim 10, further comprising:
a display device configured to display a preview of the identified printing template and foreground image data to be printed; and
a user input configured to receive a candidate image selection;
wherein the display device is also configured to display a revised preview based on the candidate image selection.

13. A non-transitory computer readable medium containing computer program instructions that cause a processor to:
identify a printing template, the template comprising first die line data representing a first cutting path and folding position data representing a folding path;
receive foreground image data representative of a first image;
automatically apply the first image data to the selected printing template to define a target location for the first image;
define a second die line around a portion of the target location to form a second cutting path based on the first image data;
print onto a substrate, by a printing device, the first image at the target location;
cut the substrate along the first cutting path and the second cutting path; and
score the substrate along the folding path to generate a printed substrate that will fold into a three-dimensional object.

14. The non-transitory computer-readable medium of claim 13, wherein the instructions that cause the processor to define the second die line further comprise instructions to form the second cutting path so that when the substrate is folded into the three-dimensional object, a foreground image corresponding to the first image will be presented in front of and set off from a background portion of the substrate.

15. The non-transitory computer-readable medium of claim 13, wherein:
the instructions that cause the processor to define the second die line comprise defining the second die line to form the second cutting path to correspond to a boundary of the first image that is present on a first side of the folding path and not to any boundary of the first image that is present on the opposite side of the cutting path; and
the instructions that cause the processor to score the substrate ensure that the processor does not apply a crease to the first image along the folding path.

16. The non-transitory computer-readable medium of claim 13, wherein the instructions also cause the processor to, before the printing:
present, via a visual display, a preview of the identified printing template and foreground image data to be printed;
receive an adjusted target location;
present, via the visual display, a revised preview based on the adjusted target location wherein the foreground image data has been moved to the adjusted target location; and
receive a user acceptance of the adjusted target location;
wherein the defining of the second die line is based on the adjusted target location.

17. The non-transitory computer-readable medium of claim 13, wherein the instructions cause the processor, after identifying the printing template, to:
display the printing template to a user; and
display a candidate image to the user;
wherein the receiving of the foreground image data comprises receiving a selection of the candidate image from the user via dragging and dropping the candidate image onto the template.

18. The non-transitory computer-readable medium of claim 13, wherein the instructions also cause the processor to:
select a background image; and
print the background image onto the substrate so the background image so that the background image does not overlap the first image.

19. The non-transitory computer-readable medium of claim 14, wherein the instructions also cause the processor to:
select a background image; and
print the background image onto the background portion of the substrate.

20. The non-transitory computer-readable medium of claim 13, wherein the instructions that cause the processor to define the second die line further comprise instructions to:
automatically detect an edge of the first image by image processing, and
set the die line to correspond to a portion of the detected edge.