Composite picture editing device

Abstract: Disclosed is a composite picture processing device for processing a composite picture consisting of a plurality of picture components. In the composite picture processing device, when a plurality of candidate patterns of one of the picture components is displayed, currently selected patterns for the other picture components is combined to each of the candidate patterns. Further, a mouse is provided to select one of the candidate patterns displayed.

Description: The present invention relates to a composite picture editing device for composing a plurality of components on a display. Conventionally, composite picture editing devices are known. In such a device, a display such as a CRT (Cathode Ray Tube) display is provided, and on the display, a plurality of picture components such as a nose component, a mouth component, a hair component, an outline of a face component, or the like are composed to form a complete composite picture. In this case, for each component, a plurality of candidates patterns are prepared, and an operator of the device is required to scroll a displayed image of the candidate patterns to find a desired pattern to be used. In the conventional composite picture editing devices, generally, only one candidate pattern is displayed on a screen of the display at a time, and in order to determine the desired candidate, the operator has to scroll the screen repeatedly. Thus, selection of a candidate pattern takes time, and it is very troublesome to use such a device. To ease the operation, there is suggested a device which displays a plurality of candidate patterns on a screen at a time, and allows the operator to select one of the displayed candidates from among the patterns simultaneously displayed. In such a device, the operator can find the desired candidate quickly. However, there still remains a problem. Although the operator can select a desired candidate from among the displayed plurality of candidate patterns, the candidate patterns displayed simultaneously are of the same component, i.e., different images related to the same component, and the operator cannot view the resultant image until all the components are selected and a composite picture is composed. In such a device, the operator is sometimes required to perform the similar operations until the desired image is obtained. US 5,375,195 discloses the generation of a plurality of pictures of a person. Each picture is specified by a bit string. A plurality of e.g. 30 pictures are presented to a user. The user estimates a similarity to a person which he/she has seen as a witness. The picture presenting the closest similarity is used to form further pictures to be presented to the user. EP 0 609 559 A2 discloses an object image display device. Images of a person are displayed. These images may be distorted to see the result of e.g. gaining weight. Summary of the invention It is therefore an object of the invention to provide an improved composite picture editing device in which a desired candidate for each component can be selected easily, with a simple operation. This object is solved by a composite picture editing device for processing composite pictures as said forth in claim 1. With such a device the operator can easily select a pattern since each candidate pattern is combined with the other components. Preferred developments of the invention are given in the corresponding depending claims. In particular, according to claim 6, when a candidate pattern for a certain component is selected, if the null image pattern is selected for each of the other components, only the candidate patterns are displayed as in any conventional device. Furthermore, according to the invention a method is provided as is defined in claim 9. Preferred developments of the method are given in the corresponding dependent claims. Description of the Accompanying Drawings Fig. 1 is a schematic front view of a composite picture editing device embodying the present invention; Fig. 2 is a block diagram of a control system of the composite picture editing device shown in Fig. 1; Fig. 3 is a screen image of a picture edit window; Fig. 4 is a screen image of a window in which a plurality of candidate patterns; Fig. 5 is a screen image of a window in which a plurality of candidate patterns combined with a null pattern for the face component; Fig. 6 is a screen image of the composite image editing window; Fig. 7 is a screen image of the candidate patterns for a body component; and Fig. 8 is a flowchart illustrating a candidate pattern displaying process. Description of the Embodiment Fig. 1 is a schematic front view of a composite picture editing device 100 embodying the present invention. The composite picture editing device 100 includes a main body 1, a keyboard 2 which is connected to the main body 1 via an interface I/F, a mouse 3, a display 4. A printer 5 is also connected to the main body 1 via the interface I/F. Fig. 2 is a block diagram illustrating a control system of the composite picture editing device 100 shown in Fig. 1. The main body 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an HDD (Hard Disk Drive) 14, and the like. The CPU 11 controls the entire operation of the composite picture editing device 100 by executing various programs stored in the ROM 12. In the embodiment, an image of a face (or an upper part of the body, or the like) is divided into a plurality of picture components, each picture component having a plurality of candidate patterns. One of the candidate patterns for each component is selected by an operator. The selected picture patterns for respective components are combined to form the composite image. The candidate patterns are stored in the ROM 12 as a pattern data. The RAM 13 includes a bit map area 13A for storing the candidate patterns for each component for display as a bit map data, and a work area 13B for temporarily storing data currently processed. The composite picture created by the composite picture editing device 100 can be stored as a data file in the HDD 14. Alternatively, by a cut-and-paste operation, which is well known in a field of image data processing, the created picture can be incorporated in a document data as an object, or can be printed out by the printer 5. Various control commands can be input through the keyboard 2 when the composite picture is created. Further, with use of the mouse 3, selection of one of the candidate patterns displayed on the display 4, or selection of a menu can be done. By moving the mouse 3 on a desk, moving amount and direction are input to the CPU 11 through the interface I/F. By pressing a mouse button 3B provided on the mouse 3, a predetermined signal is input to the CPU 11 through the interface I/F. The CPU 11 displays an image corresponding to the program being executed, and further a mouse pointer (not shown) on the display 4. The displayed position of the mouse pointer on the display 4 changes as the mouse 3 is moved on the desk. In the description hereinafter, an operation such that positioning the mouse pointer on a dot or an area on the display 4 and pushing the mouse button 3B and releasing the mouse button 3B immediately is defined as a click operation. For example, when the description says that "a button is clicked", it means that the mouse pointer is positioned on "a button" displayed on the display 4, and then the mouse button 3B is pushed and released immediately. When the CPU 11 starts an composite picture editing program, an image editing window 40 as shown in Fig. 3 is displayed on the screen 4S of the display 4. The displayed position of the screen 4S can be changed on the screen 4S. In order to change the position of the image editing window 40, the mouse pointer is positioned on a title bar 401 of the image editing window 40, and move the mouse 3 with holding the mouse button depressed. The image editing window 40 includes a category display area 410 and a composite image display area 420. The category display area 410 indicates a category, or a type of the composite picture to be edited. In the embodiment, ten different categories are provided, and for respective categories, small pictures representing the categories (for example, 412 - 416) are displayed in the category display area 410. In the drawing, the category 412 represents a face of a child, the category 413 represents a face of an adult, the category 414 represents a face of personified animals or vegetables, the category 415 represents a face in profile, and the category 416 represents a combination of a face and an upper body. In Fig. 3, five categories as described above are shown in the category display area 410. When a scroll button 418 or 419 provided at the ends of a scroll bar 417 is clicked, pictures indicative of the categories are scrolled in a direction indicated by an arrow formed on the scroll button 417 or 418, and the other pictures representing the other categories appear. By clicking one of the displayed pictures in the category display area 410, the operator can select a category represented by the clicked picture. Fig. 3 shows a situation in which the picture of a child has been clicked and the category 412 (a child face) is selected. As shown in Fig. 3, a displayed condition of the picture corresponding to the selected category is different from the displayed condition of the other pictures. Further to the above, the name of the selected category is indicated above the picture display by letter indication 411. When a category is selected, all the pattern data related to the selected category are read out of the ROM 12 and converted into the bit map data, which is stored in the bit map data area 13A of the RAM 13. Note that all the pattern data related to the selected category includes data of all the picture components to be used for the composite picture of the selected category, each picture component including a plurality of candidate patterns. The operator is then allowed to select one of a plurality of patterns for each component of the composite picture according to the selected category. The resultant image, i.e., the composite picture is displayed in a composite picture display window 421 of a composite picture display are 420. Specifically, when a category is selected by selecting a picture displayed in the category display area 410, a default picture for the selected category is firstly displayed in the composite picture display window 421. On the right-hand side of the composite picture display window 421 in Fig. 3, scroll bars 424 and 429 for respectively changing pictures of the patterns for respective components which form the composite picture are displayed. In the embodiment, when a child face (category 412) or an adult face (category 413) is selected as a composite picture to be composed, a hair style (including an outline of a face) and a look of the face can be changed as components. On the upper side of the scroll bar 424 in the drawing, a name of one of the components "Hair" is indicated, and on the upper side of the scroll bar 429, another name of the component "Face" is indicated. In order to change the hair component from the currently selected one to another, the operator may click a scroll button 425 or 426, or drag a scroll box 424B along the scroll bar 424. Note "to drag the scroll box 424B" is to position the mouse pointer on the scroll box 424B, press the mouse button 3B, and move the mouse with holding the mouse button 3B depressed. As the patterns for the component are changed, the changed result is immediately reflected on the picture shown in the composite picture display window 421. That is, for example, as the pattern of the hair component is changed with use of the scroll bar 424, the pattern of the hair component displayed on the window 421 changes one by one. While the pattern for the hair component is changing, the pattern of the face remains as is. The operator can stop scrolling when a desired pattern is displayed on the composite picture display window 421. On the upper right-hand side of the scroll bar 424, a number 423 (the value of which is "23") indicating the currently selected pattern for the hair component is displayed, as shown in Fig. 3. In this example shown in Fig. 3, the number of the selected pattern for the hair component is "23". Similarly, on the upper right-hand side of the scroll bar 429, the number 428 (value of which is "92") indicating the currently selected pattern for the face component is displayed. In this example shown in Fig. 3, the number of the selected pattern for the face component is "92". These numbers "23" and "92" change as the patterns for the components are changed. Similarly to the hair component, the pattern for the face component can be changed by clicking the scroll buttons 430, 431 and/or by dragging a scroll box 430B of the scroll bar 427. When the pattern of the face component is changed, the pattern of the face in the composite picture shown in the composite picture display window 21 changes, and the pattern of the hair component remains as is. When the operator stops changing the pattern of the face component, the pattern currently displayed in the composite picture display window 21 is selected. In the foregoing description, selection of the patterns for the components with use of the scroll bars, and composite picture display window 421 in which the composite picture is displayed, is described. Next, a collective display of a plurality of candidate patterns (i.e., a simultaneous display of the plurality of candidate patterns) will be described. As shown in Fig. 3, on the right-hand side of the scroll bars 424 and 429, first and second library display buttons 432 and 433 are displayed. The first and second library display buttons 432 and 433 are for displaying windows showing a plurality of patterns. When the first library display button 432 is clicked, a library display window 50 shown in Fig. 4 is displayed. In the library display window 50, a plurality of patterns for the hair component are shown at the same time with being combined with the currently selected pattern for the face component. If only the patterns for the corresponding component are displayed, and patterns for the other components are not combined in the library display window, it may be difficult for the operator to imagine the resultant composite picture, and it would be difficult to select the appropriate pattern from the library display window. In this embodiment, on the contrary, since the patterns for the other components are combined with the candidate patterns displayed in the library display window 50, the operator can determine the pattern to be selected easily. Selection of a pattern from among the displayed candidate patterns 500 is done only by clicking on the pattern to be selected. The selected pattern 501 is displayed highlighted as shown in Fig. 4. In case the library display window 50 displays only a part of the candidate patterns, a scroll bar 51 associated with the scroll buttons 52 and 53, and a scroll box 54 is displayed. By clicking the scroll buttons 52 and 53, and/or dragging the scroll box 54, the hidden candidate patterns appear in the library display window 50. After a pattern for the hair component is selected in the library display window 50 as described above, and an OK button 502 is clicked, the library display window 50 disappears and the selected pattern is applied to the composite picture that is shown in the composite picture display window 421 of the composite picture editing window 40 shown in Fig. 3. If a cancel button 503 in the library display window 50 is clicked, the library display window 50 disappears, and the composite picture shown in the window 421 remains as it was before the library display window 50 was opened. Although drawings will be omitted due to the similarity, it should be noted that when the library display button 433 is clicked, another library display window 50 showing a plurality of candidate patterns for the face component is displayed. Each of the candidate patterns is combined with the currently selected patterns for the other components. Accordingly, the operator can determine the appropriate pattern for each picture component easily. After the composite picture is edited as described above, and when an OK button 440 of the composite picture editing window 40 is clicked, the image displayed in the window 421 is established as a final picture. In this case, if the picture editing process is executed as a sub-process when a parent process (another program) is executed, the image data of the established picture may be incorporated in the data processed by the parent process. For example, the picture edit process is called when a text is input with an word processing program, the image data of the established picture may be pasted within the text automatically. If the picture edit process is executed as an stand-alone process, the image data may be recorded on the HDD 14 as a data file. In the above-described embodiment, the composite picture consists of only two components: the hair component; and the face component. However, the invention does not limit the number of the components, and the composite picture may consist of three or more components. Even if the number of the components is more than two, the similar process can be performed to create a desired composite picture. When the number of the components is more than two, it is preferable that when the library display window is displayed, each pattern is combined with the patterns for all of the other components. If a cancel button 441 is clicked, the composite picture is not established, and accordingly, the image data corresponding to the composite data will not be incorporated in a data processed by the parent process, or will not be written on the HDD 14. If a shuffle button 442 is clicked, a pattern for each component corresponding to the currently selected category is selected at random, and combined. The composite image thus created is displayed in the window 421. Alternatively, control may be modified such that, when the shuffle button 442 is clicked, a pattern for each component is selected at random regardless of the category, and combined. Further, control may be modified such that a plurality of composite images may be created with use of a shuffling function described above at a time and displayed in the library display window 50. Further alternatively, control may be modified such that a predetermined candidate pattern for a component is selected from among all candidate patterns for all categories randomly, and then the selected candidate patterns belonging to various categories are displayed in the library display window 50. Still alternatively, control may be modified such that not only the candidate patterns shown in the library display window 50 but also the components to be combined with the candidate patterns may be selected randomly from among all patterns for all categories when the shuffle button 422 is clicked. It should be noted that the candidate patterns for each component includes a null image pattern, i.e., a pattern which does not have image at all. For example, for a composite picture consisting of the hair component and the face component, if the null image pattern is selected for the face component and the library display window for the hair component is displayed, only the patterns for the hair component are shown in the window as shown in Fig. 5. This type of display has been employed in conventional composite picture editing devices. Having this type of display is advantageous. If the operator intends to select a pattern of a certain component without referring to the other components, by selecting the null image pattern of the other components, the purpose can be achieved easily. Fig. 6 shows the composite picture edit window 40 when the category 416 ("upper body") is selected. On the category indication portion 411, the letter "Body" is displayed to indicate the selected category. Further, the displayed condition of the picture corresponding to the category 416 in the category window 416 is also made different from the other pictures in the window 416. If the window 40 is displayed in color, the displayed condition could be different by color, and if the window 40 is a monochrome display, the displayed condition may be made different by highlighting the selected category. As shown in Fig. 6, in the composite picture window 421, a picture of an upper body is displayed. In this embodiment, the composite picture of the upper body consists of a head component and a body component. On the upper side of the scroll bar 424 which is displayed on the right-hand side of the window 421, the name of the component "Head", and a number 423 (a value of which is "23") indicating the currently selected pattern for the head component is displayed. On the upper side of the scroll bar 429, the name of the other component "Body" and the number 428 (a value of which is "78") indicating the currently selected pattern for the body component is displayed. If the library display button 433 is clicked when the window 40 shown in Fig. 6 is displayed, the library display window 50 showing a plurality of patterns for the body component as shown in Fig. 7 is displayed. As shown in Fig. 7, in the window 50, each of the candidate patterns is combined with the currently selected pattern for the head component. Since the operator can view the entire image of the composite picture, it is easier to determine a pattern in the window 50 in comparison to the case in which only the patterns for the component are displayed without the pattern for the head component. As described before with reference to Fig. 4, by clicking on a desired pattern, selection of the pattern is made. The selected pattern is displayed as being highlighted. Fig. 8 shows a flowchart illustrating a process when the library display button 432 or 433 is clicked. The process is executed by the CPU 11. When the operator clicks the library display button 432 or 433, the CPU 11 determines which component is selected at step S1 (hereinafter, referred to as S1, S2, ..). For example, in a situation in which the window 40 shown in Fig. 3 is opened, the CPU 11 determines that the hair component of the child face category is selected if the library display button 432 is clicked, and that the look component of the child face category is selected if the library display button 433 is clicked. Then, at S3, the CPU 11 reads bit map data of the patterns for the components other than that selected at S1 from the bit map area 13A of the RAM 13, and generate a combined bit mat data. Note that the combined bit map data generated as S3 does not include the bit map data of the pattern of the component selected at S1. At S5, the CPU 11 reads data of all the patterns for the component selected at S1 from the bit map area 13A, and combine each of the data of all the patterns with the combined bit map data to generate combined pattern image data. The combined pattern image data is displayed on the library display window 50 as a plurality of candidate patterns each combined with the currently selected patterns for the other components at S7 (see Figs. 4 and 7). If the operator clicks the cancel button 503 (S9:YES), the CPU 11 skips the steps following S7, and finishes the process shown in Fig. 8. Although not shown in Fig. 8, when the process shown in Fig. 8 is finished, the window 50 disappears. If the operator 502 clicks the OK button 502 when a patter is selected (S11:YES), the CPU 11 combines the bit map data of the selected pattern (i.e., the pattern which is highlighted when the OK button 502 is clicked) with the currently selected patterns for the other components to generate a bit map data of the composite picture, and display the composite picture in the window 421 (S13). As described above, according to the composite picture editing device, when a library display window showing a plurality of candidate patterns for a component is displayed, each pattern is combined with the currently selected patterns for the other components. Therefore, the operator can determine an appropriate one of the candidate patterns for the component, and accordingly the composite picture can be created easily. It should be noted that the invention does not limit the composite picture to the picture of a face, body, head or the like. As far as the composite picture consisting of a plurality of components, and each component has a plurality of candidate patterns, the invention can be applied.

Claims: A composite picture editing device (100) for processing a composite picture consisting of a plurality of components (Hair, Face; Head, Body), at least one of said components (Hair; Body) having a plurality of candidate patterns (500), one of said plurality of candidate patterns (500) being selected to form said component in said composite picture, said composite picture editing device (100) comprising: a display (4, 40, 50); an image combining system (11), which generates a plurality of combined images by combining an image of each of said plurality of candidate patterns (500) for said at least one component (Hair; Body) with currently selected patterns for the other components; a display controller which controls said display (4, 40) in a first display mode to display an image including currently selected patterns for a plurality of components (420), and which controls said display (4, 50) in a second display mode to simultaneously display a plurality of said generated combined images (500); and a selector which is manually operated to select one of said combined images displayed in said second display mode for display in said first display mode. The composite picture editing device according to claim 1, wherein in the first display mode a currently selected one of said generated combined images is displayed. The composite picture editing device according to claim 1 or 2, wherein all of said plurality of components (Hair, Face; Head, Body) respectively have a plurality of candidate patterns (500), one (501) of said plurality of candidate patterns (500) for each component being selected to compose said composite picture, said image combining system (100) preferably generates said plurality of combined images by combining an image of each of said plurality of candidate (500) patterns for only one of said components with currently selected patterns for the other components at a time. The composite picture editing device according to one of claims 1 to 3, wherein said selector comprises a manually movable mouse (3) and a mouse pointer displayed on said display (4), said mouse pointer being moved on any one of said combined images displayed on said display as said mouse (3) is moved, and said display controller preferably controls said display (50) to display said composite image consists of currently selected candidate patterns for said plurality of components. The composite picture editing device according to one of claims 1 to 4, wherein said display controller displays scroll bars (424, 429) corresponding to said plurality of components, wherein when one of said scroll bars (424, 429) is operated, currently selected candidate pattern of said composite picture corresponding to the operated ones of said scroll bars (424, 429) are replaced with another candidate pattern. The composite picture editing device according to one of claims 1 to 5, wherein said plurality of patterns for each of said plurality of components (Hair, Face; Head, Body) includes a null image pattern containing no images. The composite picture editing device according to one of claims 1 to 6, which is capable of processing a plurality of categories (412-416) of composite pictures, a plurality of different sets of components (Hair, Face; Head, Body) being provided corresponding to said plurality of categories (412-416). The composite picture editing device according to one of claims 1 to 7, wherein said image combining system (11) combines an image of one of said plurality of candidate patterns (500) for each component (Hair, Face; Head, Body) at random, and said display controller controls said display (4) to display said composite picture consists of candidate patterns selected at random for respective components. A method of processing a composite picture consisting of a plurality of components (Hair, Face; Head, Body), at least one of said components (Hair; Body) having a plurality of candidate patterns (500), one of said plurality of candidate patterns (500) being selected to form said component in said composite picture, said method comprising: providing a display (4; 40, 50); generating a plurality of combined images by combining an image of each of said plurality of candidate patterns (500) for said at least one component (Hair; Body) with currently selected patterns for the other components; controling said display (4, 40) in a first display mode to display an image including currently selected patterns for a plurality of components, and controling said display (4, 50) in a second display mode to simultaneously display a plurality of said generated combined images (500); and providing a selector which can be manually operated to select one of said combined images displayed on said display (4, 40, 50). The method according to claim 9, wherein in said first display mode a currently selected one of said generated combined images is displayed. The method according to claim 9 or 10, wherein said plurality of candidate patterns for each of said plurality of components includes a null image pattern containing no images. The method according to one of claims 9 to 11, wherein said composite picture includes pictures at a plurality of categories (412-416), wherein said plurality of candidate patterns (500) includes a plurality of candidate patterns (500) in said plurality of categories (412-416), said step of obtaining said second image data for each of said plurality of candidate patterns (500) obtains the second image data in said plurality of categories (412-416) at random, and/or said step of obtaining said first image data of said candidate pattern selects said plurality of components from among candidate patterns (500) for said plurality of categories (412-416) at random.

Inventors: IKEDO TATSUHIRO, IKEDO, TATSUHIRO
Applicants: BROTHER IND LTD, BROTHER KOGYO KABUSHIKI KAISHA
Application year: 1997
Main classification: G06T11
IPC codes: G06T11