Abstract:
The present invention provides an editing apparatus, an editing method, and a program by which a user can freely and easily apply an effect while visually confirming a motion-image to be edited. The editing apparatus includes a playback/display unit that plays back and displays a motion-image, a position designation unit that designates the positions on the motion-image played back and displayed by the playback/display unit, a coordinate conversion unit that converts the positions designated by the position designation unit into virtual coordinates on the motion image, a storage unit that stores the virtual coordinates obtained by the coordinate conversion unit in association with frames of the motion-image, and an effect application unit that applies an effect to the motion-image based on the virtual coordinates stored in the storage unit.

Description:
CROSS REFERENCE TO RELATED APPLICATIONS  
       [0001]     The present invention contains subject matter related to Japanese Patent Application JP 2004-290725 filed in the Japanese Patent Office on Oct. 1, 2004, the entire contents of which being incorporated herein by reference.  
       BACKGROUND OF THE INVENTION  
       [0002]     1. Field of the Invention  
         [0003]     The present invention relates to an editing apparatus, editing method, and a program that apply an effect to a motion-image.  
         [0004]     2. Description of the Related Art  
         [0005]     As a technique for applying an effect such as mosaic to a motion-image, so-called “motion tracking” has been available. The motion tracking automatically tracks a characteristic object in the motion-image and applies an effect to the track of the object. With the motion tracking technique, it is possible to easily apply an effect to the object moving on the screen.  
       SUMMARY OF THE INVENTION  
       [0006]     However, in the motion tracking, it is impossible to perform the application of an effect if there is no object to be tracked. Further, it is difficult to recognize an object with uncertain outline due to high-speed movement, one intersecting with other objects or backgrounds, one whose size varies, one that moves out of the motion-image once and moves in the motion-image again, so that an effect cannot reliably be applied to the target object.  
         [0007]     To cope with this problem, a technique that arranges still pictures on the editing portion of the motion-image in chronological order and displays them, and inserts selected effect images into the target still image to thereby display the still images to which an effect has been applied has been available (refer to, for example, Jpn. Pat. Appln. Laid-Open Publication No. 11-205673). However, the use of the selected effect image prevents an effect from being freely applied.  
         [0008]     The present invention has been proposed in view of the above situation, and it is desirable to provide an editing apparatus, editing method, and a program capable of freely and easily applying an effect.  
         [0009]     According to the present invention, there is provided an editing apparatus including: a playback/display means for playing back and displaying a motion-image; a position designation means for designating the positions on the motion-image played back and displayed by the playback/display means; a coordinate conversion means for converting the positions designated by the position designation means into virtual coordinates on the motion image; a storage means for storing the virtual coordinates obtained by the coordinate conversion means in association with frames of the motion-image; and an effect application means for applying an effect to the motion-image based on the virtual coordinates stored in the storage means.  
         [0010]     According to the present invention, there is also provided an editing method including: a playback/display step of playing back and displaying a motion-image; a position designation step of designating the positions on the motion-image played back and displayed in the playback/display step; a coordinate conversion step of converting the positions designated in the position designation step into virtual coordinates on the motion image; a storage step of storing the virtual coordinates obtained in the coordinate conversion step in a storage means in association with frames of the motion-image; and an effect application step of applying an effect to the motion-image based on the virtual coordinates stored in the storage means.  
         [0011]     According to the present invention, there is also provided a program allowing a process of editing a motion-image to be executed, the program including: a playback/display step of playing back and displaying a motion-image; a position designation step of designating the positions on the motion-image played back and displayed in the playback/display step; a coordinate conversion step of converting the positions designated in the position designation step into virtual coordinates on the motion image; a storage step of storing the virtual coordinates obtained in the coordinate conversion step in a storage means in association with frames of the motion-image; and an effect application step of applying an effect to the motion-image based on the virtual coordinates stored in the storage means.  
         [0012]     According to the present invention, a motion-image is played back and displayed to a user, the positions that are designated by the user are converted into virtual coordinates on the motion-image, and the obtained virtual coordinates are stored in association with frames of the motion-image. With this configuration, the user can freely and easily apply an effect while visually confirming the motion-image. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0013]      FIG. 1  is a block diagram showing an internal configuration of an editing apparatus according to an embodiment of the present invention;  
         [0014]      FIG. 2  is a flowchart showing an editing method according to the embodiment;  
         [0015]      FIG. 3  is a view showing a graphic example based on GUI;  
         [0016]      FIG. 4  is a view showing a graphic example based on GUI;  
         [0017]      FIG. 5  is a view for explaining acquisition of point coordinates;  
         [0018]      FIG. 6  is a view showing a graphic example based on GUI;  
         [0019]      FIG. 7  is a view showing a graphic example based on GUI; and  
         [0020]      FIG. 8  is a view showing a graphic example based on GUI. 
     
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS  
       [0021]     Embodiment of the present invention will be described below in detail with reference to the accompanying drawings.  FIG. 1  is a block diagram schematically showing an internal configuration of an editing apparatus  1 . In the editing apparatus  1 , a CPU (Central Processing Unit)  2 , a ROM (Read Only Memory)  3 , a RAM (Random Access Memory)  4 , an HDD (Hard Disc Drive)  5  and interface circuits  6 ,  7  are connected through a bus  8 . Further, a display device  9  and an input device  10  are connected to the bus  8  though the interface circuits  6 ,  7 .  
         [0022]     When receiving an instruction to execute a predetermined process from the input device  10  such as a mouse or keyboard through the interface circuit  7 , the CPU  2  executes various processes according to a program stored in the ROM  3  or HDD  5 . For example, the CPU  2  reads out a motion-image file from the HDD  5  as needed and allows the display device  9  to display the motion-image using GUI (Graphical User Interface). Further, the CPU  2  allows the display device  9  to display a point indicating the position on the screen according to an input operation through the input device such as a mouse.  
         [0023]     Next, a method of editing a motion-image according to the embodiment will be described with reference to a flowchart of  FIG. 2 . Firstly, in step S 201 , a graphic  300  based on GUI as shown in  FIG. 3  is displayed on the display device  9  through a user&#39;s predetermined operation.  
         [0024]     The graphic  300  is roughly constituted by a motion-image display area  301 , a playback operation area  302 , and a setting area  303 .  
         [0025]     On the motion-image display area  301 , a motion-image  304  of a predetermined frame selected on the playback operation area  302  is displayed.  
         [0026]     The playback operation area  302  includes a slide button  305 , a frame position display section  306 , playback operation buttons  307  to  311 , and a preview size setting section  312 . On the slide button  305  and frame position display section  306 , the frame position of the motion-image data that is being displayed on the motion-image display area  301 . The playback buttons  307  to  311  include a top frame moving button  307 , a frame reverse button  308 , a playback button  309 , a frame advance button  310 , and a final frame moving button  311  and are used for playing back the motion-image file at a desired frame position. The preview size setting section  312  is used for setting the size of the motion-image  304  to be displayed on the motion-image display area  301 . This setting allows the motion-image  304  to be displayed in an enlarged manner on the entire motion-image display area  301 .  
         [0027]     The setting area  303  has a playback speed selection radio button group  313  and a checkbox  314 . The playback speed selection radio button group  313  has choices of playback speed in the drag operation. Although 1×Speed, ½×Speed, ¼×Speed are available as choices in this example, the choices are not limited to these three. The checkbox  314  is used for determining whether the playback operation is ended or not at the end time of the drag operation by making a user to mark the checkbox  314 .  
         [0028]     The use of a capture start button  315  allows a program for recording point coordinates in the drag operation (to be described later) to be executed. An open button  316  is used for opening the motion-image file to be edited. The use of the open button allows user&#39;s desired motion-image file to be read out. A save button  317  is used for saving a state of the motion-image file, playback speed, or the like.  
         [0029]     An OK button  318 , which corresponds to the capture start button  315 , is used for executing a track depiction program according to the drag operation (to be described later). A cancel button  319  is used for canceling the editing program and corresponds to a close button  321 . A help button  320  is used for executing a program that gives explanations of terms, operations, and the like.  
         [0030]     Returning to  FIG. 2 , in step S 202 , various settings are made based on the graphic  300 . For example, the open button  316  is opened to read out a desired motion-image file, and the slide button  305  and playback operation buttons  307  to  311  are used to set the position of the frame that the user wants to apply an effect to. After that, on the setting area  303 , playback speed at which the track for applying an effect is depicted or whether playback operation is stopped or not at the end time of the drag operation of depicting the track is set. Hereinafter, it is assumed that the playback operation is stopped at the drag operation end time.  
         [0031]     When the capture start button  315  is clicked after the frame position or playback speed of the motion-image file to be edited is set in step S 202 , the apparatus enters a state where it is possible to start the track depiction through a drag operation (step S 203 ). At this time, the CPU  2  switches the display screen from the graphic  300  to a graphic  400  as shown in  FIG. 4 . In this graphic  400 , the capture start button  315  on the graphic  300 , which has been clicked in step S 202 , is changed into a capture pause button  415  for track depiction and the other buttons and the like are in an inactive state. The buttons and the like  401  to  420  (excluding  415 ) correspond to the buttons and the like  301  to  321  on the graphic  300  shown in  FIG. 3  and the description thereof will be omitted.  
         [0032]     When the motion-image display area  401  shown in  FIG. 4  is dragged with the input device  10  such as a mouse (step S 204 ), playback operation is started from the predetermined frame position set in the step S 202  (step S 205 ). At the same time, the CPU  2  acquires frame numbers of the motion-image and point coordinates (step S 206 ).  
         [0033]      FIG. 5  shows a relationship between the point coordinates and frame numbers of the motion-image acquired in step S 206 . As shown in  FIG. 5 , the point coordinates on the motion-image display area  501  is stored in the RAM or the like in association with the frame number of the motion-image that is being played back. That is, the position that has been designated by the drag operation in step S 206  is recorded for each frame of the motion-image that is being played back. For example, in  FIG. 5 , point coordinates corresponding to the frame numbers  0  to  31  are stored. When the point coordinates on the frame numbers  0  to  31  are connected to each other in chronological order, a track for applying an effect is obtained. The point coordinates on the motion-image display area  501  covers the outside area of the motion-image  504 , so that even if a target object moves out of the frame for a moment, the point coordinates can continuously be acquired and recorded. As described above, the point coordinates of the drag operation can be acquired for each frame of the motion-image, so that the user can freely depict the track while viewing the motion-image.  
         [0034]     The point coordinates acquired in step S 206  are converted into virtual plane coordinates on the motion-image (step S 207 ) and recorded in the RAM  4  or the like in association with the frame numbers (step S 208 ).  
         [0035]     The motion-image is played back until the drag operation has been completed (step S 209 ). That is, the steps S 205  to S 208  are repeated until the drag operation has been completed to thereby acquire a motion path which is the track to which an effect is applied. When the drag operation has been completed in step S 209 , the CPU  2  stops playback of the motion-image (step S 210 ).  
         [0036]     As a result of the drag operation, a track  622  of the motion path as shown in  FIG. 6  is displayed on the motion-image display area  601 . On a graphic  600  shown in  FIG. 6 , the track  622  of the motion path from frame positions  0  to  38  is displayed. The buttons and the like  601  to  621  correspond to the buttons and the like  401  to  421  on the graphic  400  shown in  FIG. 4  and the description thereof will be omitted.  
         [0037]     In step S 211 , the click of the capture pause button  615  stops recording operation of the virtual plane coordinates (step S 212 ). In step S 213 , the following effect is applied based on the virtual plane coordinates on the motion-image recording through the above operation.  
         [0038]     Through the above editing operation, the user can start the playback of the motion-image at a desired frame and freely depict the track and, therefore, he or she can reliably and easily apply an effect. Further, the playback of the motion-image is stopped simultaneously with the completion of the drag operation, so that it is possible to depict the track only on the frames that the user wants to apply an effect to. Further, selection of the playback speed allows the user to easily depict the track even under the condition that the movement of a target object is fast or complicated.  
         [0039]     Next, the application of an effect will be described with examples.  FIG. 7  shows an example in which a pattern effect has been applied to the track  622  of the motion path. Like the graphic  300  shown in  FIG. 3 , a graphic  700  in which a pattern effect has been applied is roughly constituted by a motion-image display area  701 , a playback operation area  702 , and a setting area  703 . The motion-image display area  701  and playback operation area  702  respectively correspond to the motion-image display area  301  and playback operation area  302  shown in  FIG. 3 , and the description thereof will be omitted.  
         [0040]     The setting area  703  is displayed when a pattern is selected from an object selection menu  713  and includes an active check button  714 , a pattern changeover menu  715 , a pen width slider  716 , a pen style menu  717 , a painting type menu  718 , a pen color menu  719 , and a brush color menu  720 .  
         [0041]     When the user wants to display the pattern selected on the pattern changeover menu  715  on a motion-image  704 , he or she checks the active check button  714 . The pattern changeover menu  715  has choices such as circle, triangle, quadrangle, star, arrow, straight line, polygonal line, and polygon, from which the user can select a desired object. The pen width slider  716  is used for adjusting the width of the outline of the object. The pen style menu  717  has choices of the line type such as solid, dash, dot, dash-dot. The painting type menu  718  has choices such as solid color, blurring, blurring and inversion, mosaic, mosaic and inversion, background transparent. The pen color menu  719  presents the line colors of the outline of the pattern, and the brush color menu  720  presents the internal colors of the pattern. By freely making the above settings on the setting area  703 , the user can easily add a desirable pattern to the track  622 .  
         [0042]      FIG. 8  shows an example in which a brush effect has been applied to the track  622  of the motion path. Like the graphic  300  shown in  FIG. 3 , a graphic  800  in which a brush effect has been applied is roughly constituted by a motion-image display area  801 , a playback operation area  802 , and a setting area  803 . The motion-image display area  801  and playback operation area  802  respectively correspond to the motion-image display area  301  and playback operation area  302  shown in  FIG. 3 , and the description thereof will be omitted.  
         [0043]     The setting area  803  is displayed when a brush is selected from an object selection menu  813  and includes an active check button  814 , a brush shape changeover menu  815 , a radius slide button  816 , an interval slide button  817 , a painting type menu  818 , and a pen color menu  819 .  
         [0044]     When the user wants to display the pattern selected on the pattern changeover menu  715  on a motion-image  804 , he or she checks the active check button  814 . The brush shape changeover menu  815  has choices such as circle, circular blurring, quadrangle, quadrangular blurring, spray, crayon, from which the user can select a desired brush particle size. The radius slide button  816  is used for adjusting the radius of the brush particles. The interval slide button  817  is used for adjusting the interval between the particles selected on the brush shape changeover menu  815 . The painting type menu  818  has choices such as solid color, blurring, blurring and inversion, mosaic, mosaic and inversion, background transparent. The pen color menu  819  presents the colors of the brush particles. By making the above settings on the setting area  803 , the user can easily and freely add a desirable type of the brush particle to the track  622 .  
         [0045]     As described above, according to the present invention, it is possible to freely and easily apply an effect while playing back a motion-image to be edited at a desirable speed and visually confirming the motion-image.  
         [0046]     It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alternations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.