Method and apparatus for displaying available source material for editing

Abstract: A computer editing system graphical user interface includes at least one central processing unit (CPU) coupled through appropriate input/output (I/O) circuitry to input devices, such as a cursor control device, and a display device. The CPU is further coupled to a storage device for the storage of data and programs including a database. The database comprises a plurality of source logs indicating a beginning point and an ending point defining all the available source material for the corresponding source log. An output sequence of selected source material is displayed on a timeline as source material blocks, wherein the source material blocks are defined by a head point and a tail point. Through the computer editing system, a user performs a variety of re-editing functions to trim existing source material and to insert new source material on the timeline. When performing a re-edit function, all available source material blocks for a source log selected for re-edit is displayed. The selected source block displayed is visually distinguished by size, colour and relative layering. By distinguishing the selected source block for which re-edit is desired, the user is permitted to clearly view all the available source material for the selected source block.

Description: The present invention relates to a method and an apparatus for displaying and editing graphic information, and more particularly, the present invention relates to a computer controlled display system for editing a multi-media production. Over the past decade, a variety of graphic user interfaces have been developed to ease human interaction with computer systems. Many display systems utilize metaphors in the design of the interface as a way of maximising human familiarity, and conveying information between the user and the computer. it is common for computer systems incorporating so-called "object oriented" display systems to utilize multiple "windows" on a display in which combinations of text and graphics are disposed. The display systems utilize familiar metaphors, such as desktops, control panels, notebooks and the like, such that the interface takes advantage of existing human mental structures to permit a user to draw upon the metaphor analogy to understand the requirements of the particular computer system. It is well known that designing around a familiar metaphor helps reduce human learning time. (See for example, Patrick Chan, "Learning Considerations in User Interface Design: The Room Model", Report CS-84-16, University of Waterloo Computer Science Department, Onatario, Canada, July 1984, and the references cited therein.) The ability to operate on images or objects which relate the user to actual objects on, for example, a desktop, results in a stronger man-machine interface. (See for example, D.Robson, "Object Oriented Software Systems", BYTE, August 1991, page 74, Vol.6, No.8; L.Tesler, "The Smalltalk Environment", BYTE, August 1981, page 90, Vol.6, No.8; and Smith, et al., "Star User Interface: An Overview", National Computer Conference, 1982). Research in interface design using metaphors in man-machine interfaces may be applied to computer controlled editing systems to incorporate and integrate various production media resources, such as special effects, music, graphics and the like. In the case of an editing system, a variety of resources must be integrated, scheduled and coordinated with one another to obtain a complete multi-media product. Users of computer controlled editing systems are generally familiar with the individual resources and the coordination of those resources to develop a finished product. Accordingly, the "windows" utilized in a video editing system may be designed such that the metaphor of the interface takes advantage of the knowledge of the user in operating discrete devices (for example, a video tape recorder or music synthesizer). The window may, therefore, take the form of a control panel for the video tape recorder, which includes the controls of play, reverse, record and the like. Similarly, the window may provide an area on the display screen in which movies, takes, or particular scenes are displayed for the user to edit. A computer controlled editing system may allow a user of the system to integrate source material from a variety of multi-media resources to generate an output sequence. One problem associated with computer editing systems is that the editing systems often fail to provide the user with an organized and visual display of the source material available to create the output sequence. Without a visual display of the source material, it is difficult for a user to select source material for editing or re-editing of an output sequence. EP-A-0,113,993 describes a video composition apparatus which composes and edits sections of available video source material into a program sequence. The apparatus employs pictorial labels associated with each segment for ease of manipulating the segments to form the program sequence. The labels are displayed on an ordered spatial array of display monitors to simulate the temporal relationship between the segments in what is typically a nontemporal display. A control function allows the user to denote a start and end of each of a plurality of selected segments to form defined segments, identify each selected segment by a pictorial image segment label which is displayed as described above, and assemble or sort the labels into a serially connected label sequence corresponding to a serially connected segment sequence. The mode of operation employs continuous looping of the displayed segment(s) to aid in the composing process. The apparatus further features trimming the segments to a desired length and adjusting if necessary the transition between segments. The sort, trim, and splice operations all are effected without rearranging the segments on the storage media. EP-A-0,438,299 describes a video editing system which schematically represents the available video source material in a window based display system such as that described above. The system includes a computer programmed with software providing an integrated software environment which enables a user conveniently to log unedited takes into the system, and to generate an edit list suitable for use in a subsequent online editing operation. The system is preferably operative to display a graphical representation of the current edit list in a window representing a timeline. In such representation, each splice is represented by a vertical bar which are spaced apart along said timeline and which may optionally be identified by a reference numeral. Furthermore, if picture frames are to be cued, means are provided for displaying each cued frame in a picture-in-picture video window at one of the locations of windows of the screen of the computer monitor. FR-A1-2,630,572 again describes a video editing system having bars representing video source material available for editing. This system gives an indication of the relative lengths of the portions of the material to be edited since each portion is represented on a display by a separate block, each block extending along an individual and separate timeline. This results in a complicated display in which it is not immediately apparent how the flow of material takes place. As will be described, the present invention provides methods and apparatus for viewing available source material for executing re-edit functions. The present invention provides a method of displaying available source material for editing by a computer controlled editing system, for editing a multi-media production, including a central processing unit (CPU) coupled to a display device and storage means coupled to said CPU, comprising the steps of: storing a plurality of source logs for identifying all the available source material for editing by said computer controlled editing system, each log comprising a start point and an end point of a portion of the available source material; on said display device, displaying on at least one timeline a sequence of a plurality of source material blocks, each block representing a portion of said source material, such that a tail point of a first source material block is adjacent to a head point of a subsequent source material block on said or each said timeline, said head and tail points of each source material block defining up to all of the portions of said source material identified by corresponding source logs, selecting a source material block for re-editing, and indicating a point on said source material block selected for which re-edit is desired; selecting a re-edit function; and upon selection of said re-edit function displaying, on said display device, available source material required for said re-edit function selected and corresponding to said source block selected and said point indicated and distinguishing said available source material from the other source material blocks on said timeline by size, colour and relative layering. The present invention also provides a computer controlled editing apparatus for editing a multi-media production including a central processing unit (CPU) coupled to a display device, for displaying available source material for editing, comprising: storage means coupled to said CPU for storing a plurality of source logs for identifying all the available source material for editing by said computer controlled editing system, each log comprising a start point and an end point of a portion of the available source material; graphical user interface (GUI) means coupled to said CPU, storage means and said display device for providing a man to machine interface for said computer controlled editing system, said GUI means comprising at least one timeline and a plurality of source material blocks, each block representing a portion of said source material, and each block having a head point and a tail point, said head and tail points of each source material block defining up to all source material identified by said corresponding source log, said GUI means further comprising: means for displaying on said display device, a sequence of a plurality of said source material blocks on said at least one timeline such that a tail point of a first source material block is adjacent to a head point of a subsequent source material block on said or each said timeline, selection means for selecting a re-edit function by selecting a source material block to be re-edited including a means for indicating a point on said source material block selected for which re-edit is desired, and for displaying, on said display device upon selection of said re-edit function available source material required for said re-edit function selected and corresponding to said source block selected and said point indicated and distinguishing said available source material from the other source material blocks on said timeline by size, colour and relative layering. The present invention provides apparatus and methods for use in computer display systems, and in particular, a graphical user interface for use in computer controlled multi-media editing system. A display system including at least one central processing unit (CPU) is coupled through appropriate input/output (I/O) circuitry to input devices, such as a cursor control device. The CPU is further coupled to a storage device for the storage of data and programs including a database. The CPU is also coupled to a display device on which the present invention's users interface is displayed. The database comprises a plurality of source logs which are pointers to selected portions of audio and/or video source material located on various media resources. Through use of the source logs, the computer editing system controls the various media resources to provide source material for editing or re-editing of a production. The computer controlled editing system of the present invention generates an output sequence of selected source material displayed on a timeline. The source logs contain a beginning point and an ending point defining all the available source materials for the corresponding source log. To generate the output sequence on the timeline, a portion of a source log is selected by defining a head point and a tail point. The computer controlled editing system of the present invention permits a user to perform a variety of re-editing functions to trim existing source material and to insert new source material on the timeline. When performing a re-edit function, the computer controlled editing system displays all available source material for a source log selected for re-edit. To accomplish this task, a source material block displayed is visually distinguished by size, colour and relative layering. By distinguishing the selected source block for which re-edit is desired, the user is permitted to clearly view all the available source material for the selected source log. Thus, with the present invention each separate sequence (e.g. of audio, video, graphics etc.) has a separate timeline and it is immediately apparent how each portion of material follows on from the other on each different timeline. The invention will be further described by way of non-limitative example with reference to the accompanying drawings, in which:- Figure 1 is a functional block diagram illustrating one possible computer display system incorporating the teachings of the present invention. Figure 2 illustrates a graphical user interface for a computer editing system configured in accordance with the present invention. Figures 3a-e illustrate a graphical user interface for a re-edit insert function configured in accordance with the present invention. Figures 4a-e illustrate a graphical user interface for an overlay re-edit function configured in accordance with the present invention. Figures 5a-f illustrate a graphical user interface for a Trim 1 mode re-edit function configured in accordance with the present invention. Figures 6a-d illustrate a graphical user interface for a Trim 2 function configured in accordance with the present invention. Figures 7a-d illustrate a graphical user interface for a Trim 3 function configured in accordance with the present invention. The detailed descriptions which follow are presented largely in terms of display images, algorithms and symbolic representations of operations of data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self consistent sequence of steps leading to a desired result. These steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It proves convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, images, terms, numbers or the like. It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels provided to these quantities. In the present case, the operations are machine operations performed in conjunction with a human operator. Useful machines for performing the operations of the present invention include general purpose digital computers or other similar devices. In all cases, there should be borne in mind the distinction between the method operations of operating a computer and the method of computation itself. The present invention relates to method steps for operating a computer and processing electrical or other physical signals to generate other desired physical signals. The present invention also relates to apparatus for performing these operations. This apparatus may be specially constructed for the required purposes, or it may comprise a general purpose computer selectively activated or reconfigured by a computer program stored in the computer. The algorithms, methods and apparatus presented herein are not inherently related to any particular computer. In particular, various general purpose machines may be used with programs in accordance with the teachings herein, or it may prove more convenient to construct more specialised apparatus to perform the required method steps. The required structure for a variety of these machines will appear from the description given below. Machines which may perform the functions of the present invention include those manufactured by Sony Corporation of America, as well as other manufacturers of computer systems. The present invention discloses apparatus and methods for displaying time based multiple track interrelationships and available graphical user interface on a computer display. In the following description, numerous specific details are set forth such as computer system configurations, window elements, icons, desktop sizes, metaphors, window configurations and arrangements, etc. in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practised without these specific details. In other instances, well known circuits, structures and the like are not described in detail so as not to obscure the present invention unnecessarily. Referring now to Figure 1, the hardware configuration of the present invention is conceptually illustrated. The Figure illustrates a computer system for generating a window-based graphic user interface in accordance with the teachings of the present invention. As illustrated, the computer system includes a computer 20 which comprises four major components. The first of these is an input/output (I/O) circuit 22, which is used to communicate information in appropriately structured form to and from other portions of the computer 20. In addition, computer 20 includes a central processing unit (CPU) 24 coupled to the I/O circuit 22 and to a memory 26. These elements are those typically found in most computers and, in fact, computer 20 is intended to be representative of a broad category of data processing devices. Also shown in Figure 1 is a keyboard 30 for inputting data and commands into computer 20 through the I/O circuit 22, as is well known. Similarly, a CD ROM 34 is coupled to the I/O circuit 22 for providing additional programming capacity to the system illustrated in Figure 1. It will be appreciated that additional devices may be coupled to the computer 20 for storing data, such as magnetic tape drives, buffer memory devices, and the like. A device control 36 is coupled to both the memory 26 and the I/O circuit 22, to permit the computer 20 to communicate with multi-media system resources. The device control 36 controls operation of the multi-media resources to interface the multi-media resources to the computer 20. For example, in a video editing environment, the computer 20 may be coupled through the device control 36 to a video tape recorder 40, a music synthesizer 42, an audio tape recorder 44, a special effects resource 46, and a disc player 41 as shown. The device control 36 may comprise an independent control and interface device or software process for execution by the CPU 24. A display monitor 50 is coupled to the computer 20 through the I/O circuit 22. Any well know variety of cathode ray tube (CRT), liquid crystal or other displays may be utilized as display 50. A cursor control device 52 includes switches 54 and 56 for signalling the CPU 24 in accordance with the teachings of the present invention. Cursor control device 52 (commonly referred to as a "mouse") permits a user to select various command modes, modify graphic data, and input other data utilizing switches 56 and 54. More particularly, the cursor control device 52 permits a user to selectively position a cursor 58 at any desired location on a display screen 60 of the display 50. As illustrated in Figure 1, the cursor 58 is disposed with a window 65 in the present invention's graphic user interface, to be described more fully below. Moreover, in the presently preferred embodiment, the present invention's window-based user interface is generated and displayed using software stored in either memories 26,32 or CD ROM 34, and executed by the CPU 24. In the presently preferred embodiment, cursor control 52 utilizes well known apparatus and methods for signalling CPU 24 of positional changes or cursor 58 by movement of the cursor control over a surface. However, it will be appreciated by one skilled in the art that a variety of well known cursor control devices may be utilized by the present invention, including other control devices such as mechanical mice, trackballs, joy sticks, graphic tablets, other keyboard inputs and the like. The cursor control 52 in Figure 1 is intended to encompass all such equivalent devices. The graphical user interface of the present invention displays information for re-editing associated with a database. Typically, the database is generated from a computer controlled editing system to incorporate and integrate various production media resources. As an example, a computer controlled editing system configured in accordance with the present invention may provide a means for a user of the computer controlled editing system to generate source logs. The database comprises a plurality of source logs which are pointers to selected portions of audio and/or video source material located on various media resources. Each source log comprises information such as a tape identifier, a start point, and end point, and any other information useful for the editing and re-editing processes. The database also contains a total duration for each source log. Through use of the source logs, the computer editing system control the various media resources to provide source material for editing or re-editing of a production. For example, to create a source log, a user may select a media resource, such as a video tape player, and command the computer controlled editing system to capture a selected portion of the video generated by the video tape player. The source log generated may comprise video and/or any number of audio channels. The plurality of source logs generated for editing of a particular multi-media production may be arranged into a file such that the file contains source logs for the editing or re-editing of that particular production. As will be described more fully below, the graphical user interface of the present invention operates in conjunction with the database comprising the source logs. Although the present invention is described in conjunction with a computer controlled editing system that generates source logs, any database comprising source material for use in a computer controlled editing system could be used in accordance with the teachings of the present invention. In a preferred embodiment, the computer editing system of the present invention retrieves the source logs stored in the database during an earlier edit session, and displays a corresponding source material block. Each source block contains a start point and an end point. The start and the end points define the available source material or the particular source block. To generate an output sequence, the source blocks are entered onto a timeline in a sequential order. However, in generating the output sequence, it may be desirable to include only a portion of the available source material from a particular source block. Therefore, the computer editing system permits selection of portions of any particular source block. The beginning of the selected portion of the source block is defined as the "in" or "head" point, and the closing of the selected portion of the source block is defined as the "out" or "tail" point. A final output sequence generated on the timeline comprises selected portions arranged such that a tail of a first source block is adjacent to a head of a subsequent source block. Referring to Figure 2, a graphical user interface for a computer editing system configured in accordance with the present invention is illustrated. The graphical user interface 200 permits a user of the computer editing system to perform a number of re-editing functions. In general, the graphical user interface 200 contains at least one timeline 210, wherein the timeline 210 displays any number of source blocks 205,208 arranged in sequence. As described above, during an earlier editing session, source blocks are placed on each timeline which represents a time position in a final output sequence. Although a single timeline is illustrated in Figure 2, any number of timelines representing multiple tracks could be displayed in accordance with the teachings of the present invention. In a preferred embodiment, the multiple timelines representing time sequences for multiple track comprises one track of video and two tracks of audio. The timeline 210 is arranged in a horizontal direction beginning at the left and extending to the right. However, the timeline may be arranged in a horizontal direction beginning at the right and extending to the left, or the timeline may be arranged in a vertical direction. In addition to the timeline 210, the graphical user interface 200 displays a timeline cursor 212 and a selection cursor 201. The timeline cursor 212 is used in the re-editing functions as is described more fully below. The placement of the selection cursor 201 on the graphical interface 200 is controlled by the cursor control device 52. The graphical user interface 200 permits selection of a number of re-edit functions. Specifically, the present invention provides for three trim functions and two insert functions. The three trim functions are selectable from Trim 1 select 227, Trim 2 select 225, and Trim 3 select 221. The two insert functions are selectable by Insert 1 214 and Insert 2 215. The trim and the insert functions of the present invention may be selectable through any means. The trim and insert re-edit functions of the present invention are described more fully below. The graphical user interface 200 provides for control and operation of the re-edit functions. An edit control 236 permits entry of source blocks 205,208 on the timeline 210, and a delete control 238 allows deletion of a source block form the timeline 210. A head and tail control 232 and 230, respectively, control placement of the timeline cursor 212 and source blocks onto the timeline 210. The placement of the timeline cursor 212 at either the head or tail of respective source block can be achieved through selection of either head 232 or tail 230, respectively. If the user selects the head control 232, then the computer editing system performs re-edit functions on the head portion of an adjacent source block. Alternatively, if the user selects the tail control 230, then the computer edit system performs re-edit functions on the tail portion of an adjacent source block. In addition to controlling the placement of the timeline cursor 212 by the head and tail functions 232 and 230, a right arrow 234 and left arrow 236 move the cursor in the right and left directions, respectively. The timeline cursor is controlled by selection of right and left arrows 234 and 236 in any increment desired. For example, if source blocks displayed on a timeline identify frames of video, then selection of the right or left arrow 234 and 236 results in movement of one video frame. Also shown in Figure 2 is an event number 244 and an event duration 246. The event number 244 identifies the origin of a particular source block, and the event duration displays the available length of a particular source block. In a preferred embodiment of the present invention, the graphical user interface 200 is viewed in conjunction with an additional display. The additional display permits viewing of the source material simultaneously with display of corresponding source blocks on the graphical user interface 200. Although a graphical user interface is illustrated for control and operation of a number of re-editing functions, any control interface could be used to manipulate and control the re-edit functions of the present invention without deviating from the scope of the invention. Referring to Figures 3a-e, a graphical user interface for a re-edit insert function configured in accordance with the present invention is illustrated. an Insert 1 function of the present invention permits a user of the computer editing system to insert material contained on a source block into the sequence of source blocks on the timeline much like creating a splice on motion picture film. The Insert 1 function of the present invention inserts a new source block onto the timeline 210 without erasing or overlaying any of the existing source blocks. For purposes of explanation, a portion of a timeline containing three source blocks A, B and C are illustrated in Figure 3a. In order to execute the Insert 1 function, the user of the computer editing system places the timeline cursor 212 in a position for which the insertion is desired. For the example shown in Figures 3a-e, the timeline cursor 212 resides in the centre of the source block B. Upon selection, new source material, designated as source block E on Figure 3b, is placed on the timeline 210 by the computer editing system such that the start of the source block E is adjacent to the timeline cursor 212. The selection of new source material for placement on the timeline 210 may be accomplished through any means without deviating from the spirit and scope of the invention. The Insert 1 function is then initiated by the user through the graphical user interface 200 by placing the selection cursor 201 over the Insert 1 function select 214 and depressing a key on the cursor control device 52. Upon selecting the Insert 1 function, the user selects a head point on the source block E to mark the beginning of the source material for which insert on the timeline 210 is desired. To designate a head point of the source block E, the user selects the right arrow function 234 on the graphical user interface 200. In response, the source block E is advanced in a right to left direction. For the example illustrated in Figures 3a-e, the source block E is advanced to a head point designated "Head". In a preferred embodiment, the head point is selected via the head selection control 232, whereupon the computer editing system indicate selection of the head point as shown in Figure 3c. In a second embodiment, the user selects the head point for the source block E prior to the selection of the Insert 1 function. In the second embodiment for the example illustrated in Figures 3a-e, upon selecting the head point and then the Insert 1 function, the computer editing system displays the arrangement shown in Figure 3c. After the head point for the source block E is selected, the user advances the source block E for selection of a tail point. For the example shown in Figures 3a-e, the source block E is advanced via the right arrow 234 to place the desired tail point location within the timeline cursor 212. As shown in Figure 3d, as the source block E is advanced, a separation is created between the original B1 and B2 source blocks. As the separation is created, the head point on the source block E remains adjacent to the tail point of source block B1. The source block E is advanced through the timeline cursor 212 until the desired tail point is reached. The section between the head point and the tail point of the source block E represents the portion of the source block E desired for insertion on the timeline 210. After selection of the tail point of the source block E, the user selects the Insert End 219 on the graphical user interface 200. Upon selecting the Insert End 219, the computer editing system of the present invention inserts the source material contained on the source block E between the head and tail points as shown in Figure 3e. The portion of the new source material inserted is designated E' to represent that a portion of the source block E is inserted. After the re-edit Insert 1 function in the present example is executed, the source block A is shifted on the timeline 210, in a reverse direction, a distance equal to the source material E'. Likewise, the source block B1, bifurcated from the insertion, is shifted in a reverse direction on the timeline 210 a distance E'. Referring to Figures 4a-e, a graphical user interface for an overlay re-edit function configured in accordance with the present invention is illustrated. The computer editing system of the present invention permits overlaying of selected source material onto existing source material via an Insert 2 function. The Insert 2 function, like the Insert 1 function, permits insertion of new source material onto existing source material on the timeline in a re-edit session. However, the Insert 2 function of the present invention overlays the new source material onto the existing source blocks. For purposes of explanation, the timeline shown in Figure 4a depicts source blocks A, B, C and D. A new source block, designated as source block E, is placed on the timeline 210 for re-edit. The timeline cursor 212 is placed on the timeline at a point for which insertion of source material is desired. For the example shown in Figures 4a-e, the timeline cursor 212 is placed at the tail point of source block B. However, the insertion of the new source material need not occur at the head or tail point, but may occur anywhere on the timeline 210. After placing the cursor and the new source block E on the timeline, the user selects a head point for the source block E. As described above in conjunction with the Insert 1 function, the user selects the right arrow 234 on the graphical user interface 200 to advance the source block E forward in time on the timeline. As shown in Figure 4b, a head point for the source block E is selected. Upon selection of the head point, the source block E is further advanced for selection of a tail point. For the example illustrated in Figures 4a-e, the head point and tail points for the new source block E are shown in Figure 4c. After designating the tail point, the user selects the Insert End 219 function on the graphical user interface 200. The computer editing system of the present invention overlays the selected source material between the head point and the tail point from the source block E on top of the source block C. As shown in Figure 4d, new source material E', representing the portion between the head point and the tail point is shown. Also, the source block C, now designated C', is shortened as a result of the overlay function. Note for the Insert 2 function of the present invention, because the head and tail points for the new source block E were selected for placement only in source block C, the source blocks A, B and D are not affected, such that the source blocks retain their original position on the timeline. Figure 4e illustrate the source block E in a Trim 3 mode. The Trim 3 mode permits the user to view all existing source block material from the start to the end of the source block E. The operation of the present invention Trim 3 mode is described more fully below. Referring to Figures 5a-f, a graphical user interface for a Trim 1 function re-edit function configured in accordance with the present invention is illustrated. The Trim 1 function permits a user of the computer editing system to view and select existing source material in a source block during a re-edit session. Specifically, the Trim 1 function permits a user to edit the head point, tail point, or any combination thereof, for a selected source block. In the Trim 1 mode, if the duration of a source block selected is altered through selection of new head and/or tail points, the other source blocks on the timeline are affected accordingly. For purposes of explanation, four source blocks, designated A, B, C and D are illustrated in Figure 5a. To perform a Trim 1 function, the user places the timeline cursor 212 at the head or tail of a source block for which a re-edit is desired. From the example illustrated in Figures 5a-f, the timeline cursor 212 is placed at the tail of source block B using the tail select 230 on the graphical user interface 200. Upon placement of the timeline cursor in a desired head or tail location, the user selects the Trim 1 function from the graphical user interface 200 via the Trim 1 select 227. In addition to selecting the Trim 1 function, the user selects either right view 242 or left view 240 selects. The selection of the right view 242 or the left view 240 is indicated through illumination of the respective border areas on the graphical user interface 200. In a preferred embodiment, the selected right or left view border is illuminated, while the border area for the inactive view is darkened. For the example illustrated in Figures 5a-f, if the right view 242 is selected for modification of the tail point, then all existing source material for the source block B is shown beginning at the head 1 point and extending to the end point as shown in Figure 5b. In the right view perspective, the adjacent source block C is not shown on the timeline, and the source block B is displayed in a different colour and size than source block A. In the right view perspective, the user is permitted to view all existing source material for the source block B residing right of the cursor thereby allowing the user to select a new tail point. To select a new tail point in the present example, the user, through use of the right arrow 234, advances the source block B in time resulting in the source material moving in a right to left direction. The user advances the source material contained in source block B until the desired tail point is located within the timeline cursor. The selection of a tail point for the present example, designated Tail 2 , is illustrated in Figure 5c. The selected source material comprising the new Tail 2 point for the original source block B is designated B'. For the present example, the new Tail 2 lies to the right of Tail 1 , the previous tail point. Therefore, the duration of the source material for B' is greater than the duration of source material B. A user may also desire to change the original head point for the source material B. To accomplish this task, the user selects the left view via the left view select 240 on graphical user interface 200. Upon invoking the left view perspective, the computer editing system of the present invention displays the entire available source material in the source block B left of the timeline cursor. As shown in Figure 5d, the source block B from the start point to the tail point is displayed. To select a new head point, the user, through the graphical user interface 200, moves the source material in a reverse direction in relation to the timeline as shown in Figure 5e. The user shifts the source material in source block B such that the desired head point is located within the timeline cursor. When the desired head point is within the timeline cursor, the user selects the head point. The current source material containing the new head point and tail point is designated as B''. The current source material B'' comprises a different duration length than the original source material B. When the user has completed the re-edit session, the user selects the Trim End function 223 on the graphical user interface 200. The computer editing system of the present invention then displays the new current source material B'' as re-edited. As shown in Figure 5f, the change in duration of the current source material B'' results in a shift of source blocks A, C and D on the timeline. Referring to Figures 6a-d, a graphical user interface for a Trim 2 function configured in accordance with the present invention is illustrated. The Trim 2 function of the present invention permits a user to perform re-edit operations on existing source block material. In contrast to the Trim 1 function, Trim 2 function does not displace in time unedited source blocks on the timeline. Figure 6a depicts four source blocks A, B, C and D on a timeline. The user positions the timeline cursor between two source blocks for which the re-edit is desired. For the example shown in Figures 6a-d, re-edits of the tail point of source B and the head point of source block C are desired. As shown in Figure 6b, the source material for the end of source block B and start of source block C extends beyond the original edit illustrated in Figure 6a. In order to perform the re-edit, the user selects the Trim 2 select 225 on the graphical user interface 200. After invoking the Trim 2 function, the user selects either the right arrow 234 or left arrow 236 to perform the re-edit. For the example shown Figures 6a-d, the user selects the left arrow 236 causing the source block B to extend along the timeline in a reverse direction. As shown in figure 6c, the source block B comprises a new tail point, and the source block C comprises a new head point. Therefore, using the Trim 2 function of the present invention, the user may adjust the head point of source block C and the tail point of source block B in accordance with the positioning of the timeline cursor. After the user positions the cursor to select the new head point for source block C and tail point for source block B, the user selects the Trim End 232 select on the graphical user interface 200. The computer editing system of the present invention then displays the re-edit timeline as shown in Figure 6d. The source block B, comprising a new tail point, is designated as B', and the source block C, comprising a new head point, is designated C'. In contrast to the Trim 1 function, the Trim 2 function retains synchronization for adjacent source blocks on the timeline. For the example shown in Figures 6a-d, the source blocks A and D remain unchanged in both duration and positioning on the timeline. In order to affect the positioning of adjacent source blocks, Trim 1 mode is used. Referring to Figures 7a-d, a graphical user interface for a Trim 3 mode configured in accordance with the present invention is illustrated. The Trim 3 mode permits re-editing of a single source block. An example timeline is illustrated in Figure 7a containing source blocks A, B, C and D. To perform a re-edit in the Trim 3 mode, the user places the timeline cursor at the head or tail of the source block for which re-editing is desired, and selects the Trim 3 select 221 on the graphical user interface 200. For the example illustrated in Figures 7a-d, the source block B is chosen for re-edit. The Trim 3 mode permits the user to change both the head and tail points, simultaneously. The selection of new head and tail points in conjunction with the Trim 3 function of the present invention is accomplished through explicitly selecting either a new head or tail point at the timeline cursor resulting in the computer editing system selecting a corresponding new tail or head point. For the example of Figures 7a-d, placement of the timeline cursor at the head point is illustrated. In order to change the head and tail points on the source block B, the user scrolls through the source block B with the user of the right arrow or left arrow selects 234 and 236 respectively. For the example of Figures 7a-d, the user, via the left arrow select 236 on the graphical user interface 200, moves the source block B in a reverse direction. When the new head point desired is placed underneath the timeline cursor, the user selects the Trim End select 223 on the graphical user interface 200. Upon invocation of the Trim End function, the computer editing system of the present invention displays the new source block B with the new head and tail points. The selection of a new head point, as shown in Figures 7a-d, results in automatic selection of a corresponding tail point by the computer editing system. The Trim 3 function of the present invention does not displace the position of adjacent source blocks on the timeline. For the example shown in Figures 7a-d, the source blocks A, C and D retain the same position and duration on the timeline.

Claims: A method of displaying available source material for editing by a computer controlled editing system, for editing a multi-media production, including a central processing unit (CPU) (24) coupled to a display device (50) and storage means (32, 34) coupled to said CPU, comprising the steps of: storing a plurality of source logs for identifying all the available source material for editing by said computer controlled editing system, each log comprising a start point and an end point of a portion of the available source material (205, 208); on said display device, displaying on at least one timeline (210) a sequence of a plurality of source material blocks (205, 208), each block representing a portion of said source material, such that a tail point of a first source material block is adjacent to a head point of a subsequent source material block on said or each said timeline, said head and tail points of each source material block defining up to all of the portions of said source material identified by corresponding source logs; selecting a source material block for re-editing and indicating a point on said source material block selected for which re-edit is desired; selecting a re-edit function (214, 215, 221, 225, 227); and upon selection of said re-edit function displaying, on said display device, available source material required for said re-edit function selected and corresponding to said source block selected and said point indicated and distinguishing said available source material from the other source material blocks on said timeline by size, colour and relative layering. The method of displaying available source material for editing as claimed in claim 1, wherein the step of displaying on at least one timeline (210) one sequence of plurality of source material blocks (205, 208) comprises the step of displaying a plurality of sequences of source material blocks on multiple timelines showing time interrelationships, each of said plurality of sequences of source material blocks representing one track of a multi-track production. The method of displaying available source material for editing as claimed in claim 1 wherein the step of indicating a point on said source material block comprises the step of providing a timeline cursor (212) extending through said source material blocks on said timeline. The method of displaying available source material for editing as claimed in claim 1 wherein the step of selecting a re-edit function (214, 215, 221, 225, 227) comprises the step of providing selection of a first re-edit function (214) for insertion of new source material at said point indicated. The method of displaying available source material for editing as claimed in claim 4, further comprising the steps of: displaying said source material required for said re-edit function selected, starting at said point indicated, for which insertion is desired; advancing said source material along said timeline; selecting a head point on said required source material when said head point desired is within said point indicated; advancing said source material along said timeline while displaying said source material block selected at said point indicated separated from a subsequent source material block on said timeline; selecting a tail point on said required source material when said tail point desired is within said point indicated; terminating said first re-edit function; and displaying said required source material, from said head point to said tail point, on said timeline starting at said point indicated such that said plurality of source material blocks are displayed in a continuous sequence. The method of displaying available source material for editing as claimed in any one of claims 1 to 5, wherein the step of selecting a re-edit function comprises the step of selecting a second re-edit function (215) to overlay new source material onto existing source block material. The method of displaying available source material for editing as claimed in claim 6 further comprising the steps of: displaying said new source material, starting at said point indicated, for which overlay is desired by distinguishing said new source material from said source material blocks on said timeline by size, colour and relative layering; advancing said new source material along said timeline; selecting a head point on said new source material when said head point desired is within said point indicated; selecting a tail point on said new source material when said tail point desired is within said point indicated; terminating said second re-edit function; and displaying said new source material upon termination, from said head point to said tail point, on said timeline starting at said point indicated so as to overlay said existing source material blocks on said timeline. The method of displaying available source material for editing as claimed in any one of the preceding claims, wherein the step of selection of a re-edit function (214, 215, 221, 225, 227) comprises the step of selecting a first trim function (227), wherein the first trim function (227) permits selection of a new tail and head point for an existing source material block so as to alter positions of said adjacent source material blocks on said timeline. The method of displaying available source material for editing as claimed in claim 8 further comprising the steps of: selecting a right and a left view of said source material block selected; displaying, in response to selection of said left view, available source material for said source material block selected residing left of said point indicated by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; advancing said source material block selected along said timeline; selecting a tail point on said source material block selected when said tail point desired is within said point indicated and said left view is selected; displaying, in response to selection of said right view, available source material for said source material block selected residing right of said point indicated by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; selecting a head point on said source material selected when said head point desired is within said point indicated and said right view is selected; terminating said first trim function; and displaying said trimmed source material upon termination, from said head point to said tail point, on said timeline so as to alter positions of said adjacent other source material blocks on said timeline. The method of displaying available source material for editing as claimed in any one of the preceding claims, wherein the step of selecting a re-edit function (214, 215, 221, 225, 227) comprises the step of selecting a second trim function (225), wherein said second trim function permits selection of a new tail point for said selected source material block and selection of a new head point for a second existing and adjacent source material block so as not to affect the position on the timeline of further adjacent source blocks. The method of displaying available source material for editing as claimed in claim 10 further comprising the steps of: displaying said available source material required for re-editing said source material block selected by distinguishing said source material block selected and said second existing source material block from said other source material blocks on said timeline by size, colour and relative layering; advancing said source material block selected along said timeline so as to change relative positioning of said second existing source block; selecting changing source material on said source material block selected when a tail or head point desired is within said point indicated; terminating said second trim function; and displaying said source material block selected and said second existing source material block on said timeline to reflect the selection of said new head or tail point on said source material block selected and said second existing source block. The method of displaying available source material for editing as claimed in any one of the preceding claims, wherein the step of selection of a re-edit function (214, 215, 221, 225, 227) comprises the step of selecting a third trim function (227), wherein said third trim function (227) permits selection of a new tail and head point simultaneously for said source material block selected. The method of displaying available source material for editing as claimed in claim 12 further comprising the steps of: displaying said available source material required for re-editing said source material block selected by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; advancing said source material block selected along said timeline in a forward and reverse directions; selecting a head/tail point on said source material block selected when said head/tail point desired is within said point indicated; terminating said third trim function; and displaying said trimmed source material block selected on said timeline reflecting selection of said head/tail point on said source material block selected. A computer controlled editing apparatus for editing a multi-media production including a central processing unit (CPU) (24) coupled to a display device (50), for displaying available source material for editing, comprising: storage means (32, 34) coupled to said CPU for storing a plurality of source logs for identifying all the available source material for editing by said computer controlled editing system, each log comprising a start point and an end point of a portion of the available source material; graphical user interface (GUI) means coupled to said CPU, storage means and said display device for providing a man to machine interface for said computer controlled editing system, said GUI means comprising at least one timeline (210) and a plurality of source material blocks (205, 208), each block representing a portion of said source material, and each block having a head point and a tail point, said head and tail points of each source material block defining up to all source material identified by said corresponding source log, said GUI means further comprising: means for displaying on said display device, a sequence of a plurality of said source material blocks on said at least one timeline such that a tail point of a first source material block is adjacent to a head point of a subsequent source material block on said or each said timeline, and selection means (52, 214, 221, 225, 227) for selecting a re-edit function by selecting a source material block (205, 208) to be re-edited including a means for indicating a point (212) on said source material block selected for which re-edit is desired, and for displaying, on said display device upon selection of said re-edit function available source material required for said re-edit function selected and corresponding to said source block selected and said point indicated and distinguishing said available source material from the other source material blocks on said timeline by size, colour and relative layering. The apparatus for displaying available source material for editing as claimed in claim 14, wherein said graphical user interface means comprises a plurality of sequences of source material blocks showing time interrelationships, each of said plurality of sequences of source material blocks representing one track for a multi-track production to be displayed on one timeline. The apparatus for displaying available source material for editing as claimed in claim 14 or 15, wherein said selection means comprises a timeline cursor extending through said source material blocks on said timeline. The apparatus for displaying available source material for editing as claimed in claim 14, 15 or 16, wherein said means for selecting a re-edit function comprises means for selecting a first insert function (214), wherein said first insert function permits insertion of new source material at said point indicated. The apparatus for displaying available source material for editing as claimed in claim 17 further comprising: means for displaying said source material required for said re-edit function selected, starting at said point indicated, for which insertion is desired; means for advancing said source material along said timeline; means for selecting a head point on said required source material when said head point desired is within said point indicated; means for advancing said source material along said timeline while displaying said source material block selected at said point indicated separated from a subsequent source material block on said timeline; means for selecting a tail point on said required source material when said tail point desired is within said point indicated; means for terminating said first insert function; and means for displaying said required source material, from said head point to said tail point, on said timeline starting at said point indicated such that said plurality of source material blocks are displayed in a continuous sequence. The apparatus for displaying available source material for editing as claimed in any one of claims 14 to 18, wherein said means for selecting a re-edit function comprises means for selecting a second insert function, wherein said second insert function permits overlay of new source material onto existing source block material. The apparatus for displaying available source material for editing as claimed in claim 19 further comprises: means for displaying said new source material, starting at said point indicated, for which overlay is desired by distinguishing said new source material from said source material blocks on said timeline by size, colour and relative layering; means for advancing said new source material along said timeline; means for selecting a head point on said new source material when said head point desired is within said point indicated; means for selecting a tail point on said new source material when said tail point desired is within said point indicated; means for terminating said second insert function; and means for displaying said new source material upon termination, from said head point to said tail point, on said timeline starting at said point indicated so as to overlay said existing source material blocks on said timeline. The apparatus for displaying available source material for editing as claimed in any one of claims 14 to 20, wherein said means for selecting a re-edit function comprises means for selecting a first trim function, wherein said first trim function permits selection of new tail and head point for an existing source material block so as to alter positions of said adjacent source material blocks on said timeline. The apparatus for displaying available source material for editing as claimed in claim 21 further comprising: means for selecting a right and left view of said source material block selected; means for displaying, in response to selection of said left view, available source material for said source material block selected residing left of said point indicated by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; means for advancing said source material block selected along said timeline; means for selecting a tail point on said source material block selected when said tail point desired is within said point indicated and said left view is selected; means for displaying, in response to selection of said right view, available source material for said source material block selected residing right of said point indicated by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; means for selecting a head point on said source material selected when said head point desired is within said point indicated and said right view is selected; means for terminating said first trim function; and means for displaying said trimmed source material upon termination, from said head point to said tail point, on said timeline so as to alter positions of said adjacent other source material blocks on said timeline. The apparatus for displaying available source material for editing as claimed in anyone of claims 14 to 22, wherein said means for selecting a re-edit function comprises means for selecting a second trim function, wherein said second trim function permits selection of a new tail point for said source material block selected and selection of a new head point for a second existing and adjacent source material block so as not to affect positioning on the timeline of further adjacent source blocks. The apparatus for displaying available source material for editing as claimed in claim 23 further comprising: means for displaying said available source material required for re-editing said source material block selected by distinguishing said source material block selected and said second existing source material block from said other source material blocks on said timeline by size, colour and relative layering; means for advancing said source material block selected along said timeline so as to change relative positioning of said second existing source block; means for selecting changing source material on said source material block selected when a tail or head point desired is within said point indicated; means for terminating said second trim function; and means for displaying said source material block selected and said second existing source material block on said timeline to reflect the selection of said new head or tail point on said source material block selected and said second existing source block. The apparatus for displaying available source material for editing as claimed in any one of claims 14 to 24, wherein said means for selecting a re-edit function comprises means for selecting a third trim function, wherein said third trim function permits selection of a new tail and head point simultaneously for said source material block selected. The apparatus for displaying available source material for editing as claimed in claim 25 further comprising: means for displaying said available source material required for re-editing said source material block selected by distinguishing said source material block selected from said other source material blocks on said timeline by size, colour and relative layering; means for advancing said source material block selected along said timeline in a forward and reverse directions; means for selecting a head/tail point on said source material block selected when said head/tail point desired is within said point indicated; means for terminating said third trim function; and means for displaying said trimmed source material block selected on said timeline reflecting selection of said head/tail point on said source material block selected.

Inventors: DUFFY ROBERT, MORGAN O F, DUFFY, ROBERT, MORGAN, O. F.
Applicants: SONY ELECTRONICS INC, SONY ELECTRONICS INC.
Application year: 1994
Main classification: H04N5
IPC codes: G06T11, G06F17, G11B27, G06F3