System and method for visual editing

The invention is directed to a system and method for visual editing of an input signal. Accordingly, it includes an editing device comprising a device screen, a media module, a user input module, and an output module. The media module receives an input signal which includes at least one visual component. The device screen comprises a source screen and a delay screen, wherein the input signal is displayed on the source screen in real time, and the input signal is displayed on the delay screen in delay time, with the delay time being adjustable. The user input module allows the user to create at least one clip comprising a portion of the input signal as it is displayed on the delay screen. The output module is structured to output the clip.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a system and method for visual editing of an input signal using a source screen displaying the input signal in real time and a delay screen displaying the input signal in delay time.

Description of the Related Art

Video editing is the process of editing segments of video footage, special effects, and sound recordings. Video editing typically occurs in a post production process, after the filming is complete. In this process, relevant clips of the raw footage or data are cut and then pieced together in a viewable and coherent format, and may further include other signal processing and other enhancements.

As such, traditional video editing requires the user to first capture the raw video footage and/or sound recordings. The user must then transport or transmit the raw data from the capture or source device to a video editor or program for post production. Further, in order to determine which segments of the raw data to use in a resulting clip, the user is required to watch, rewind, or fast forward to track the starting points and end points of each portion to be extracted.

As such, there is a need for an improved system and method which enables a user to selectively create clips from a raw data source, while overcoming disadvantages and problems of the type set forth above.

SUMMARY OF THE INVENTION

The present invention is directed to a system and method for visual editing of an input signal, wherein the input signal may comprise a video signal and/or a visual representation of a non-video signal, such as, by way of example only, a visual representation of an audio signal, an EKG, a speed profile, a direction profile, a temperature profile, etc., such as lends itself to a visual representation in real time that may be displayed on a device screen. Specifically, in at least one embodiment, the present invention enables visual editing of a signal through use of a source screen that visually displays the input signal in real time, and a delay screen that visually displays the input signal in delay time. This allows a user to selectively extract or edit portions of an input signal while watching the input signal as displayed on the delay screen, in order to create a clip from the input signal.

As such, at least one embodiment of the present invention comprises an editing device including a media module, a device screen, a user input module, and an output module.

The media module is structured to receive an input signal from a signal source, and in one embodiment, the signal source may comprise a video camera, a digital video camera, a computer, a server, a mobile electronic device, a camera, an electrocardiograph device, another editing device, or another device capable of transmitting an input signal to the media module.

In one embodiment of the present invention, the device screen comprises a source screen and a delay screen. The source screen is structured to display the input signal in real time. The delay screen is structured to display the input signal in delay time. The source screen and delay screen may be displayed on the device screen in different configurations, in at least one embodiment.

The user input module, in accordance with one embodiment of the present invention, is structured to allow a user to select an input signal for display on both a source screen and a corresponding delay screen. The user input module may also allow the user to change the configurations of the source screen and the delay screen as displayed on the device screen. The user input module, in at least one embodiment, further allows the user to initiate recording of a clip of the input signal as displayed on the delay screen, as well as to pause or terminate recording of the clip. The user may also set or adjust the delay time of the delay screen through the user input module, in accordance with one embodiment of the present invention. For instance, if the user misses the portion that he or she wishes to record, the user may increase the delay interval so that the portion is displayed again in the delay screen.

In accordance with at least one embodiment of the present invention, the output module is structured to transmit a clip to an output device, and in one further embodiment, the output device comprises an internal memory of the editing device itself. In at least one embodiment, the clip comprises a digital media file, and may be transmitted as a stream or feed to one or more output devices, which may comprise an external device or an internal memory of the editing device itself.

DETAILED DESCRIPTION

As stated above, the present invention is directed to a system for visual editing of an input signal, generally as shown as200throughout the figures, as well as a method for visual editing of an input signal, generally shown as300throughout the figures.

FIG. 1is a diagrammatic representation of one embodiment of a system200for visual editing of an input signal150in accordance with the present invention. The system200as shown inFIG. 1comprises a signal source110structured at least in part to transmit an input signal150to an editing device10, wherein the input signal150comprises at least one visual component, and in at least one embodiment, the input signal150comprises a video signal and/or a visual representation of an audio signal. The editing device10is structured at least in part to display and at least temporarily store an input signal150transmitted thereto. As such, in at least one embodiment, the editing device10includes a processor101and/or a memory102. In one further embodiment, an editing device10comprises a device screen100disposed in a communicative relationship with a media module103, a user input module104, and/or an output module105. The processor101and memory102are structured to allow the modules103,104, and/or105to operatively communicate with one another, as well as with the device screen100. The output module105, in at least one embodiment, is structured at least in part to at least temporarily store a clip160comprising one or more portions of an input signal150.

In accordance with at least one embodiment of the present invention, the editing device10comprises, but is in no manner limited to, a video camera, a digital video camera, a computer, a cell phone, a smart phone, a tablet, or another mobile electronic device capable of displaying an input signal150. In one further embodiment, the editing device10comprises a wearable device, such as, once again by way of example only, glasses or visors, watches, or other electronic accessories capable of displaying an input signal150.

A signal source110in accordance with the present invention comprises a device capable of transmitting an input signal150having at least one visual component. For instance, in one embodiment, the signal source110comprises a computer, a server, or a mobile electronic device which transmits an input signal150to an editing device10, and more in particular, to a media module103of the editing device10. In another embodiment, the signal source110comprises a video camera or a web camera which transmits an input signal150comprising live video to the editing device10, and in one further embodiment, the signal source110comprises a video camera built into the editing device10itself. In another embodiment, the signal source110is a memory module, storage medium, or the like of an editing device10, wherein the editing device10receives an input signal150from a signal source110comprising storage medium and circuit pathways of the editing device10itself. In at least one further embodiment, the signal source110comprises another editing device10.

As previously stated, in at least one embodiment, a media module103is structured to receive an input signal150from a signal source110. In one embodiment, a media module103is capable of receiving an input signal150from any of a plurality of signal sources110. In one further embodiment, a media module103concurrently receives a different one of a plurality of input signals150from each of a corresponding plurality of different signal sources110. The media module103is structured to play different digital files, streams, and live feeds, and as such, in at least one embodiment, the media module103comprises hardware and software, such as video and audio codecs, required to decode and display different input signals150to a device screen100.

In accordance with one embodiment of the present invention, the device screen100comprises at least one source screen12and at least one delay screen14. The device screen100is capable of displaying both a source screen12and a delay screen14concurrently, with each of the source screen12and the delay screen14comprising at least a portion of the device screen100, such as is shown in the illustrative embodiment ofFIG. 2. At least one other embodiment of the present invention comprises a plurality of device screens100, wherein one device screen100is integral with an editing device10itself, and another device screen100is separate and/or remote from the editing device10, such as, by way of example only, a first device screen100on a digital video camera, and a second device screen100comprising a remote monitor disposed in a communicative relationship with the editing device10via a wired or wireless connection.

The source screen12, in at least one embodiment, is structured to display an input signal150in real time. As used herein, “real time” shall mean that an input signal150is transmitted from a signal source110to a media module103and is displayed on a source screen12, without a perceivable time delay to a user.

In at least one further embodiment, a delay screen14is structured to display an input signal150in delay time. As used herein, “delay time” shall mean the period of time between the live or “real time” display of an input signal150from a signal source110on a source screen12, and the display of the input signal150, which in at least one embodiment is at least temporarily stored in a buffer of memory102of the editing device10, on a delay screen14. In at least one embodiment, the delay time is preset, for example, a delay time of eight seconds, however, the delay time can be reset or adjusted by a user. In one embodiment, a user adjusts a delay time via a user input module104, and in one further embodiment, the delay time is reset or adjusted during the display of an input signal150on a source screen12and/or a delay screen14.

The user input module104, in at least one embodiment of the present invention, is structured to allow a user to select an input signal150for display on at least one source screen12in real time and on at least one delay screen14in delay time. In an embodiment having a plurality of input signals150and a device screen100having a plurality of source screens12, such as shown in the illustrative embodiment ofFIG. 6, a user input module104further allows a user to selectively display different ones of the plurality of input signals150on different ones of the plurality of source screens12and correspondingly different ones of a plurality of delay screens14. Further, a user input module104allows a user to select different display configurations of a source screen12and a delay screen14on a device screen100.

In at least one embodiment, a user input module104also allows a user to effect editing of an input signal150as it is displayed on a delay screen14. A user input module104allows a user to create at least one clip160comprising at least a portion of an input signal150as it is displayed on a delay screen14. In at least one embodiment, a user input module104allows a user to initiate recording of a clip160of an input signal150as it is displayed on a delay screen14, based on the visual image the user previously viewed on a source screen12.

More in particular, in at least one embodiment, a user views a display of an input signal150in real time on a source screen12, and when he or she views a portion or scene which he or she wishes to keep, the user can initiate recording a clip160of the input signal150at the start of the same scene just as or just prior to the scene being displayed on the delay screen14, because the user knows when the scene will begin as he or she just viewed it in real time on the source screen12. In one further embodiment, a user may be viewing live action which is being captured and transmitted to an editing device10as an input signal, and, as before, the user can initiate recording a clip160of the input signal150at the start of an event the user just saw as it is being displayed on the delay screen14, because the user knows when the event begins as he or she just watched it occur.

In at least one embodiment, the user input module104also allows the user to pause recording of the clip160, and in one further embodiment, the user input module104allows the user to resume recording to the same clip160. In one further embodiment, recording of the clip160continues while the image on the delay screen14is paused. In yet another embodiment, the input signal150is displayed on delay screen14in slow motion, in order to allow more accurate editing, or in fast motion, in order to catch up to the source screen12display once recording has been initiated, however, in this embodiment, the clip160will capture the portion of the input signal150for playback in normal speed. In yet one further embodiment, the input signal150is displayed on delay screen14in slow motion or fast motion, and the clip160will capture the portion of the input signal150for playback in either slow motion or fast motion, exactly as it was displayed on delay screen14.

In one further embodiment, the user input module104also allows the user to terminate recording of the clip160. In at least one embodiment, upon termination of recording the clip160is at least temporarily stored on the editing device10, such as, for example, in memory102, and in one further embodiment, the clip160is automatically transferred to an output device120via an output module105.

The user input module104in accordance with at least one embodiment of the present invention further allows the user to set or adjust a delay time for display of an input signal150on a delay screen14. More in particular, in one embodiment, the user sets or adjusts a delay time while an input signal150is displayed on a source screen12, or a delay screen14, or both. In another embodiment, a user sets or adjusts a delay time while an input signal150is being edited. In one further embodiment, a user input module104comprises one or more of physical buttons, touch capacitive sensing on a touchscreen input100′, motion tracking or sensing, voice activation, and/or remote input from another device.

The output module105, in at least one embodiment, is structured to transmit a clip160to an output device120. The clip160comprises at least a portion of an input signal150created by the editing device10. The output device120, in at least one embodiment, comprises a memory102of the editing device10, such as an internal hard disk, an attached memory card, embedded nonvolatile flash memory, or other such storage. The output device120, in one further embodiment, comprises remote storage such as a server or cloud storage provider accessible through a communication network such as the Internet. The output module105, in one embodiment, transmits a clip160in raw format, and in at least one other embodiment, the output device105encodes the clip160with at least one codec, and/or prompts the user to select what file type or compression format in which to transmit the clip160. As one example, the output module105is structured to process and encode the clip in one of Xvid, DivX, MPEG, H.264, WMV, WMA, MP3, MP4, etc.

In at least one embodiment, an output module105transmits a clip160in a stream or live feed format. In at least one embodiment, the output device120comprises a computer, server, television, video monitor, tablet, audio player, or mobile electronic device. In one other embodiment, the output device120comprises another editing device10. This allows multiple users to edit an input signal150in a cascading fashion. For example, a first user edits an input signal150on a first editing device10during a sporting event and transmits a first clip160to one or more second editing device10via output module105. The second editing device10receives the first clip160and the second user edit the first clip160thereby creating a second and further edited clip160. In at least one embodiment, the output module105of the first editing device10first transmits the first clip160to a remote server, and other editing devices10download or stream an input signal150consisting of the first clip160from that remote server.

The output module105is triggered upon a termination event which, in at least one embodiment, comprises a user input via the user input module104, e.g., actuation of a stop button. In at least one embodiment, the output module105automatically saves a clip160upon reaching the end of an input signal150. In one further embodiment, the output module105automatically saves a clip160upon a time out request, or an operational error, such as, but not limited to, a camera malfunction, low battery, or software crash.

As previously stated, the editing device10may comprise, but is not limited to, a mobile electronic device, a phone, or a tablet. In this embodiment, the editing device10comprises a device screen100. The device screen100illustrates a side by side configuration of the source screen12and the delay screen14. The device screen100further comprises a touchscreen input100′ including recording controls21, delay controls25, and playback controls29, such as is illustrated in the embodiment ofFIG. 2.

Playback controls29, in at least one embodiment, comprise a playback slide bar29′ used to select a portion of an input signal150to be displayed on a source screen12. Playback controls29in one further embodiment comprise playback buttons29″ including a play button to initiate playback of an input signal150, and a pause button to at least temporarily pause the playback of an input signal150. In at least one embodiment, the playback controls29are present only when the input signal150comprises a digital media file or a media stream. In another embodiment having an input signal150comprising a live feed, playback controls29are not necessary and are therefore not displayed. However, in at least one other embodiment, the editing device10retains a buffer of a live feed, and as such, playback controls29are operational in such an embodiment.

Delay controls25, in at least one embodiment, comprise a delay slide bar25′ used to adjust a delay time for the display of an input signal150on a delay screen14. The delay time shown inFIG. 2ranging from 8 seconds and 30 minutes is for illustrative purposes only and is not limiting, as greater or lesser delay time limits and/or ranges are within the scope and intent of the present invention. Delay controls25in one further embodiment of the present invention comprise delay adjustment buttons25″ which are operative to incrementally increase or decrease a delay time. In at least one embodiment, the delay adjustment buttons25″ allow the display of the input signal150on the delay screen14to be at least temporarily paused. In at least one embodiment, while the delay screen14is paused, the delay time automatically increases if the source screen12continues to display the input signal150. In another embodiment, the delay controls25furthers comprise a delay increment button25′″ to increase delay time in a preset interval which, in at least one embodiment, is selected and/or adjusted by the user. In one further embodiment, delay controls25are locked out when the editing device10is recording, while in one further embodiment, the delay controls25remain operative when the editing device10is recording.

Recording controls21, in at least one embodiment, comprise a record button, a pause button, and a stop button, as shown best inFIG. 2. As such, a user may begin recording a clip160, pause recording of a clip, and stop recording a clip160as an input signal150is displayed on the delay screen14. In at least one embodiment, a user can pause recording of a clip160and later resume recording to the same clip160.

Looking next to the illustrative embodiments ofFIGS. 3A through 3D, it is seen that the device screen100of the editing device10can present at least one source screen12and at least one delay screen14in various display configurations. As one example,FIG. 3Aillustrates a source screen12only configuration, wherein the source screen12comprises substantially the entire device screen100. As another example,FIG. 3Billustrates a delay screen14only configuration, wherein the delay screen14comprises substantially the entire device screen100.FIG. 3Cillustrates an example of a source screen12picture-in-picture configuration, wherein the source screen12comprises only a portion of the device screen100while the delay screen14comprises the remainder of the device screen100. Lastly,FIG. 3Dillustrates a delay screen14picture-in-picture configuration, wherein the delay screen14comprises only a portion of the device screen100while the source screen12comprises the remainder of the device screen100. A user may switch between various display configurations of the source screen12and the delay screen14via touchscreen input100′. In at least one embodiment, the user may switch between the various display configurations using a swiping motion via touchscreen input100′, and in one further embodiment the display configuration is affected by “pinching” a portion of the touchscreen input100′. In at least one other embodiment, a user may switch between various display configurations using input such as motion sensing or tracking, i.e., shaking the editing device10, flipping the editing device10, voice command, etc.

Looking next to the illustrative embodiment ofFIG. 4, an input signal150comprises an audio signal, and a visual representation of an audio signal30,30′ are displayed on source screen12and delay screen14, respectively. As displayed on the source screen12, the visual representation of an audio signal30is shown in real time, and as displayed on the delay screen14, the visual representation of an audio signal30′ is shown in delay time. The visual representations of an audio signal30,30′ may comprise waveforms, such as shown inFIG. 4. In one further embodiment, visual markers, such as a delay time line tag34,36indicating where sound occurs in a video display to assist a user in editing an input signal150based on an audible component, such as, a sound occurring by something or someone off screen and not visually perceivable in the source screen12or delay screen14. In at least one embodiment, a delay time line tag34,36, as shown inFIG. 2, is inserted by tapping the touchscreen input100′ on source screen12during display of an input signal150thereon in real time, and in one other embodiment, a button or similar control is operable to insert one or more delay time line tag34,36. In one further embodiment, a visual marker is keyed to particular frequencies and/or amplitudes of sound to assist the user in editing of the input signal150. In at least one embodiment, the visual representations of an audio signal30,30′ are displayed concurrently with another visual component, such as a video signal. The visual representations of a signal are not limited to audio signals, but may comprise other signals such but not limited to EKG, temperature, direction, speed, etc.

As illustrated inFIG. 5, at least one embodiment of the present invention comprises a plurality of editing devices10. In the illustrative embodiment ofFIG. 5, at least one editing device10acts as a signal source110and transmits an input signal150to each of a plurality of different editing devices10. The user of the signal source110focuses on recording operations, while the user of each of the plurality of editing devices10focuses on editing an input signal150from the signal source110.

As one example, a user of a signal source110records a high school football game, and the user of each of a plurality of different editing devices10receives an input signal150from the signal source110. Further, each user edits the input signal150to create a different clip160, wherein the clip160created by each user consists of video highlights of different players.

In one alternative embodiment, a plurality of signal sources110record from different vantage points, and each of the plurality of signal sources110transmits an input signal150to an editing device10, to allow simultaneous editing of multiple input signals150. As just one example, a plurality of signal sources110are setup at different angles and locations to record a football game, and each signal source110transmits a different input signal150to an editing device10. A user of the editing device10can select one of the plurality of different input signals150and edit one of the plurality of different input signals150to create a clip160having a duration of 10 seconds, and the editing device10will simultaneously create a clip160of the same 10 seconds from each of the remaining plurality of different input signals150. This allows a clip160of the exact same event, e.g., the exact same 10 second interval, to be viewed from different perspectives. In at least one embodiment, the signal sources110and editing devices10are linked together via wired or wireless communication, such as via LAN, WiFi, Bluetooth, or other communication technologies.

FIG. 7is a diagrammatic representation of one illustrative embodiment of a method for visual editing of at least one input signal on an editing device having a device screen300. In the embodiment ofFIG. 7, a user selects310at least one input signal comprising at least one visual component. The input signal may be stored locally on the editing device, connected to or in communication with the editing device, or streamed across a communication network such as the Internet.

A device screen is partitioned320into a source screen and a delay screen, in accordance with one embodiment of the present invention. The source screen and the delay screen can be displayed either concurrently or separately on the device screen. The user selects between a plurality of different display configurations including, but not limited to, source screen only, delay screen only, side by side, source screen picture-in-picture, delay screen picture-in-picture, etc., as described above with reference toFIGS. 3A through 3D.

In at least one embodiment of the present method300, an input signal is displayed330on the source screen in real time. In the case where the input signal comprises an audio component, a visual representation of the audio signal is displayed on the source screen. In at least one further embodiment, an input signal is then displayed340on the delay screen in delay time. The delay time is preset, however, in at least one embodiment, a user can reset a delay time tailored to a particular user's reaction time. The user can adjust the delay time on the editing device during the display playback of the input signal. In at least one embodiment, a user adjusts the delay time during recording of a clip. In one further embodiment, when a user adjusts the delay time during playback of the input signal on the editing device, the display of the input signal on the delay screen adjusts correspondingly to the new delay time.

A user initiates recording350of a clip of an input signal based on the replay of a visual image displayed on a delay screen in accordance with one embodiment of the present method300. In at least one further embodiment, the user pauses and resumes recording at any time to selectively record only those desired portions of the input signal, which the user has previously viewed either live or as displayed on a source screen, thus allowing visual editing of the input signal. In at least one embodiment, the pausing and resuming operations will not create a plurality of clips, but rather results in a single, composite clip.

In accordance with one further embodiment of the present method300, a user terminates360recording of a clip of the input signal as displayed on the delay screen. Subsequently, the clip is output370. In another embodiment, termination360results in a clip being output370automatically. In another embodiment, termination360results in prompting the user on how or where to output370the clip. In at least one embodiment, output370of a clip further includes encoding the clip with at least one codec. The user further selects the codecs and/or file format in which the clip is output370. Output370may further comprise, by way of example only, saving a clip in the internal memory102of the editing device, to an attached storage medium, to a storage medium in communication with the editing device, or to a server such as a cloud storage provider or social media provider over the Internet.

Now that the invention has been described,