Source: http://www.google.com/patents/US6473096?dq=6462713
Timestamp: 2016-10-22 05:50:54
Document Index: 569858136

Matched Legal Cases: ['art 4', 'art 8', 'art 8', 'art 8', 'art 8', 'art 8', 'art 14', 'art 14', 'art 7', 'art 4', 'art 4', 'art 12', 'art 11', 'art 13', 'art 11', 'art 13', 'art 13', 'art 14', 'art 14', 'art 14', 'art 12']

Patent US6473096 - Device and method for generating scenario suitable for use as presentation ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsDescribed herein are a device and a method of generating a scenario used for presentation materials. A descriptive operation input part is used to perform descriptive operation while contents retained in a contents holding part is being reproduced and operated under control by a contents reproducing...http://www.google.com/patents/US6473096?utm_source=gb-gplus-sharePatent US6473096 - Device and method for generating scenario suitable for use as presentation materialsAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS6473096 B1Publication typeGrantApplication numberUS 09/386,365Publication dateOct 29, 2002Filing dateAug 31, 1999Priority dateOct 16, 1998Fee statusPaidPublication number09386365, 386365, US 6473096 B1, US 6473096B1, US-B1-6473096, US6473096 B1, US6473096B1InventorsYuji Kobayashi, Nobuo Suzuki, Tooru IshigakiOriginal AssigneeFuji Xerox Co., Ltd.Export CitationBiBTeX, EndNote, RefManPatent Citations (7), Referenced by (43), Classifications (23), Legal Events (4) External Links: USPTO, USPTO Assignment, EspacenetDevice and method for generating scenario suitable for use as presentation materials
US 6473096 B1Abstract
Described herein are a device and a method of generating a scenario used for presentation materials. A descriptive operation input part is used to perform descriptive operation while contents retained in a contents holding part is being reproduced and operated under control by a contents reproducing part. A history indicative of the descriptive operations is retained in a descriptive operation history holding part and speaker information from a speaker information input part is retained in a speaker information holding part. In a scenario generation processing part, a history information separating part separates the history information related to the descriptive operations into information. Based on the separated information, a descriptive operation contents generating part generates tool-operation reproducing contents, which is in turn retained in a descriptive operation contents holding part. A scenario output part generates a basic scenario, based on history information related to control operations and adds the relationship of synchronism and reproduction between the descriptive operation contents and the speaker information to the basic scenario to thereby complete a scenario.
As to the presentation executed while such a multimedia title is being reproduced by the computer, there is known “Multimedia Processing Device” disclosed in Japanese Published Unexamined Patent Application No. Hei 8-115335, for example. A command bar acts as an important role when the presentation is performed in real time. In the present example, however, information about the multimedia title is described in a work in advance to utilize a pointing device as the effective command bar upon reproduction of the multimedia title, and a display image of the pointing device is controlled synchronously with the contents of the work upon reproduction, whereby screen operations under the presentation are made more effective. Further, a progress control command such as form feed or the like is associated with voice data of an explainer and recognized and executed from the voice of the explainer, thereby making it possible to smoothly perform a screen operation of the presentation.
On the other hand, an attempt has been made to simplify authoring requiring an advanced speciality to some extent. As an example thereof, there is known, for example, “Multimedia Presentation Edit Execution Device” described in Japanese Published Unexamined Patent Application No. Hei 8-147264. In the present example, a multimedia title can be created without programming in accordance with a system for inputting and setting reproduce/display timings of respective multimedia contents utilizing an interface having minimized a keyboard input and a human sense of time elapse, i.e., each scene changeover operating timing actually done by a human without a special sense of authoring.
As to the authoring which imagines such a presentation done asynchronously and on the non-facing basis, there is known “Method for Constituting Multimedia Presentation Materials and System therefor” described in Japanese Published Unexamined Patent Application No. Hei 8-180036, for example. The present example provides an authoring system wherein presented conditions such as presented magnifications, presented time, etc. for all the presented materials used as a base are set and registered, and attached materials for processing the presented materials every present materials are next created, set and registered, and scenario files in which the contents of processing of the presented conditions and presented time are edited in time sequence every materials presented from the registered data, are then set and registered, whereby the daily-created materials can be utilized as they are and the special technique becomes unnecessary.
With the foregoing in view, it is therefore an object of the present invention to provide a device and a method for generating a scenario suitable for use as presentation materials, wherein a multimedia title for a presentation done asynchronously and on a non-facing basis over a network can be generated by a method similar to daily-executed presentation action without a sense of authoring action to the utmost.
“START (scenario ID)” indicates the start of the simulated presentation. This is received upon clicking of the start button 34. [Scenario ID] indicates an identifier automatically given by the system. This is associated with the voice information retained in the speaker information holding part 4.
“END (scenario ID)” indicates the end of the simulated presentation. This is received upon clicking of the end button 35.
“PlayStart (PlayID, name of contents, display frame No.)” represents that a file indicated by the [name of contents] has started to reproduce at a sub-frame indicated by the [display frame No.]. [PlayID] indicates an identifier automatically given from the system.
“PlayEnd (PlayID)” indicates the end of reproduction of [PlayID].
“PlayControl (PlayID, Control Code)” represents that control on [Control Code] has been performed on the reproduction of [PlayID].
“ToolOn (locus dataID, name of Tool, PlayID)” shows that a presentation tool of [Name of Tool] has started to perform descriptive operations on the reproduction of [PlayID]. [Locus dataID] is automatically given from the system. The coordinates of the position of the presentation tool are recorded in locus data associated with the locus dataID at predetermined time intervals.
“ToolEnd (locus dataID)” indicates the completion of utilization of a presentation tool. At this time, the recording of the coordinates in [locus dataID] is terminated.
FIG. 6 is a timing chart showing event sequences related to control operations. According to the timing chart, reproduced contents are represented side by side in time sequence every subareas. Namely, a “subarea No. 1” indicates that “Text01” is reproduced subsequently to the reproduction of “Image01” and some control operations are performed while “Text01” is being reproduced. A “subarea No. 2” indicates that the reproduction of “Mov01” is started after the starting of reproduction of “Image01” and its reproduction is terminated after the completion of reproduction of “Text01”.
FIG. 7 is a diagram showing the example of the basic scenario generated from the history information of the event sequences about the control operations. In the basic scenario 52 shown in FIG. 7, an element A is represented by a range from a start tag <A> to an end tag </A>. However, when the element does not include other elements thereinside, the end tag is omitted. When an element B has attributes C and D and their attribute values are defined as c and d respectively, their relations are given as <B C=“c”, D=“d”>.
In the basic scenario 52 shown in FIG. 7, a <scenario> element comprises a <head> element and a <Body> element. The <head> element includes two <Window> elements. The <Window> elements define windows for reproducing contents and are referred to by attribute values of names respectively. In the above-described example, a Window indicated by Win1 shows a Window of the “subarea No. 1”, and a Window indicated by Win2 shows a Window of the “subarea No. 2”, respectively.
The <Image> element, <Text> element and <MOVE> element indicate contents and have reproduction conditions as attributes, respectively. An attribute value of a “File” attribute is a reproduced file name. An attribute value of a “delayed time” attributes corresponds to the time required to start the reproduction of a parent element with the start of reproduction of the parent element as a start point. Further, an attribute value of a “Window” attribute corresponds to a name attribute value of the <Window> element. An attribute value of a “display time” attribute corresponds to the time required to continue the reproduction of the corresponding element. Moreover, an attribute value of a “control” attribute corresponds to a control execution time with the time required to start the reproduction of the corresponding element as a start point, and a control code provided for the reproduction of the corresponding element.
As described above, subareas utilized for the reproduction are first detected from the above-described event sequences related to the control operations and are defined as <Window> elements lying within a <head> element. Next, a <parallel> element is defined within a <Body> element and reproductions in respective subareas are defined within the <parallel> element. When a plurality of reproductions are performed within one subarea at this time, they are defined as elements lying within a <sequential> element. Finally, the contents of a “PlayControl” event is described in a “control” attribute of an element to be controlled. From the above, the basic scenario 52 is generated from the event sequences related to the control operations.
FIG. 8 is a diagram showing history information of event sequences related to descriptive operations. According to the event sequences of the history information 53 illustrated herein, the separation of two descriptive operations from the history information 50 shown in FIG. 4 is illustrated. Here, description information held at data ID=Tool01 as viewed from “PlayID” corresponds to a description for Image01.jpg, whereas description information held at data ID=Tool02 as viewed therefrom corresponds to a description for Mov01.mov.
Two locus data ID of “Tool01” and “Tool02”, locus data associated with the respective locus data ID, and their corresponding Tool names are delivered from the history information 53 to the descriptive operation contents generating part 8 for generating each motion picture used to reproduce the operation of a presentation tool, whereby the generation of motion picture data for command bars corresponding to the respective locus data ID is required of the descriptive operation contents generating part 8. At this time, a file name generated by the descriptive operation contents generating part 8 is defined as” “each locus data ID”. mov”. Thus, a motion picture file name corresponding to the locus data ID=Tool01 generated by the descriptive operation contents generating part 8 results in Tool01.mov, whereas a motion picture file name corresponding to the locus data ID=Tool02 results in Tool02.mov. Coordinate positions lying within subareas for presentation tools at 0.1 second intervals, for example, are recorded in each locus data. The descriptive operation contents generating part 8 applies an animation effect to a display image corresponding to a Tool name by using the locus data to thereby create motion picture data. Simultaneously with this, the scenario output part 14 performs a process for generating <MOVE> elements corresponding to the respective data ID and embedding them in a basic scenario. The result of the embedding process is shown in FIG. 9.
In order to display movements of command bars represented as motion pictures so as to overlay contents to be described, new windows Win11 and Win21 are defined and layers are specified as 1. Win1 and Win11 are windows identical in position and size from each other and different in layer alone from each other. Attribute values of “layer” attributes mean that when the values are displayed in overlapped form as they increase, they are represented at the top surface. Further, the added respective <MOVE> elements are respectively defined in parallel relations because it is necessary to reproduce them simultaneously with elements to be described.
Next, the scenario output part 14 of the scenario generation processing part 7 defines the relationship of synchronism and reproduction between the voice data retained in the above-described speaker information holding part 4 in the scenario 54 shown in FIG. 9. A file name of the voice data retained in the speaker information holding part 4 is associated with a scenario ID corresponding to the argument of the START event in the history information 50 illustrated in FIG. 4. Since the argument is “Test01”, the file name of the voice data is given as Test01.wav, for example. Incidentally, the voice data inputted during one simulated presentation is managed by one file. An example in which the definition of the relationship of synchronism and reproduction between the voice data is added to the scenario 54 shown in FIG. 9, is illustrated in FIG. 10.
The noted contents detecting part 12 detects contents that an explainer would focus thereon in regards to their description upon execution of a simulated presentation, i.e., contents to be noted, based on events related to presentation tools 40, which are separated by a history information separating part 11. For example, contents specified by a presentation tool is detected as the contents to be noted. In the example of the event sequences related to the presentation tools 40 in the first embodiment shown in FIG. 8, it is detected that “play01” has been noted by the explainer for 36 seconds between 0:03.54 and 0:04.30 as viewed from records in the second and third lines and “play02” has been noted by the explainer for 36 seconds between 0:05.54 and 0:06.30 as viewed from records in the fourth and fifth lines.
FIG. 13 is a flowchart showing the flow of processing at the detection of contents to be noted. Based on the event sequences related to the control operations shown in FIG. 5, other contents reproduced for a time interval between 0:03.54 and 0:04.30 in which the explainer's note given to play01 reproduced in a “subarea No. 1” is detected (Step S21). In the present example, the reproduction of play02 in a “subarea No. 2” for a time interval between 0:01.00 and 0:08.00 is detected.
Next, the contents are simultaneously reproduced in the “subarea No. 1” and “subarea No. 2” in the present example. Since attention is given to the contents of the “subarea No. 1” of them, the sizes and layout of the Windows are defined as shown in FIG. 12B (Step S22). Thus, two new Windows are added to and defined in the <head> element in the example of the scenario 55 shown in FIG. 10, and a Window for the display of the contents of descriptive operations is additionally defined.
FIG. 14 is a diagram showing a partial scenario in which new Windows are defined. According to the scenario 55 a shown in FIG. 14, three lines marked with asterisks at the beginning of the tops thereof are added lines. Namely, two <Window> elements are first added to a <head> element. Here, the attribute of “adjustment” defines processing at the time that a Window size and an object size differ from each other. An attribute value “fit” means that the object size is automatically controlled so as to coincide with the Window size. A third line marked with an asterisk at the beginning of the top thereof is added as a Window for the display of the contents of descriptive operations.
Next, the reproduction of the contents to be noted is defined (Step S23). Namely, one line which defines the reproduction of the image file “Image01.jpg” of the noted contents in the scenario 55 shown in FIG. 10, is replaced by three reproduction definitions together with a <sequential> element.
FIG. 16 is a diagram showing a partial scenario indicative of the definition for the reproduction of descriptive operation contents relative to noted contents. According to the scenario 55 c shown in FIG. 16, a line marked with an asterisk at the beginning of the top thereof is a modified or changed line. In the line, an attribute value of an attribute “Window” for the display of the descriptive operation contents is changed.
Finally, the reproduction of contents reproduced for the same time interval as that for the noted contents is defined (Step S25). One line, which defines the reproduction of a motion picture file “Mov01.mov” corresponding to another contents defined so as to be reproduced parallel to the noted contents in the scenario 55 shown in FIG. 10, is replaced with a <sequential> element and three reproduction definitions for the motion picture file.
The reproduced contents information detecting part 13 receives therein history information related to control operations separated by history information separating part 11 to thereby detect information about the reproduced contents, i.e., the name of the contents. If the history information about the control operations shown in FIG. 5, for example, is inputted to the reproduced contents information detecting part 13, then the reproduced contents information detecting part 13 searches PlayStart; event and obtains a contents name of the argument thereof. In the example illustrated in FIG. 5, an image file “Image01.jpg”, a text file “Text01.txt”, and a motion picture file “Mov01.mov” are detected. Of these contents, contents types to embed link information can be set in advance by setting operating environments with a set button 38 on a screen 30. A description will now be made below of an example in which the scenario output part 14 embeds link information for respective contents of an image file “Image01.jpg” and a motion picture file “Mov01.mov”, for example in the basic scenario 52 shown in FIG. 7.
FIG. 18 is a diagram showing a generated example of a scenario with link information embedded therein. According to the scenario 56 shown in FIG. 18, four lines marked with asterisks at the beginning of the tops thereof indicate lines added to embed the link information. Now, <Original> elements represent link from components thereof such as an <Image> element, a <Move> element, etc. to contents indicated by attribute values of “src” attributes of the <Original> elements. Namely, when the contents is clicked during scenario reproduction by representing elements indicative of the contents such as the <Image> element, the <Move> element, etc. as members of the <Original> elements, and causing the elements indicative of the respective contents to specify or designate files to be reproduced, as the attribute values of the “src” attributes of the <Original> elements thereof, the contents described herein are separated from the viewpoint of the entire synchronism and reproduction relationship and can be reproduced in parallel.
FIG. 20 is a diagram illustrating a generated example of a scenario which has taken into consideration the contents to be noted. According to the scenario 54 a which allows for the noted contents, the scenario output part 14 embeds a <MOVE> element corresponding to the reproduction of movements at the operation of each presentation tool 40 in the basic scenario 52 shown in FIG. 7. When the scenario 54 allowing for the descriptive operation contents shown in FIG. 9 is generated, the scenario output part 14 causes a new “noted” attribute to be contained in a component to be specified, of the <MOVE> element through the use of the noted attribute information supplied from the noted contents detecting part 12 a and gives “True” to an attribute value thereof. It is cleared that the corresponding element is given noted contents owing to the attribute value.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS6161114 *Apr 14, 1999Dec 12, 2000Design Intelligence, Inc.Design engine for fitting content to a mediumUS6195093 *Sep 14, 1998Feb 27, 2001Fuji Xerox Co., Ltd.Systems and method for controlling a presentation using physical objectsUS6330004 *Nov 27, 1998Dec 11, 2001Matsushita Electric Industrial Co., Ltd.Multimedia program editing and presenting system with flexible layout capability by simplified input operationsUS6332147 *Nov 3, 1995Dec 18, 2001Xerox CorporationComputer controlled display system using a graphical replay device to control playback of temporal data representing collaborative activitiesJPH08115335A Title not availableJPH08147264A Title not availableJPH08180036A Title not available* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS6938206 *Jan 19, 2001Aug 30, 2005Transolutions, Inc.System and method for creating a clinical resumeUS7254635 *Apr 4, 2001Aug 7, 2007Sony CorporationApparatus and method for producing and managing data for optimizing the delivery of multimedia contentUS7266767Oct 31, 2005Sep 4, 2007Parker Philip MMethod and apparatus for automated authoring and marketingUS7372991Sep 26, 2003May 13, 2008Seiko Epson CorporationMethod and apparatus for summarizing and indexing the contents of an audio-visual presentationUS7496845Oct 30, 2002Feb 24, 2009Microsoft CorporationInteractive presentation viewing system employing multi-media componentsUS7519616 *Jun 30, 2003Apr 14, 2009Microsoft CorporationTime references for multimedia objectsUS7657061Feb 2, 2010Fuji Xerox Co., Ltd.Communication apparatus and system handling viewer imageUS7870432 *Jul 25, 2006Jan 11, 2011Siemens AktiengesellschaftMethod and device for dynamically generating test scenarios for complex computer-controlled systems, e.g. for medical engineering installationsUS7930638 *Apr 19, 2011Nbor CorporationSystem and method for creating, playing and modifying slide showsUS8046341 *Oct 25, 2011Sony CorporationInformation processing apparatus for reproducing metadata and method, program, and recording mediumUS8365083Jun 25, 2004Jan 29, 2013Hewlett-Packard Development Company, L.P.Customizable, categorically organized graphical user interface for utilizing online and local contentUS8392834Apr 9, 2003Mar 5, 2013Hewlett-Packard Development Company, L.P.Systems and methods of authoring a multimedia fileUS8483543May 28, 2004Jul 9, 2013Canon Kabushiki KaishaRecording and reproducing apparatus using random access recording mediumUS8689097 *Jan 8, 2007Apr 1, 2014Satyam Computer Services Ltd.System and method for automatic generation of presentations based on agendaUS9319357Jul 30, 2013Apr 19, 2016Social Communications CompanyContext based virtual area creationUS9411489Nov 1, 2012Aug 9, 2016Sococo, Inc.Interfacing with a spatial virtual communication environmentUS9411490Apr 11, 2014Aug 9, 2016Sococo, Inc.Shared virtual area communication environment based apparatus and methodsUS20010047419 *Apr 4, 2001Nov 29, 2001Yoshihisa GonnoManaging apparatus and methodUS20020138524 *Jan 19, 2001Sep 26, 2002Ingle David BlakemanSystem and method for creating a clinical resumeUS20030174160 *Oct 30, 2002Sep 18, 2003John DeutscherInteractive presentation viewing system employing multi-media componentsUS20030191776 *Apr 5, 2002Oct 9, 2003Pere ObradorMedia object managementUS20040001106 *Jun 26, 2002Jan 1, 2004John DeutscherSystem and process for creating an interactive presentation employing multi-media componentsUS20040068510 *Jun 30, 2003Apr 8, 2004Sean HayesTime references for multimedia objectsUS20040201609 *Apr 9, 2003Oct 14, 2004Pere ObradorSystems and methods of authoring a multimedia fileUS20040267819 *Jun 24, 2004Dec 30, 2004Mitsutoshi ShinkaiInformation processing apparatus and method, program, and recording mediumUS20050034077 *Dec 18, 2003Feb 10, 2005Denny JaegerSystem and method for creating, playing and modifying slide showsUS20050069225 *Sep 26, 2003Mar 31, 2005Fuji Xerox Co., Ltd.Binding interactive multichannel digital document system and authoring toolUS20050078868 *Sep 26, 2003Apr 14, 2005William ChenMethod and apparatus for summarizing and indexing the contents of an audio-visual presentationUS20050081155 *Oct 4, 2004Apr 14, 2005Geoffrey MartinVirtual player capable of handling dissimilar contentUS20050179785 *Sep 3, 2004Aug 18, 2005Fuji Xerox Co., Ltd.Communication apparatus and system handling viewer imageUS20050289475 *Jun 25, 2004Dec 29, 2005Geoffrey MartinCustomizable, categorically organized graphical user interface for utilizing online and local contentUS20060044283 *Mar 22, 2005Mar 2, 2006Michiaki EriInformation processing apparatus and display control programUS20060064631 *Oct 31, 2005Mar 23, 2006Parker Philip MMethod and apparatus for automated authoring and marketingUS20060101491 *May 19, 2003May 11, 2006Yasushi TsurutaContent recording/reproducting apparatus, cntent recording/reproducingmethod, and computer programUS20070038039 *Jul 25, 2006Feb 15, 2007Siemens AktiengesellschaftMethod and device for dynamically generating test scenarios for complex computer-controlled systems, e.g. for medical engineering installationsUS20080010585 *Jul 10, 2007Jan 10, 2008Fuji Xerox Co., Ltd.Binding interactive multichannel digital document system and authoring toolUS20080040340 *Jan 8, 2007Feb 14, 2008Satyam Computer Services LtdSystem and method for automatic generation of presentations based on agendaUS20080307324 *Jan 14, 2008Dec 11, 2008Apple Inc.Sharing content in a videoconference sessionUS20090018681 *Mar 10, 2008Jan 15, 2009Samsung Elecatronics Co., Ltd.Apparatus and method of controlling reproduction of media signal using tagUS20090113278 *Oct 25, 2007Apr 30, 2009Fuji Xerox Co., Ltd.System and methods for generating automatic and user-controllable movies of presentations on small devicesUS20140039867 *Jun 20, 2013Feb 6, 2014Canon Kabushiki KaishaInformation processing apparatus and method thereofUS20150097758 *Oct 1, 2014Apr 9, 2015Hiroshi MaedaDisplay apparatus, information terminal, display system, and programCN100409239CSep 27, 2004Aug 6, 2008富士施乐株式会社Communication apparatus and system handling viewer image* Cited by examinerClassifications U.S. Classification715/731, 707/E17.009, 715/203, 715/732, 715/753, 715/202, 715/730International ClassificationG06F19/00, G06F3/048, G06F3/16, G06F17/30Cooperative ClassificationH04N21/4438, H04N21/8543, H04N21/4307, H04N21/44213, H04N21/8146, G06F17/30017European ClassificationH04N21/442E, H04N21/81G, H04N21/8543, H04N21/43S2, H04N21/443W, G06F17/30ELegal EventsDateCodeEventDescriptionAug 31, 1999ASAssignmentOwner name: FUJI XEROX CO., LTD., JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOBAYASHI, YUJI;SUZUKI, NOBUO;ISHIGAKI, TOORU;REEL/FRAME:010210/0186Effective date: 19990827Apr 7, 2006FPAYFee paymentYear of fee payment: 4Apr 21, 2010FPAYFee paymentYear of fee payment: 8Apr 2, 2014FPAYFee paymentYear of fee payment: 12RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services