# Patent

## Title
Recording medium, and method and apparatus for reproducing the recording medium

## Abstract

In one embodiment, the method includes retrieving management information associated with the audiovisual data. The management information includes link information, an indicator, and reference information. The method further includes identifying whether or not a set of additional data associated with the audiovisual data exists in a stream including at least a portion of the management information using the indicator. The additional data describes the audiovisual data. Also, the indicator includes one of a first indicator value indicating that the set of the additional data associated with the audiovisual data exists in the stream and a second indicator value indicating that the set of the additional data associated with the audiovisual data does not exist in the stream. The audiovisual data and the set of the additional data are retrieved using the link information referencing the set of the additional data and the reference information being assigned to the audiovisual data, and the audiovisual data and the associated additional data are reproduced.

## Background
DOMESTIC PRIORITY INFORMATION
This is a continuation application of application Ser. No. 11/723,087, filed Mar. 16, 2007, now U.S. Pat. No. 8,270,804 the entire contents of which are hereby incorporated by reference.


FOREIGN PRIORITY INFORMATION
The present invention claims priority under 35 U.S.C. 119 on Korean Application No. 2001-26028, filed May 12, 2001, the entire contents of which are hereby incorporated by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a recording medium on which moving picture data have been recorded together with script files including additional information related with the moving picture data.
The present invention further relates to a method of linking script files with moving picture data and relates to method and apparatus of reproducing the moving picture data along with script files thereof.
2. Description of the Related Art
An optical disk such as DVD (Digital Versatile Disk) being able to store digital data is widely used in these days. A DVD can store not only audio data but also moving picture data of long time. A DVD has two recording partitions, one for storing digital data stream such as moving picture data, and the other for storing navigation data which are used to control reproduction of the stored digital data stream.
Thus, when a DVD having digital data stream thereon is placed into a conventional DVD player, the player reads out the reproduction-controlling data written in the navigation data partition first and stores them in a memory equipped therein. Afterwards, the DVD player can select or search for an arbitrary section of moving picture data using the reproduction-controlling data in the memory and playback it.
A DVD may include additional information about moving picture data recorded thereon. Namely, a DVD may include scene descriptive texts and introduction of characters, etc. besides video and audio data. Such additional information may be informed to a viewer who wants more information about moving pictures being presented.
However, how to link such additional information with moving picture data and how to reproduce it along with moving picture data are not yet decided.
SUMMARY OF THE INVENTION
The present invention relates to a recording medium having a data structure for managing reproduction of moving picture data from the recording medium.
The present invention further relates to a method of reproducing audiovisual data with additional data.
In one embodiment, the method includes retrieving management information associated with the audiovisual data. The management information includes link information, an indicator, and reference information. The method further includes identifying whether or not a set of additional data associated with the audiovisual data exists in a stream including at least a portion of the management information using the indicator. The additional data describes the audiovisual data. Also, the indicator includes one of a first indicator value indicating that the set of the additional data associated with the audiovisual data exists in the stream and a second indicator value indicating that the set of the additional data associated with the audiovisual data does not exist in the stream. The audiovisual data and the set of the additional data are retrieved using the link information referencing the set of the additional data and the reference information being assigned to the audiovisual data, and the audiovisual data and the associated additional data are reproduced.
The present invention still further relates to an apparatus for reproducing audiovisual data with additional data.
In one embodiment, the apparatus includes a controller configured to retrieve management information associated with the audiovisual data. The management information includes link information, an indicator, and reference information. The controller is further configured to identify whether or not a set of additional data associated with the audiovisual data exists in a stream including at least a portion of the management information using the indicator, the additional data being describing the audiovisual data. The controller is also configured to retrieve the audiovisual data and the set of the additional data using the link information referencing the set of the additional data and the reference information assigned to the audiovisual data. And, the controller is configured to reproduce the audiovisual data and the associated additional data. The indicator includes one of a first indicator value indicating that the set of the additional data associated with the audiovisual data exists in the stream and a second indicator value indicating that the set of the additional data associated with the audiovisual data does not exist in the stream.



BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a further understandings of the invention, illustrate the preferred embodiments of the invention, and together with the description, serve to explain the principles of the present invention.
FIG. 1 schematically shows a recording medium such as a DVD including script files containing additional information about moving picture data;
FIGS. 2 and 3 show structures of Video Manager Information (VMGI) and Video Title Set Information (VTSI), respectively, recorded in a navigation data zone of the recording medium of FIG. 1;
FIG. 4 shows hierarchically-structured digital data stream recorded on a recording medium;
FIG. 5 shows a part of program chain information including 4-byte-long PGC Content field a ‘Script Flag’ is allocated in;
FIG. 6 shows the first embodiment of a method linking script files with moving picture data according to the present invention;
FIG. 7 shows the second embodiment of a method linking script files with moving picture data according to the present invention;
FIG. 8 shows the third embodiment of a method linking script files with moving picture data according to the present invention;
FIG. 9 shows an embodiment of a method specifying that a moving picture data section has no related additional information;
FIG. 10 is a block diagram of an apparatus reproducing a recording medium including script files as well as moving picture data in accordance with the present invention;
FIG. 11 is a flow chart of an embodiment of a method reproducing a recording medium including script files as well as moving picture data in accordance with the present invention;
FIG. 12 shows an example of screen displaying both a scene by moving picture data and scene descriptive text by a script file; and
FIG. 13 is a flow chart of another embodiment of a method reproducing a recording medium including script files as well as moving picture data in accordance with the present invention.



DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
In order that the invention may be fully understood, a example embodiments thereof will now be described with reference to the accompanying drawings.
Embodiments of a method linking additional information with moving picture data in accordance with the present invention are described first.
FIG. 1 schematically shows a recording medium such as a DVD including script files containing additional information about moving picture data. The DVD of FIG. 1 is composed of three recording partitions, the first ‘Data Zone (DZ)’ for storing digital data stream such as moving picture data, the second ‘Navigation Data Zone (NDZ)’ for storing navigation data used to control reproduction of the stored digital data stream in the DZ, and the third ‘Script File Zone (SFZ)’ for storing script files having additional and/or detailed information about moving picture data.
In the SFZ, at least one link data file, which links script files with corresponding sections of moving picture data, may be included.
The additional information in the script file may be written in the conventional HTML (Hyper-Text Markup Language) format, and a single script file is linked with at least one a predetermined-sized VOBU (Video OBject Unit) which is defined in the general DVD recording standard.
In addition, the link data file may be created for each PGCI (ProGram Chain Information) which is also defined in the general DVD recording standard, and it is composed of link entries where each entry consists of a script file identifier and an address of VOBUs associated with a script file.
FIG. 2 shows the structure of Video Manager Information (VMGI) recorded in the NDZ. The VMGI includes Video Manager Menu VOBU Address Map ‘VMGM_VOBU_ADMAP’ in which 4-byte-long start addresses of Video Manager Menu VOBUs ‘VMGM_VOBU_Ads’ are written.
FIG. 3 shows the structure of Video Title Set Information (VTSI) recorded in the NDZ. The VTSI includes Video Title Set Video Object Unit Address Map ‘VTS_VOBU_ADMAP’ in which 4-byte-long start addresses of Video Title Set VOBUs ‘VTS_VOBU_Ads’ are written.
FIG. 4 shows hierarchically-structured digital data stream recorded on a DVD. According to the hierarchical structure depicted in FIG. 4, single PGCI which has been written in the PGCI table included in the VMGI and/or VTSI is associated with at least one VOB (Video OBject), called program section or program chain, where a single VOB is composed of many VOBUs containing actual data.
In the PGCI, 4-byte-long PGC Content field is included as shown in FIG. 5. The PGC Content field consists of the following sub-fields: 8-bit-long ‘Number of Cells’, 7-bit-long ‘Number of Programs’, 1-bit ‘Script Flag’, and 16-bit-long ‘Reserved’.
The 1-bit ‘Script Flag’ indicates whether or not script files are linked with an associated program chain. If the ‘Script Flag’ is set it means that there are linked script files, and if reset it means that there are not.
If there are linked script files, information for linking each script file with a corresponding section of moving picture data belonging to a program chain is stored in a link data file.
FIG. 6 shows an example of the structure of a link data file. There may be several link data files, as shown in FIG. 6, to match one file with one program chain when a plurality of program chains exist on a DVD. Therefore, a link data file may have a filename indicative of an associated PGCI to distinguish what link data file is associated with what PGCI. For example, the first link data file associated with the PGCI ‘PGCI #1’ of the first program section is named to ‘PGC.sub.--1.lk’, and, in the same manner, the second link data file associated with the PGCI ‘PGCI #2’ of the second program section is named to ‘PGC.sub.--2.lk’ where the extension ‘lk’ implies link data file.
In the example of a link data file depicted in FIG. 6, each link entry written in the link data file consists of an address of a VOBU with which contents of a linked script file are to be presented and a recording address of the linked script file. For example, if it is supposed that an address of a VOBU with which contents of a linked script file are to be presented is ‘10000’ and a recording address of the linked script file is ‘001001h’, a corresponding link entry has data of ‘10000/001001h’ where the symbol ‘/’ is a delimiter. Other symbol such as a space may be used instead of ‘/’.
FIG. 7 shows another example of the structure of a link data file. In the example of FIG. 7, each link data file is associated with a corresponding program chain through a unique filename the same as the above example. Namely, a link data file is named to ‘PGC.sub.--1.lk’ for the first PGCI, and to ‘PGC.sub.--2.lk’ for the second PGCI. Each link entry consists of an address of a VOBU with which contents of a linked script file are to be presented and a filename of the linked script file. For example, if it is supposed that an address of a VOBU with which contents of a linked script file are to be presented is ‘10000’ and a filename of the linked script file is ‘xxxx0.sc’, a corresponding link entry has data of ‘10000/xxxx0.sc’ where the symbol ‘/’ is a delimiter.
When a DVD including the above-explained script files and at least one link data file thereon is placed into a DVD player and a program chain to reproduce is selected at the same time from a user, the DVD player checks the 1-bit ‘Script Flag’ written in the PGC Content field ‘PGC_CNT’ in PGCI of the selected program chain, first. If the ‘Script Flag’ is 1, the DVD player considers that script files associated with the selected program chain have been written in the SFZ, reads a data link file associated with the selected program chain from the SFZ, and stores the read data link file in a memory. In these successive operations, all script files in the SFZ may be read out and then stored in the memory along with the link data file.
Afterwards, the selected program chain is reproduced. If script display mode is activated, the DVD player examines all link entries in the link data file, stored in the memory, associated with the program chain being presented in order to search for an address which is equal to a start address of a VOBU being reproduced. If the same address is found in the link entries, the DVD player obtains a recording address or a filename of a script file combined with the found address through a delimiter ‘/’, and decodes data contained in the identified script file by the obtained recording address or filename while reading the script file from the memory or the DVD. Through these operations, a viewer is able to view additional information related with the presented moving pictures at the same time while watching the moving pictures.
In the above embodiment, an additional link data file is necessary to link script files with moving picture data. However, script files can be linked directly with moving picture data without the above-explained link data file.
FIG. 8 is another embodiment of a method linking script files with moving picture data in accordance with the present invention. In the embodiment of FIG. 8, every script file has filename including an address of a VOBU to be presented along with the script file. For example, if it is supposed that a script file is to be presented with the fifth VOBU ‘VOBU #5’ of which start address is ‘10000’, the script file includes a string of ‘10000.sc’ in its filename where the ‘sc’, means script file. In other words, a start address of a VOBU to be presented with additional information included in a script file must be used as a filename (extension excluded) of the script file, as shown in FIG. 8.
Therefore, a DVD player reads all script files written in the SFZ of a DVD and knows each start address of a VOBU to be presented with a script file based on each filename before starting reproduction. Afterwards, if there is a filename matched with an address of a VOBU being presented now, the DVD player reads data in a script file having the matched filename and decodes out them. Through these operations, a viewer can view additional information related with the presented moving pictures at the same time while watching the moving pictures.
Entire script files may be retrieved from a DVD and then stored in a memory at an initial disk loading process when a DVD is placed. Otherwise, linked script files are retrieved from a DVD and then decoded sequentially when a viewer activates script display mode. If a memory has enough storage capacity, a user's script display request may be responded to after storing all script files in the memory.
An arbitrary section of moving picture data, namely several VOBUs may have no additional information although the moving picture data may have additional information overall. For such a section, a script file of which filename includes a start address of the section is still created, however, the script file has only null data. FIG. 9 shows this method schematically.
In the example of FIG. 9 illustrating a case that an arbitrary section of moving picture data is not supplied with additional information, a section from the L-th VOBU ‘VOBU #L’ to the (m−1)-th ‘VOBU #m−1’ has no additional information, so that a script file of which filename is ‘30000’, same with the address of the L-th VOBU, has null data of fixed size.
Therefore, when the L-th VOBU is encountered while reproducing the moving picture data, the DVD player reads contents written in the script file ‘30000.sc’ and it deletes previously-outputted contents of the script file ‘21000.sc’ in a viewing screen because the contents of the file ‘30000.sc’ are all null. As a result, while a section of moving picture data not supplied with additional information is being reproduced, previous additional information not related with current section disappears in a screen.
Instead of writing null data in a script file, a special code, e.g., ‘-’ is added to the filename of a script file to indicate that a linked section has no additional information. For example, in the example of FIG. 9, the script file of which filename is same with the address of the L-th VOBU ‘VOBU #L’ is named to ‘-30000.sc’. Therefore, if a script file of which filename includes the code ‘-’ is linked with current VOBU, a previously-presented script file is removed in a screen immediately without reading data in the script file.
An embodiment of method and apparatus of reproducing a recording medium including script files linked with moving picture data as explained above is now described in detail.
FIG. 10 is a block diagram of an apparatus reproducing a recording medium including script files as well as moving picture data in accordance with the present invention. The reproducing apparatus of FIG. 10 comprises an optical pickup 11 detecting signals recorded on a DVD 10 on which script files are also written; a reproduction processing unit 12 processing the detected signals by the pickup 11 to restore them to video, audio, and/or text data; a spindle motor 17 rotating the DVD 10; a sled motor 16 moving the pickup 11 inward and outward on the DVD 10; a servo unit 15 conducting servo operations for the spindle motor 17, the sled motor 16, and an objective lens of the pickup 11; a controlling unit 13 controlling all elements to reproduce the DVD 10; and a memory 14 for temporarily storing data produced while reproducing the DVD 10 and script files.
The reproduction processing unit 12 may be composed of a digital signal processor (DSP) 12a restoring the detected RF signals to digital data after converting the RF signals to binary signals, a decoder 12b decoding compressed digital data restored by the digital signal processor 12a, and the like. The controlling unit 13 may be composed of a file system 13a searching for and reading a link data file or a script file stored in the memory 14 or recorded on the DVD 10, a microprocessor 13b controlling reproduction of recorded data and script files in connection with the file system 13a, and so on. A reproduction operation, conducted under the control of the controlling unit 13, of both moving picture data and related additional information in script files is performed as follows.
FIG. 11 is a flow chart of an embodiment of a method reproducing a recording medium including script files as well as moving picture data in accordance with the present invention.
The procedures depicted in FIG. 11 are on the assumption that the DVD 10 includes a link data file in the SFZ as the embodiments of FIGS. 7 and 8. When the DVD 10 is placed exactly (S10), the controlling unit 13 reads navigation data for controlling reproduction of the DVD 10 from the NDZ and stores them in the memory 14, first (S11). There are the VMGI and the VTSI containing PGCI in the navigation data stored in the memory 14.
Because there may be several program chains on the DVD 10, the controlling unit 13 waits until a program chain is chosen to be reproduced by a user. If a program chain is selected, the controlling unit 13 checks 1-bit ‘Script Flag’ allocated in the PGC Content field ‘PGC_CNT’ written in PGCI associated with the chosen program chain (S12). If the value of ‘Script Flag’ is 0, the controlling unit 13 knows that there is no additional information associated with the chosen program chain, and conducts a general DVD reproducing operation (S13).
If the values of ‘Script Flag’ is 1, the controlling unit 13 considers that there is at least one stored script file, linked with the selected program chain, in the SFZ of the DVD 10, and it searches the SFZ of the DVD 10 for a link data file having filename associated with the PGCI of the chosen program chain. If found, the controlling unit 13 determines that the chosen program chain has linked script files, otherwise, it determines that the chosen program chain does not.
If it is determined that there is additional information related with the program chain, the controlling unit 13 reads out the found data link file from the SFZ (S14) and stores it in the memory 14. Specially, if storage of the memory 14 is large enough to store many script files, the controlling unit 13 analyzes all link entries of the stored link data file, reads every script file identified by address or filename written in each link entry, and stores the read script files in the memory 14, before starting to reproduce moving picture data belonging to the chosen program chain (S15).
Afterwards, the controlling unit 13 conducts reproducing operation of the selected program chain (S16). If current reproducing mode is script display one or if script display mode is requested from a user during reproduction of moving picture data (S17), the controlling unit 13 receives an address of a VOBU being reproduced now from the reproduction processing unit 12 or knows the address from the already-stored VTSI in the memory 14 (S18), and it searches the link data file stored in the memory 14 for a link entry of which VOBU address member is equal to the received or known address (S19) If the link entry is not found, the controlling unit 13 searches for a link entry of which VOBU address member is closest to and smaller than the received or known address (S19). If a link entry is found from the former or the latter search operation, the controlling unit 13 identifies a recording address or a filename of a script file from the other member, delimited by ‘/’, of the found link entry, and searches the DVD 10 or the memory 14 for a script file identified by the address or filename through the file system 13a (S20).
If an associated script file is found, its contents are transmitted to the reproduction processing unit 12 which decodes the received contents in accordance with compressing way of the contents, if compressed, and outputs them along with video and audio data decoded from reproduced moving picture data (S21). Owing to this dual decoding and outputting operation, a scene by moving picture data and scene descriptive text by a script file are displayed together in a single screen as shown in FIG. 12.
In the meantime, if the found script file contains null data or has a special code such as ‘-’ indicative of no linked additional information in its filename as explained referring to FIG. 9, the controlling unit 13 supplies the reproduction processing unit 12 with a signal indicative of no information to command the reproduction processing unit 12 to blank a present script window. Consequently, continuous display of previous script file is prevented.
FIG. 13 is a flow chart of another embodiment of a method reproducing a recording medium including script files as well as moving picture data in accordance with the present invention.
The procedures depicted in FIG. 13 are on the assumption that the DVD 10 includes no link data file as the embodiment of FIG. 9.
The procedures of the embodiment of FIG. 13 are totally same with those of FIG. 11 except the following distinctive steps. In the embodiment of FIG. 13, if it is determined that a selected program chain has additional information (S32), the address range of the selected program chain composed of at least one VOB is detected first and script files named with address belonging to the detected address range are all read from the SFZ of the DVD 10 into the memory 14 (S34).
Afterwards, if in script display mode, the controlling unit 13 receives an address of a VOBU being currently reproduced from the reproduction processing unit 12 or knows the address from the already-stored VTSI in the memory 14 (S38), and it searches the memory 14 for a script file named with the received or known address or with an address closest to and smaller than the received or known address (S39). If found, the controlling unit 13 transmits contents of the found script file to the reproduction processing unit 12 to be presented with reproduced moving pictures in a screen.
If the found script file contains only null data or has a special code indicative of no linked additional information in its filename, the controlling unit 13 supplies the reproduction processing unit 12 with a signal indicative of no information to blank a present script window as the former embodiment.
As shown in FIG. 12, the moving pictures and its related additional information, referred to as metadata, may be displayed together through a conventional Web browser used for surfing Internet. In case of using Web browser, the script window for additional information can be scrolled to a previous or a next scene descriptive information by commands or clicks from a viewer. In addition, the descriptive data written in a script file may be made out in the form of hyper-text in order that a viewer might obtain with ease more detailed information related with a part of text, e.g., a word or a phrase by simply clicking it.
The above-explained method of linking additional information with each section of moving picture data and method and apparatus of reproducing a recording medium including the additional information as well as moving picture data make it possible for a viewer to obtain with ease additional and/or detailed information related to moving picture data reproduced from a recording medium such as a DVD.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention.

## Claims

1. A method of retrieving information for managing video data, comprising:
retrieving linking information for associating a metadata set with the video data and location information; and
retrieving a metadata indicator for indicating whether the metadata set exists in a stream including the linking information, the metadata set being a set of metadata and an additional information describing the video data, and the linking information being used for identifying the metadata set associated with the video data, wherein
the location information indicates where the additional information is found,
the metadata indicator indicates that the metadata set associated with the video data exists in the stream when the metadata indicator has a first metadata indicator value, and
the metadata indicator indicates that the metadata set associated with the video data does not exist in the stream when the metadata indicator has a second metadata indicator value.

2. The method of claim 1, wherein the linking information identifies at least one metadata set, and the metadata set includes the metadata associated with the video data.

3. The method of claim 1, wherein the metadata includes one or more metadata units, wherein each metadata unit is decoded at a specific instant in a time.

4. The method of claim 1, wherein the metadata set includes one or more metadata in a same format.

5. The method of claim 1, wherein the metadata set is provided separately from the video data.

6. The method of claim 1, wherein the linking information includes identification information of the metadata.

7. The method of claim 1, wherein the metadata indicator is a flag.

8. The method of claim 7, wherein a value of the flag is 0 or 1.

9. An apparatus for retrieving information for managing video data, comprising:
a controlling unit configured to:
retrieve linking information for associating a metadata set with the video data and location information; and
retrieve a metadata indicator for indicating whether the metadata set exists in a stream including the linking information, the metadata set being a set of metadata and an additional information describing the video data, and the linking information being used for identifying the metadata set associated with the video data, wherein
the location information indicates where the additional information is found,
the metadata indicator indicates that the metadata set associated with the video data exists in the stream when the metadata indicator has a first metadata indicator value, and
the metadata indicator indicates that the metadata set associated with the video data does not exist in the stream when the metadata indicator has a second metadata indicator value.

10. The apparatus of claim 9, wherein the linking information identifies at least one metadata set, and the metadata set includes the metadata associated with the video data.

11. The apparatus of claim 9, wherein the metadata includes one or more metadata units, wherein each metadata unit is decoded at a specific instant in a time.

12. The apparatus of claim 9, wherein the metadata set includes one or more metadata in a same format.

13. The apparatus of claim 9, wherein the metadata set is provided separately from the video data.

14. The apparatus of claim 9, wherein the linking information includes identification information of the metadata.

15. The method of claim 9, wherein the metadata indicator is a flag.

16. The method of claim 15, wherein a value of the flag is 0 or 1.

17. A method of providing information for managing video data, comprising:
providing linking information for associating a metadata set with the video data and location information; and
providing a metadata indicator for indicating whether the metadata set exists in a stream including the linking information, the metadata set being a set of metadata and an additional information describing the video data, and the linking information being used for identifying the metadata set associated with the video data, wherein
the location information indicates where the additional information is found,
the metadata indicator indicates that the metadata set associated with the video data exists in the stream when the metadata indicator has a first metadata indicator value, and
the metadata indicator indicates that the metadata set associated with the video data does not exist in the stream when the metadata indicator has a second metadata indicator value.