Source: https://patents.google.com/patent/US8380044B2/en
Timestamp: 2018-03-23 09:26:11
Document Index: 284468719

Matched Legal Cases: ['application No. 200710146944', 'Application No. 200580009434', 'Application No. 2007', 'Application No. 2667', 'application No. 2007', 'Application No. 10', 'Application No. 05', 'Application No. 94109427']

US8380044B2 - Recording medium storing a text subtitle stream, method and apparatus for reproducing a text subtitle stream to display a text subtitle - Google Patents
Recording medium storing a text subtitle stream, method and apparatus for reproducing a text subtitle stream to display a text subtitle Download PDF
US8380044B2
US8380044B2 US11703246 US70324607A US8380044B2 US 8380044 B2 US8380044 B2 US 8380044B2 US 11703246 US11703246 US 11703246 US 70324607 A US70324607 A US 70324607A US 8380044 B2 US8380044 B2 US 8380044B2
US11703246
US20070140659A1 (en )
In one embodiment, the invention relates to a recording medium for storing a data structure. The data structure has at least one text subtitle stream. Each text subtitle stream includes a style segment defining a group of region styles and a plurality of presentation segments. Each presentation segment has at least one region of text and each region of text being linked to a selected one of the group of region styles. The presentation segment further contains a palette update flag which indicates display update only in palette information in association with a immediately previous presentation segment when reproducing each presentation segment.
This is a continuation application of application Ser. No. 11/070,242 filed Mar. 3, 2005, now U.S. Pat. No. 7,756,398, the entire contents of which are hereby incorporated by reference.
The present invention relates to a recording medium having a data structure for recording and reproducing a text subtitle stream.
In one embodiment, the data structure includes at least one text subtitle stream. Each text subtitle stream having a style segment defining a group of region styles and a plurality of presentation segments. Each presentation segment has at least one region of text and each region of text is linked to a selected one of the group of region styles. The presentation segment further contains a palette update flag which indicates display update only in palette information in association with a immediately previous presentation segment when reproducing each presentation segment.
In one embodiment, the data structure has a first presentation segment configured to use the palette information defined in the style segment, and at least one second presentation segment configured to fade-in or fade-out a presentation of the first presentation segment by changing its palette information only. Each of the first and second presentation segments containing at least one region of text and each region of text being linked to a selected one of the group of region styles defined in the style segment.
In one embodiment, the present invention relates to a method for reproducing, storing and decoding a text subtitle stream recorded on a recording medium that includes reading a style segment included in the text subtitle stream; the style segment defining a group of region styles and palette information. Thereafter, the method calls for reading each presentation segment included in the text subtitle stream where each presentation segment contains at least one region of text and each region of text being linked to a selected one of the group of region styles. A palette update flag is included in each presentation segment that indicates whether to use the palette information defined in the style segment or to use new palette information for display update only in palette information when reproducing the each presentation segment.
In one embodiment, the method includes parsing the text subtitle stream into composition information, rendering information and dialog text data, the composition information further parsing a palette update information; rendering parsed dialog text data into bitmap data using rendering information; and composition the rendered text data into the graphics plane according to the composition information.
On the other hand, local style information defines an inline style (local style) which is applied to a particular portion of text strings included in a region. For example, the inline style information may contain at least one of a font type, font size, font style, and font color. The particular portion of text strings may be an entire text line within a region or a particular portion of the text line. Referring to FIG. 5C, a particular inline style is applied to the text portion “mountain” included in Region 1. In other words, at least one of the font type, font size, font style, and font color of the particular portion of text strings is different from the remaining portion of the text strings within Region 1.
Accordingly, the above-described text data is recorded and described as a “text string” depending upon whether a specific inline style exists. FIG. 6 illustrates a text subtitle stream file (e.g., 10001.m2ts shown in FIG. 1) according to the present invention. The text subtitle stream file may be formed of an MPEG2 transport stream including a plurality of transport packets (TP), all of which have a same packet identifier (e.g., PID=0x18xx). When a disc player receives many input streams including a particular text subtitle stream, it finds all the transport packets that belong to the text subtitle stream using their PIDs. Referring to FIG. 6, each sub-set of transport packets form a packet elementary stream (PES) packet. One of the PES packets shown in FIG. 6 corresponds to a dialog style segment (DSS) defining a group of region styles. All the remaining PES packets after the second PES packet correspond to dialog presentation segments (DPSs)
In the above-described text subtitle stream structure of FIG. 6, each of the dialog information shown in FIGS. 5A to 5C represent a dialog presentation segment (DPS). And, the style information included in the dialog information represents a set of information that links any one of the plurality of region style sets defined in the dialog style segment (DSS), which can also be referred to as “region_style_id”, and inline styles. Accordingly, in the present invention, a region style set and palette information, which are applied to the dialog presentation segment (DPS), are recorded in the dialog style segment (DSS), which will now be described in detail.
And, generally, the dialog presentation segment (DPS) is commonly applied with the palette information defined in the above-described dialog style segment (DSS). However, a separate palette information should also be newly defined and applied to the dialog presentation segment (DPS). Herein, information indicating such modification (or update) of the palette information is referred to as a “palette_update_flag”. More specifically, when palette_update_flag=0b, the common palette information defined at the dialog style segment (DSS) is applied as it is without any modification (or update). Conversely, when palette_update_flag=1b, a new palette information (i.e., palette( )) that is applied to the corresponding dialog style segment (DSS) is defined and used.
FIG. 7B illustrates a usage of the palette information of DPS #1 to DPS #6 as shown in FIG. 7A and, most particularly, illustrates a method for representing a fading effect showing Fade In and Fade Out effects. More specifically, referring to FIG. 7B, in DPS #1 and DPS #2, palette_update_flag=0b is applied, thereby using the common palette information provided from the DSS. However, when DPS #2 is processed with a fade out effect, palette_update_flag=1b is applied to each of DPS #3, DPS #4, and DPS #5, so as to gradually modify (or change) the palette information, which designates color and/or transparency, thereby producing (or producing) the fade out effect. Therefore, the process of newly defining and modifying (or changing) only the palette information, as shown in DPS #3, DPS #4, and DPS #5, and redefining the above-described style information and text data without any modifications, as those used in DPS #2, is also referred to as a “palette only Display update”.
The syntax structure of the above-described dialog style segment (DSS) and the dialog presentation segment (DPS) will now be described in detail with reference to FIGS. 8 to 10B. More specifically, by illustrating the structure of the syntax in detail, the usage of the above-described style information and palette information according to the present invention can be described with more precision. FIG. 8 illustrates a syntax of the text subtitle stream (Text_subtitle_stream( )) according to the present invention. Referring to FIG. 8, the Text_subtitle_stream( ) includes a dialog_style_segment( ) syntax and a dialog_presentation_segment( ) syntax. More specifically, the dialog_style_segment( ) syntax corresponds to a single dialog style segment (DSS) defining the style information set, and the dialog_presentation_segment( ) syntax corresponds to a plurality of dialog presentation segments (DPS) having the actual dialog information recorded therein.
FIGS. 9A to 9D illustrate a detailed structure of the dialog_style_segment( ), which represent the dialog style segment (DSS). More specifically, FIG. 9A illustrates the overall structure of the dialog_style_segment( ), wherein a dialog_style set( ) defining diverse style information sets that are applied in the dialog is defined. FIG. 9B illustrates a dialog_style set( ) according to the present invention, which is defined in the dialog_style_segment( ). Apart from the region_styles (region style( )), the dialog_style_set( ) includes a Player_style_flag, a user_changeable_style set( ), and a palette( ). The Player_style_flag indicates whether change in style information by the player is authorized. Also, the user_changeable_style set( ) defines the range of change in style information by the player, and the palette( ) indicates color information.
The region style information (region_style( )) represents Global style information defined for each region, as described above. A region_style_id is assigned to each region, and a style information set corresponding to the specific region_style_id is defined. Therefore, when reproducing a dialog by recording the region style_id, which is applied to the corresponding dialog, within the dialog presentation segment (DPS), style information set values defined by identical region_style_id within the dialog_style set( ) are applied, so as to reproduce the dialog. Accordingly, individual style information included in the style information set provided to each region_style_id will now be described.
In addition, as information defining an original (or starting) position of the text within the corresponding region, a text_horizontal_position and a text_vertical_position are provided. Also, a text_flow defining the direction of the text (e.g., left→right, right→left, up→down), and a text_alignment defining the alignment direction of the text (e.g. left, center, right) are provided. More specifically, when a plurality of regions are included in a specific dialog, the text_flow of each region included in the corresponding dialog is defined to have an identical text_flow value, so as to prevent users from viewing disturbed images.
Meanwhile, the Player_style_flag recorded within the dialog_style set( ) indicates whether an author may apply the style information provided to the player. For example, when Player_style flag=1b, as well as the style information defined in the dialog style set( ) recorded in a disc, the player is authorized to reproduce the text subtitle stream by applying the style information provided within the player itself. On the other hand, when Player_style_flag=0b, only usage of the style information defined in the dialog_style set( ) recorded within the disc is authorized.
Accordingly, the characteristics of the user_changeable style set( ) according to the present invention will now be described as follows. An identical number of user_control_style( ) is defined in all region_style( ) that are included in the dialog style segment (DSS). Accordingly, the number of user_control_style that can be applied to all of the dialog presentation segments (DPS) is also identical. Further, each user_control_style( ) is represented by a different user_style_id, and when the user selects a random user_id_style, an identical order of the user_control_style( ) is applied to all region_style( ). In addition, a combination of all changeable styles is defined in a single user_control_style( ). More specifically, the region_position, and the font_size are defined simultaneously, instead of being defined separately. Finally, each of the direction (*_direction) and the indication of increase or decrease (*_inc_dec) is recorded independently regardless of each position movement unit (*_delta). More specifically, by defining only the position movement unit (*_delta), a final value of the actually changed style information (or style value) may be obtained by adding the position movement unit (*_delta) to the value defined in the region_style( ).
FIGS. 10A and 10B illustrate a detailed structure of the dialog_presentation_segment( ), which represent the dialog presentation segment (DPS) according to the present invention. FIG. 10A illustrates the overall structure of the dialog_presentation_segment( ), wherein a dialog_start_PTS and a dialog_end_PTS are defined. The dialog_start_PTS and the dialog_end_PTS designate the presentation time of the corresponding dialog. Then, the dialog_presentation_segment( ) includes a palette_update_flag, which indicates a change of information within the corresponding dialog. As described above, when palette_update_flag=1b, a new palette information (palette( )) that is used only in the corresponding DPS is separately defined, instead of the commonly used palette information, shown in FIG. 9D, within the DDS. Accordingly, the author uses the palette_update_flag, so as to allow a wide range of applications. Most particularly, in order to produce (or represent) fade in/out effects, DPSs having only the palette information modified are consecutively provided (e.g., DPS #3 to DPS #5 shown in FIG. 7B), thereby visually providing a fade in or fade out effect of the text subtitle to the user.
Subsequently, a dialog_region( ) that defines the region information is recorded in the dialog_presentation_segment( ). In the present invention, a maximum of two regions is provided within a single dialog, and therefore, dialog_region( ) information is provided to each region. The dialog_region( ) includes region_style_id information and continuous present_flag information. The region_style_id information designates any one of the region styles, as shown in FIG. 9B, and the continuous_present_flag information identifies whether to perform a seamless reproduction with the previous dialog region. Further, text data and region_subtitle( ) information are also included in the dialog_region( ). The text data is included in the actual corresponding region, and the region_subtitle( ) information defines the local style information.
FIG. 10B illustrates a region_subtitle( ) information defined within the dialog_region( ). Herein, the region_subtitle( ) is formed of a group (or pair) of a text string and an inline style information that is applied to the text string. More specifically, in the dialog_presentation_segment( ), when palette_update_flag=1b, the region_style_id and the region_subtitle( ) should be identical to those of a previous dialog style segment (DSS). In this case, the continuous_present_flag should be determined as continuous present_flag=1b. More specifically, type=0x01 within the region_subtitle( ) represents the text string. Therefore, a character code (char_data_byte) is recorded within the text_string( ).
More specifically, as described above, type=0x05 represents a change in the Font color. In this case, a modified palette_entry_id is recorded in the inline_style_value( ), thereby enabling the font color that is applied to each text string to be modified. For example, the text portion “mountain” included in Region 1, as shown in FIG. 5C, is written as a text_string (e.g., text_string=“mountain”), yet the text portion is set to “inline_style type=0x05 (change in Font color)” as the local style information. And, by setting the text portion to “inline_style_value( )=palette_entry_id(k), the font color of the corresponding text_string=“mountain” can be reproduced to have the color information (Y, Cr and Cb values) and degree of transparency (T value) defined in the palette_entry_id(k), shown in FIG. 9D.
FIG. 11B illustrates the text subtitle decoder 42, shown in FIG. 11A, in more details. The decoding process performed by the text subtitle decoder 42 includes parsing, rendering, and composition steps. In the parsing step, the text subtitle stream(s) stored in the subtitle preloading buffer (SPB) 41 is parsed into composition information, rendering information, and dialog text data, in accordance with the information included in the dialog presentation segment (DPS). A dialog represents all the text subtitles that are displayed during a predetermined period of time, which may be defined by a presentation time stamp (PTS). Accordingly, the composition information corresponds to the information related to the display time and display position of the text subtitle when displayed onto the screen, and also to a new palette information that is newly defined by a palette information update (palette_update_flag=1b). The rendering information corresponds to the information that actually describe (or represent) the text of each region for each dialog. Such rendering information includes “region width & height”, “Background color”, “Text Flow”, “Text Alignment”, and “Font id/style/size”. Furthermore, the dialog text information corresponds to an inline style information that is applied to the actual text data and a specific text string recorded within the DPS.
Accordingly, in the DPS of palette_update_flag=1b, the rendering step is omitted, and the bitmap object related to a previous DPS and which is stored within the BOB buffer 424 is preserved and used. Herein, by using the palette information defined in the DPS of palette_update_flag=1b, so as to modify the CLUT only, only the color information (Y, Cr, and Cb values) and transparency information (T value) for the bitmap object of the previous DPS, which is preserved in the graphics plane, are updated. As described above, this is referred to as “palette_only display update”. By using the “palette_only display update”, the fade in/out effects of the DPS may also be represented.
1. A non-transitory computer readable recording medium storing a data structure including at least one text subtitle stream, the text subtitle stream comprising:
a style segment being in a first packet of the text subtitle stream and defining at least one region style; and
a plurality of presentation segments being respectively included in a plurality of packets which follow the first packet, each of the presentation segments containing a palette update flag and at least one region of text, the palette update flag indicating whether or not a graphical composition in the corresponding presentation segment is identical to that of an immediately-previous presentation segment and whether or not palette information has been updated in the corresponding presentation segment, each region of text being linked to one of the at least one region style,
wherein a text subtitle of each presentation segment is displayed by using one of palette information in the style segment and the palette information in the corresponding presentation segment according to the palette update flag.
2. The recording medium of claim 1, wherein the text subtitle of the corresponding presentation segment is displayed by using the palette information in the corresponding presentation segment, if the palette update flag indicates that the graphical composition in the corresponding presentation segment is identical to that of the immediately-previous presentation segment and the palette information in the corresponding presentation segment has been updated.
3. The recording medium of claim 1, wherein the text subtitle of the corresponding presentation segment is displayed by using the palette information in the style segment, if the palette update flag indicates that the graphical composition in the corresponding presentation segment is not identical to that of the immediately-previous presentation segment or the palette information in the corresponding presentation segment has not been updated.
4. A method of reproducing text subtitle streams using a data processing apparatus, the method comprising:
receiving, by the data processing apparatus, at least one text subtitle stream from an external source, each text subtitle stream including a style segment and a plurality of presentation segments, the style segment being in a first packet of the text subtitle stream and defining at least one region style, the presentation segments being respectively included in a plurality of packets which follow the first packet, each of the presentation segments containing a palette update flag and at least one region of text, the palette update flag indicating whether or not a graphical composition in the corresponding presentation segment is identical to that of an immediately-previous presentation segment and whether or not palette information has been updated in the corresponding presentation segment, each region of text being linked to one of the at least one region style; and
displaying, by the data processing apparatus, a text subtitle of each presentation segment by using one of palette information in the style segment and the palette information in the corresponding presentation segment according to the palette update flag.
5. An apparatus for reproducing a text subtitle streams, the apparatus comprising:
a buffer configured to receive at least one text subtitle stream from an external source, each text subtitle stream including a style segment and a plurality of presentation segments, the style segment being in a first packet of the text subtitle stream and defining at least one region style, the presentation segments being respectively included in a plurality of packets which follow the first packet, each of the presentation segments containing a palette update flag and at least one region of text, the palette update flag indicating whether or not a graphical composition in the corresponding presentation segment is identical to that of an immediately-previous presentation segment and whether or not palette information has been updated in the corresponding presentation segment, each region of text being linked to one of the at least one region style;
a renderer configured to display a text subtitle of each presentation segment within the received text subtitle stream; and
a controller configured to identify the palette update flag in each presentation segment and control the renderer to display the text subtitle of the corresponding presentation segment by using one of palette information in the style segment and the palette information in the corresponding presentation segment according to the palette update flag.
6. The apparatus of claim 5, wherein the controller is configured to control the renderer to display the text subtitle of the corresponding presentation segment by using the palette information in the corresponding presentation segment, if the palette update flag indicates that the graphical composition in the corresponding presentation segment is identical to that of the immediately-previous presentation segment and the palette information in the corresponding presentation segment has been updated.
7. The apparatus of claim 5, wherein the controller is configured to control the renderer to display the text subtitle of the corresponding presentation segment by using the palette information in the style segment, if the palette update flag indicates that the graphical composition in the corresponding presentation segment is not identical to that of the immediately-previous presentation segment or the palette information in the corresponding presentation segment has not been updated.
US11703246 2004-03-26 2007-02-07 Recording medium storing a text subtitle stream, method and apparatus for reproducing a text subtitle stream to display a text subtitle Active 2029-11-29 US8380044B2 (en)
US11070242 US7756398B2 (en) 2004-03-26 2005-03-03 Recording medium and method and apparatus for reproducing text subtitle stream for updating palette information
US11703246 US8380044B2 (en) 2004-03-26 2007-02-07 Recording medium storing a text subtitle stream, method and apparatus for reproducing a text subtitle stream to display a text subtitle
US11070242 Continuation US7756398B2 (en) 2004-03-26 2005-03-03 Recording medium and method and apparatus for reproducing text subtitle stream for updating palette information
US20070140659A1 true US20070140659A1 (en) 2007-06-21
US8380044B2 true US8380044B2 (en) 2013-02-19
ID=34989929
US11070242 Active 2029-03-01 US7756398B2 (en) 2004-03-26 2005-03-03 Recording medium and method and apparatus for reproducing text subtitle stream for updating palette information
US11703231 Active 2029-12-07 US8374486B2 (en) 2004-03-26 2007-02-07 Recording medium storing a text subtitle stream, method and apparatus for a text subtitle stream to display a text subtitle
US11703246 Active 2029-11-29 US8380044B2 (en) 2004-03-26 2007-02-07 Recording medium storing a text subtitle stream, method and apparatus for reproducing a text subtitle stream to display a text subtitle
US (3) US7756398B2 (en)
EP (1) EP1730730B1 (en)
JP (1) JP4599396B2 (en)
KR (1) KR101067778B1 (en)
CN (6) CN101197172B (en)
DE (1) DE602005017878D1 (en)
ES (2) ES2336223T3 (en)
RU (1) RU2376659C2 (en)
WO (1) WO2005091722A3 (en)
CN101494075B (en) 2008-01-25 2012-05-23 中国电子科技集团公司第三研究所 Message recording method
US6115529A (en) 1996-06-29 2000-09-05 Samsung Electronics Co., Ltd. Sub-picture restoring method and apparatus in digital video disk system
CN1290935A (en) 1999-07-05 2001-04-11 日本先锋公司 Device and method for recording information
US20020133521A1 (en) 2001-03-15 2002-09-19 Campbell Gregory A. System and method for text delivery
US20040044964A1 (en) 2002-08-29 2004-03-04 Sun Microsystems, Inc. Behavior of anchored frames
KR20040081992A (en) 2003-03-17 2004-09-23 엘지전자 주식회사 Method for converting and displaying text data from audio data
WO2005006746A1 (en) * 2003-07-11 2005-01-20 Matsushita Electric Industrial Co., Ltd. Recording medium, recording method, reproduction apparatus and method, and computer-readable program
US6897873B2 (en) 2000-03-30 2005-05-24 Yamaha Corporation Display control apparatus having replaceable color palette
US20060152622A1 (en) 2002-10-04 2006-07-13 Jek-Thoon Tan Visual contents in karaoke applications
US6819641B1 (en) 1999-07-05 2004-11-16 Pioneer Corporation Apparatus and method of recording information
CN1395422A (en) 2001-06-11 2003-02-05 三星电子株式会社 Storage medium containing multilanguage tab file information and reproducing equipment and method
EP1288950A1 (en) 2001-06-11 2003-03-05 Samsung Electronics Co., Ltd. Information storage medium containing information for providing multi-language markup document, apparatus and method for reproducing thereof
"IEC 62216-1" International Standard, E-Book (Draft Version 2.0.2), International Electrotechnical Commission, pates 2-121, 2001.
Chinese Office Action dated Sep. 9, 2010 issued in corresponding Chinese application No. 200710146944.X and English translation thereof.
Chinese Patent Gazette dated Dec. 28, 2011 issued in corresponding Chinese Application No. 200580009434.7.
English translation of Office Action for counterpart Japanese Patent Application No. 2007-504883 dated Dec. 25, 2009.
Indian Office Action dated Jul. 30, 2012 for Indian Application No. 2667/KOLNP/2006.
International Search Report Issued Sep. 22, 2005 in corresponding International Patent Application No. PCT/KR2005/000579.
Japanese Notice of Allowance dated Sep. 10, 2010 issued in corresponding Japanese application No. 2007-504873 and English translation thereof.
Korean Notice of Allowance dated Jun. 29, 2011 issued in corresponding Korean Application No. 10-2006-7022273.
Office Action for corresponding U.S. Appl. No. 11/703,231 dated Feb. 16, 2012.
Office Action issued Dec. 12, 2007 by the European Patent Office in counterpart European Patent Application No. 05 721 968.5-2210.
Office Action issued Dec. 22, 2008 by the U.S. Patent and Trademark Office in U.S. Appl. No. 11/087,808.
Office Action issued Jul. 6, 2009 by the USPTO in counterpart U.S. Appl. No. 11/087,808.
Office Action issued Jun. 27, 2008 by the Malaysian Patent Office in counterpart Malaysian Patent Application No. Pl 20051316.
Taiwanese Office Action dated Sep. 7, 2011 issued in corresponding Taiwanese Application No. 94109427.
U.S. Office Action dated Dec. 21, 2011 issued in corresponding U.S. Appl. No. 11/889,898.
ES2350940T3 (en) 2011-01-28 grant
CN101114499A (en) 2008-01-30 application
CN101197172B (en) 2011-04-13 grant
CN101241744B (en) 2012-09-12 grant
EP1730730B1 (en) 2009-11-25 grant
US8374486B2 (en) 2013-02-12 grant
RU2376659C2 (en) 2009-12-20 grant
ES2336223T3 (en) 2010-04-09 grant
CN101241744A (en) 2008-08-13 application
RU2006137720A (en) 2008-05-10 application
CN1934638A (en) 2007-03-21 application
EP1730730A2 (en) 2006-12-13 application
CN101127922A (en) 2008-02-20 application
WO2005091722A2 (en) 2005-10-06 application
US7756398B2 (en) 2010-07-13 grant
US20070140659A1 (en) 2007-06-21 application
US20050213944A1 (en) 2005-09-29 application
CN1934638B (en) 2011-12-28 grant
WO2005091722A3 (en) 2005-11-17 application
KR101067778B1 (en) 2011-09-28 grant
KR20070007845A (en) 2007-01-16 application
US20070201831A1 (en) 2007-08-30 application
CN1934624B (en) 2011-10-05 grant
JP2007531192A (en) 2007-11-01 application
CN1934624A (en) 2007-03-21 application
CN101127922B (en) 2012-06-13 grant
DE602005017878D1 (en) 2010-01-07 grant
CN101114499B (en) 2011-08-03 grant
JP4599396B2 (en) 2010-12-15 grant
CN101197172A (en) 2008-06-11 application