Source: http://www.google.com/patents/US8131134?dq=Wowio
Timestamp: 2014-12-21 06:26:30
Document Index: 348898608

Matched Legal Cases: ['application No. 10', 'application No. 10', 'Application No. 60', 'Application No. 60', 'art 3', 'art 3', 'art 7', 'art 7', 'Application No. 05', 'Application No. 200510067376', 'Application No. 2005']

Patent US8131134 - Digital media universal elementary stream - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsDescribed techniques and tools include techniques and tools for mapping digital media data (e.g., audio, video, still images, and/or text, among others) in a given format to a transport or file container format useful for encoding the data on optical disks such as digital video disks (DVDs). A digital...http://www.google.com/patents/US8131134?utm_source=gb-gplus-sharePatent US8131134 - Digital media universal elementary streamAdvanced Patent SearchPublication numberUS8131134 B2Publication typeGrantApplication numberUS 10/966,443Publication dateMar 6, 2012Filing dateOct 15, 2004Priority dateApr 14, 2004Also published asCN1761308A, CN1761308B, EP1587063A2, EP1587063A3, EP1587063B1, US20050234731, US20120130721Publication number10966443, 966443, US 8131134 B2, US 8131134B2, US-B2-8131134, US8131134 B2, US8131134B2InventorsSudheer Sirivara, James D. Johnston, Naveen Thumpudi, Wei-ge Chen, Sergey Smirnov, Chris MesserOriginal AssigneeMicrosoft CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (13), Non-Patent Citations (15), Referenced by (2), Classifications (11), Legal Events (1) External Links: USPTO, USPTO Assignment, EspacenetDigital media universal elementary streamUS 8131134 B2Abstract Described techniques and tools include techniques and tools for mapping digital media data (e.g., audio, video, still images, and/or text, among others) in a given format to a transport or file container format useful for encoding the data on optical disks such as digital video disks (DVDs). A digital media universal elementary stream can be used to map digital media streams (e.g., an audio stream, video stream or an image) into any arbitrary transport or file container, including optical disk formats, and other transports, such as broadcast streams, wireless transmissions, etc. The information to decode any given frame of the digital media in the stream can be carried in each coded frame. A digital media universal elementary stream includes stream components called chunks. An implementation of a digital media universal elementary stream arranges data for a media stream in frames, the frames having one or more chunks.
We claim: 1. One or more computer-readable storage media, the computer-readable storage media not being a propagating signal, having stored thereon computer-executable instructions operable to cause a computer to perform a method of encoding digital audio data as a universal elementary stream, the method comprising:
TECHNICAL FIELD The invention relates generally to digital media (e.g., audio, video, and/or still images, among others) encoding and decoding.
BACKGROUND With the introduction of compact disks, digital video disks, portable digital media players, digital wireless networks, and audio and video delivery over the Internet, digital audio and video has become commonplace. Engineers use a variety of techniques to process digital audio and video efficiently while still maintaining the quality of the digital audio or video.
Many computers and computer networks lack the storage or resources to process raw digital audio and video. Encoding (also called coding or bitrate compression) decreases the cost of storing and transmitting audio or video information by converting the information into a lower bitrate. Encoding can be lossless (in which quality does not suffer) or lossy (in which analytic quality suffers�though perceived audio quality may not�but the bitrate reduction compared to lossless encoding is more dramatic). Decoding (also called decompression) extracts a reconstructed version of the original information from the encoded form.
In response to the demand for efficient encoding and decoding of digital media data, many audio and video encoder/decoder systems (�codecs�) have been developed. For example, referring to FIG. 1, an audio encoder 100 takes input audio data 110 and encodes it to produce encoded audio output data 120 using one or more encoding modules. In FIG. 1, analysis module 130, frequency transformer module 140, quality reducer (lossy encoding) module 150 and lossless encoder module 160 are used to produce the encoded audio data 120. Controller 170 coordinates and controls the encoding process.
Existing audio codecs include Microsoft Corporation's Windows Media Audio (�WMA�) codec. Some other codec systems are provided or specified by the Motion Picture Experts Group (�MPEG�), Audio Layer 3 (�MP3�) standard, the MPEG-2 Advanced Audio Coding [�AAC�] standard, or by other commercial providers such as Dolby (which has provided the AC-2 and AC-3 standards).
SUMMARY In summary, the detailed description is directed to various techniques and tools for digital media encoding and decoding, such as audio streams. The described techniques and tools include techniques and tools for mapping digital media data (e.g., audio, video, still images, and/or text, among others) in a given format to a transport or file container format useful for encoding the data on optical disks such as digital video disks (DVDs).
In one implementation, a digital media universal elementary stream incorporates an efficient coding scheme using chunks, including a sync chunk with sync pattern and length fields. Some implementations encode a stream using optional elements, on a �positive check-in� basis. In one implementation, an end of block chunk can be used alternately with sync pattern/length fields to denote the end of a stream frame. Further, in some stream frames, both the sync pattern/length chunk and end of block chunk can be omitted. The sync pattern/length chunk and end of block chunk therefore also are optional elements of the stream.
A digital media universal elementary stream also includes extension mechanisms that allow extension of the stream definition to encode later-defined codecs or chunk types, without breaking compatibility for prior decoder implementations. A universal elementary stream definition is extensible in that new chunk types can be defined using chunk type codes that previously had no semantic meaning, and universal elementary streams containing such newly defined chunk types remain parse-able by existing or legacy decoders of the universal elementary stream. The newly defined chunks may be �length provided�(where the length of the chunk is encoded in a syntax element of the chunk) or �length predefined�(where the length is implied from the chunk type code). The newly defined chunks then can be �thrown away� or ignored by the parsers of existing legacy decoders, without losing bitstream parsing or scansion.
BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of an audio encoder system according to the prior art.
DETAILED DESCRIPTION Described embodiments relate to techniques and tools for digital media encoding and decoding, and more particularly to codecs using a digital media universal elementary stream that can be mapped to arbitrary transport or file containers. The described techniques and tools include techniques and tools for mapping audio data in a given format to a format useful for encoding audio data on optical disks such as digital video disks (DVDs) and other transports or file containers. In some implementations, digital audio data is arranged in an intermediate format suitable for later translation and storage in a DVD format. The intermediate format can be, for example, a Windows Media Audio (WMA) format, and more particularly, a representation of the WMA format as a universal elementary stream described below. The DVD format can be, for example, a DVD audio recording (DVD-AR) format, or a DVD compressed audio (DVD-A CA) format. Although the specific application of these techniques to audio streams is illustrated, the techniques also can be used to encode/decode other forms of digital media, including without limitation video, still images, text, hypertext, and multiple media, among others.
With reference to FIG. 3, an exemplary audio encoder (300) includes a selector (308), a multi-channel pre-processor (310), a partitioner/tile configurer (320), a frequency transformer (330), a perception modeler (340), a weighter (342), a multi-channel transformer (350), a quantizer (360), an entropy encoder (370), a controller (380), and a bitstream multiplexer [�MUX�](390).
The encoder (300) receives a time series of input audio samples (305) at some sampling depth and rate in pulse code modulated [�PCM�] format. The encoder (300) compresses the audio samples (305) and multiplexes information produced by the various modules of the encoder (300) to output a bitstream (395) in a format such as a Microsoft Windows Media Audio [�WMA�] format.
With reference to FIG. 4, a corresponding audio decoder (400) includes a bitstream demultiplexer [�DEMUX�](410), one or more entropy decoders (420), a tile configuration decoder (430), an inverse multi-channel transformer (440), a inverse quantizer/weighter (450), an inverse frequency transformer (460), an overlapper/adder (470), and a multi-channel post-processor (480). The decoder (400) is somewhat simpler than the encoder (300) because the decoder (400) does not include modules for rate/quality control or perception modeling.
For more information on WMA audio encoders and decoders, see U.S. patent application No. 10/642,550, entitled �MULTI-CHANNEL AUDIO ENCODING AND DECODING,� published as U.S. Patent Application Publication No. 2004-0049379, filed Aug. 15, 2003; and U.S. patent application No. 10/642,551, entitled �QUANTIZATION AND INVERSE QUANTIZATION FOR AUDIO,� published as U.S. Patent Application Publication No. 2004-0044527, filed Aug. 15, 2003, which are hereby incorporated herein by reference.
In some implementations, a universal audio elementary stream is a variant of the Windows Media Audio (WMA) format. For more information on WMA formats, see U.S. Provisional Patent Application No. 60/488,508, entitled �Lossless Audio Encoding and Decoding Tools and Techniques,� filed Jul. 18, 2003, and U.S. Provisional Patent Application No. 60/488,727, entitled �Audio Encoding and Decoding Tools and Techniques,� filed Jul. 18, 2003, which are incorporated herein by reference.
Version number of the WMA bit-stream
Bit depth of the decoded audio samples
Sampling rate of the decoded audio
EncOpt
Encoder options structure
Field describing the encoding profile that
Bit rate of encoded stream in Kbps
Length Field: In this example, the length field indicates the offset to the beginning of the previous sync code. The sync pattern combined with the length field provides a sufficiently unique combination of information to prevent emulation. When a reader comes across a sync pattern, it parses forward to the next sync pattern and verifies that the length specified in the second sync pattern corresponds to the length in bytes it has parsed in order to reach the second sync pattern from the first. If this is verified, the parser has encountered a valid sync pattern and it can start decoding. Or, a decoder can �speculatively� start decoding from the first sync pattern it finds, rather than waiting for the next sync pattern. In this way, a decoder can perform playback of some samples before parsing and verifying the next sync pattern.
TABLE 2 Content Descriptor Metadata Bit position Field name Field description 0 Start When this bit is set, it flags the start of the metadata. 1-2 Type This field identifies the contents of the current metadata string. Values are: Bit1 Bit2 String Description 0 0 Title 0 1 Artist 1 0 Album 1 1 Undefined (free text) 3-7 Reserved Should be set to 0. 8-15 Byte0 First byte of the metadata. 16-23 Byte1 Second byte of the metadata. 24-31 Byte2 Third byte of the metadata. The actual content descriptor strings are assembled by the receiver from the byte stream contained in the metadata .Each byte in the stream represents a UTF-8 character. Metadata can be padded with 0�00 if the metadata string ends before the end of a block. The beginning and end of a string are implied by transitions in the �Type� field. Because of this, transmitters cycle through all four types when sending content descriptor metadata�even if one or more of the strings is empty.
Chunk Type: In this example, chunk type is a single byte header which precedes every type of data chunk. The chunk type field carries a description of the data chunk to follow. The elementary stream definition defines a number of chunk types, which includes an escape mechanism to allow the elementary stream definition to be supplemented or extended with additional, later defined chunk types. The newly defined chunks may be �length provided�(where the length of the chunk is encoded in a syntax element of the chunk) or �length predefined�(where the length is implied from the chunk type code). The newly defined chunks then can be �thrown away� or ignored by the parsers of existing legacy decoders, without losing bitstream parsing or scansion. The logic behind the chunk type and its use is detailed in the next section.
1 byte indicating the type of metadata 1 byte indicating the chunk size N in bytes (metadata>256 bytes transmitted as multiple chunks with the same ID); N-byte chunk CRC: In this example, the cyclic redundancy check (CRC) field covers everything starting after the previous CRC or at and including the previous Sync pattern, whichever is nearer, up to but not including the CRC itself.
Chunk Range
0x00 thru 0x92
LENGTH_PROVIDED
0x93 thru 0xBF
LENGTH_AND_MEANING� PREDEFINED
0xC0 thru 0xFF
LENGTH_PREDEFINED
WMA Std
Chunk Type (Hex)
Multi Byte Fill Element
A 1 Byte length field. (MSB is bit 7)
A 3 Byte length field. (MSB is bit 23)
If the value of bits 22 through 3 is �FFFFF,� this denotes an
Length of Field Following Chunk Type for LENGTH_AND� MEANING_PREDEFINED Tags.
Single byte fill element
(Additional tag definitions)
TABLE 8 Data Length Skipped After Chunk Type for LENGTH_PREDEFINED Tags. Chunk Type Length of Data to Be Bits 5 through 3 Skipped (in Bytes) 000 1 001 1 010 2 011 4 100 8 101 16 110 32 111 32 For 2-byte, 4-byte, 8-byte and 16-byte data, up to eight distinct tags are possible, represented by bits 2 through 0 of the chunk type. For 1 -byte and 32-byte data, the number of possible tags is doubled to 16, because 1 -byte and 32-byte data can each be represented in two ways (e.g., 000 or 001 for 1 -byte and 110 or 111 for 32-byte in bits 5 through 3, as shown in Table 8, above).
Fold Down: This field contains information on fold down matrices for author controlled fold down scenarios. This is the field which carries the fold down matrix, the size of which can vary depending on the fold down combination that it carries. In the worst case the size would be an 8�6 matrix for fold down from 7.1 (8 channels, including subwoofer) to 5.1 (6 channels, including subwoofer). The fold down field is repeated in each access unit to cover the case where the fold down matrices vary over time.
The actual content descriptor strings are assembled by the receiver from the byte stream contained in the metadata. Each byte in the stream represents a UTF-8 character. Metadata can be padded with 0�00 if the metadata string ends before the end of a block. The beginning and end of a string are implied by transitions in the �Type� field. Because of this, transmitters cycle through all four types when sending content descriptor metadata�even if one or more of the strings is empty.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5617263 *Oct 26, 1995Apr 1, 1997Matsushita Electric Industrial Co., Ltd.Method of and apparatus for recording data suitable for a digital recording in a multiplexed fashionUS6536011 *Oct 22, 1998Mar 18, 2003Oak Technology, Inc.Enabling accurate demodulation of a DVD bit stream using devices including a SYNC window generator controlled by a read channel bit counterUS20010026561 *Mar 27, 2001Oct 4, 2001U. S. Philips CorporationMethods and apparatus for making and replaying digital video recordings, and recordings made by such methodsUS20030215215 *Jun 17, 2003Nov 20, 2003Sony CorporationEncoded stream generating apparatus and method, data transmission system and method, and editing system and methodUS20040017997Jul 29, 2002Jan 29, 2004Sonicblue, IncAutomated playlist generationUS20040165734 *Mar 25, 2004Aug 26, 2004Bing LiAudio system for a vehicleUS20090327510 *Sep 4, 2009Dec 31, 2009Adobe Systems IncorporatedReal-Time Priority-Based Media CommunicationJP2000306325A Title not availableJP2001086453A Title not availableJP2002184114A Title not availableJP2002358732A Title not availableJP2004078427A Title not availableWO2001076256A1Mar 20, 2001Oct 11, 2001Koninkl Philips Electronics NvMethods and apparatus for making and replaying digital video recordings, and recordings made by such methods* Cited by examinerNon-Patent CitationsReference1Advanced Television Systems Committee, ATSC Standard: Digital Audio Compression (AC-3), Revision A, pp. 1-54, 118-140 (Aug. 2001).2ISO/IEC, International Standard ISO/IEC 11172-3: Information Technology-Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s-Part 3: Audio, pp. ii-vi, 1-44 (Aug. 1993).3ISO/IEC, International Standard ISO/IEC 11172-3: Information Technology�Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s�Part 3: Audio, pp. ii-vi, 1-44 (Aug. 1993).4ISO/IEC, International Standard ISO/IEC 13818-1: Information Technology-Generic coding of moving pictures and associated audio information: Systems, 171 pp. (Dec. 2000).5ISO/IEC, International Standard ISO/IEC 13818-1: Information Technology�Generic coding of moving pictures and associated audio information: Systems, 171 pp. (Dec. 2000).6ISO/IEC, International Standard ISO/IEC 13818-7: Information Technology-Generic coding of moving pictures and associated audio information-Part 7: Advanced Audio Coding (AAC), pp. i-iii, 1-22, 86-92 (Dec. 1997).7ISO/IEC, International Standard ISO/IEC 13818-7: Information Technology�Generic coding of moving pictures and associated audio information�Part 7: Advanced Audio Coding (AAC), pp. i-iii, 1-22, 86-92 (Dec. 1997).8Microsoft Corporation, "Advanced Systems Format (ASF) Specification," rev. 01.20.02, 104 pp. (Jun. 2004).9Minutes of Oral Proceedings, EP Application No. 05 102 872.8, 5 pages, Apr. 15, 2011.10Notice of Fourth Office Action (English translation), CN Application No. 200510067376.5, 8 pages, Mar. 30, 2011.11Notice of Rejection (English translation), JP Application No. 2005-116625, 9 pages, Dec. 7, 2010.12Perkins et al., "RTP Payload for Redundant Audio Data," Internet Engineering Task Force (Internet Draft-Work in Progress), 9 pp. (Jun. 1997).13Perkins et al., "RTP Payload for Redundant Audio Data," Internet Engineering Task Force (Internet Draft�Work in Progress), 9 pp. (Jun. 1997).14Schulzrinne et al., "RTP: A Transport Protocol for Real-Time Applications," Internet Engineering Task Force (Internet Draft-Work in Progress), 81 pp. (Nov. 2001).15Schulzrinne et al., "RTP: A Transport Protocol for Real-Time Applications," Internet Engineering Task Force (Internet Draft�Work in Progress), 81 pp. (Nov. 2001).Referenced byCiting PatentFiling datePublication dateApplicantTitleUS8515771 *Feb 29, 2012Aug 20, 2013Panasonic CorporationIdentifying an encoding format of an encoded voice signalUS20120226494 *Feb 29, 2012Sep 6, 2012Panasonic CorporationIdentifying an encoding format of an encoded voice signal* Cited by examinerClassifications U.S. Classification386/326, 386/353International ClassificationG10L19/00, H03M7/30, H04N5/93, G11B20/10, H04N5/92, G10L19/14, G11B20/12Cooperative ClassificationG10L19/167European ClassificationG10L19/167Legal EventsDateCodeEventDescriptionNov 9, 2004ASAssignmentOwner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SIRIVARA, SUDHEER;JOHNSTON, JAMES D;THUMPUDI, NAVEEN;ANDOTHERS;REEL/FRAME:015346/0229Effective date: 20041014RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google