Source: http://www.google.com/patents/US8050321?dq=7,362,867
Timestamp: 2014-03-13 07:28:49
Document Index: 469452795

Matched Legal Cases: ['application No. 2006', 'Application No. 2006110322', 'Application No. 03700321', 'Application No. 2006', 'Application No. 2006110321', 'application No. 06101013', 'application No. 06101014', 'Application No. 2006', 'Application No. 2006', 'Application No. 2006']

Patent US8050321 - Grouping of image frames in video coding - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsA method for encoding a video sequence comprising an independent sequence of image frames, wherein at least one reference image frame is predictable from at least one previous image frame that is earlier than the previous reference image frame in decoding order. An indication of at least one image frame...http://www.google.com/patents/US8050321?utm_source=gb-gplus-sharePatent US8050321 - Grouping of image frames in video codingAdvanced Patent SearchPublication numberUS8050321 B2Publication typeGrantApplication numberUS 11/338,934Publication dateNov 1, 2011Filing dateJan 25, 2006Priority dateJan 23, 2002Also published asCN1288915C, CN1620820A, EP1479245A1, EP1670259A2, EP1670259A3, EP1670260A2, EP1670260A3, US8204134, US20060120451, US20060120464, WO2003063505A1Publication number11338934, 338934, US 8050321 B2, US 8050321B2, US-B2-8050321, US8050321 B2, US8050321B2InventorsMiska HannukselaOriginal AssigneeNokia CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (43), Non-Patent Citations (46), Referenced by (2), Classifications (44) External Links: USPTO, USPTO Assignment, EspacenetGrouping of image frames in video codingUS 8050321 B2Abstract A method for encoding a video sequence comprising an independent sequence of image frames, wherein at least one reference image frame is predictable from at least one previous image frame that is earlier than the previous reference image frame in decoding order. An indication of at least one image frame is encoded into the video sequence, which indicated image frame is the first image frame, in decoding order, of the independent sequence, said at least one reference image frame being included in the sequence. In the decoding phase, the indication of at least one image frame is decoded from the video sequence, and the decoding of the video sequence is started from said first image frame of the independent sequence, whereby the video sequence is decoded without prediction from any image frame decoded prior to said first image frame.
RELATED PATENT DOCUMENTS This application is a continuation of U.S. patent application Ser. No. 10/306,942 filed on Nov. 29, 2002 now U.S. Pat. No. 7,894,521 which is incorporated herein by reference in its entirety.
FIELD OF THE INVENTION The invention relates to the grouping of multimedia files, particularly video files and particularly in connection with streaming.
BACKGROUND OF THE INVENTION The term �streaming� refers to simultaneous sending and playback of data, typically multimedia data, such as audio and video files, in which the recipient may begin data playback already before all the data to be transmitted has been received. Multimedia data streaming systems comprise a streaming server and terminal devices that the recipients use for setting up a data connection, typically via a telecommunications network, to the streaming server. From the streaming server the recipients retrieve either stored or real-time multimedia data, and the playback of the multimedia data can then begin, most advantageously almost in real-time with the transmission of the data, by means of a streaming application included in the terminal.
BRIEF DESCRIPTION OF THE INVENTION Now there is invented an improved method and equipment implementing the method, that enable detection of image frames from which a decoder can start the decoding process. Various aspects of the invention include methods, a video encoder, a video decoder, and computer programs that are characterized by what is stated in the independent claims. The preferred embodiments of the invention are disclosed in the dependent claims.
BRIEF DESCRIPTION OF THE DRAWINGS In the following, the invention will be described in connection with the preferred embodiments and with reference to the accompanying drawings, in which
DETAILED DESCRIPTION OF THE INVENTION In the following, a general-purpose multimedia data streaming system is disclosed, the basic principles of which can be applied in connection with any telecommunications system. Although the invention is described here with a particular reference to a streaming system, in which the multimedia data is transmitted most preferably through a telecommunications network employing a packet-switched data protocol, such as an IP network, the invention can equally well be implemented in circuit-switched networks, such as fixed telephone networks PSTN/ISDN (Public Switched Telephone Network/integrated Services Digital Network) or in mobile communications networks PLMN (Public Land Mobile Network). Further, the invention can be applied in the streaming of multimedia files in the form of both normal streaming and progressive downloading, and for implementing video calls, for example.
The above examples illustrate a situation where image frames are temporally predicted from previous image frames. In some coding methods, however, the reference picture selection has been further extended to also include the predicting of the image information of image frames from temporally succeeding image frames. Reference picture selection offers most diversified means for creating different temporally scalable image frame structures and allows the error sensitivity of the video sequence to be reduced. One of the coding techniques based on reference picture selection is INTRA-frame postponement. The INTRA-frame is not placed into its temporally �correct� position in the video sequence, but its position is temporally postponed. The video sequence image frames that are between the �correct� position of the INTRA-frame and its actual position are predicted temporally backward from the INTRA-frame in question. This naturally requires that uncoded image frames be buffered for a sufficiently long period of time so that all image frames that are to be displayed can be coded and arranged into their order of presentation. INTRA-frame transfer and the associated determining of sub-sequences in accordance with the invention are illustrated in the following with reference to FIG. 6.
FIG. 6 a shows a video sequence part in which the INTRA-frame comprises a single I-frame 600, which is temporally transferred to the position shown in FIG. 6, although the �correct� position of the I-frame in the video sequence would have been at the first image frame. The video sequence image frames between the �correct� position and the real position 600 are thus temporally predicted backward from the I-frame 600. This is illustrated by a sub-sequence coded into enhancement layer 1 and having a first temporally backward predicted image frame 602, which is a P-frame (P.0.0). This frame is used for temporally predicting a previous image frame 604, i.e. a P-frame (P.0.1), which is used in turn for predicting an image frame 606, i.e. a P-frame (P.0.2), and, finally, the frame 606 for predicting an image frame 608, i.e. a P-frame (P.0.3), which is at the position that would have been the �correct� position of the I-frame 600 in the video sequence. Correspondingly, the I-frame 600 on the base layer is used for temporally forward prediction of a sub-sequence comprising four P-frames 610, 612, 614 and 616, i.e. P-frames (P.0.0), (P.0.1), (P.0.2) and (P.0.3).
In response to this, and provided that sliding windowing is used for buffering the image frames, the decoder enters into the buffer memory a number of image frames, the contents of which may be fully random, corresponding to the missing image numbers. These random image frames are then designated by an identifier �invalid� to indicate that the frames in question do not belong to the actual video sequence, but are only filler frames entered for purposes of buffer memory management. A filler frame can naturally be implemented using only memory indicators, i.e. no data is preferably entered into the buffer memory, but memory management is used merely to store a reference to a generic �invalid� frame. The entering of the image frames of the actual video sequence continues from the correct image frame number after the number of filler frames indicated by the missing image numbers has been entered into the buffer, which allows the buffer memories of the encoder and the decoder to be kept preferably in synchronism. If during decoding a reference to an image number is detected which is then found to indicate a filler frame located in the buffer, error correction actions are initiated in the decoder to reconstruct the actual reference image, for example by asking the encoder to re-transmit the reference image in question.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4390966 *Jul 15, 1980Jun 28, 1983Omron Tateisi Electronics Co.Sequence controllerUS5122875Feb 27, 1991Jun 16, 1992General Electric CompanyAn HDTV compression systemUS5144426Oct 12, 1990Sep 1, 1992Matsushita Electric Industrial Co., Ltd.Motion compensated prediction interframe coding systemUS5680322 *May 26, 1995Oct 21, 1997Matsushita Electric Industrial Co., Ltd.Method and apparatus for dynamic image data transmissionUS5699476May 9, 1996Dec 16, 1997U.S. Philips CorporationMethod and apparatus for transmitting and/or storing a series of hierarchically encoded digital image data blocksUS5774593Feb 26, 1997Jun 30, 1998University Of WashingtonAutomatic scene decomposition and optimization of MPEG compressed videoUS5786858 *Oct 7, 1996Jul 28, 1998Sony CorporationMethod of encoding image signal, apparatus for encoding image signal, method of decoding image signal, apparatus for decoding image signal, and image signal recording mediumUS5838265May 23, 1996Nov 17, 1998Deutsche Thomson Brandt GmbhMethod, encoder and decoder for resynchronization to a data stream which contains errorsUS5852630 *Mar 30, 1998Dec 22, 1998Globespan Semiconductor, Inc.Method and apparatus for a RADSL transceiver warm start activation procedure with precodingUS5877812Nov 21, 1995Mar 2, 1999Imedia CorporationMethod and apparatus for increasing channel utilization for digital video transmissionUS6072831Jul 15, 1997Jun 6, 2000General Instrument CorporationRate control for stereoscopic digital video encodingUS6094456 *Aug 7, 1998Jul 25, 2000Nec CorporationCompact image transmission system and image reproducing device capable of reproducing a DCT-based code at a high speed without deterioration of picture qualityUS6108382Feb 6, 1998Aug 22, 2000Gte Laboratories IncorporatedMethod and system for transmission of video in an asynchronous transfer mode networkUS6266158Jan 21, 1998Jul 24, 2001Matsushita Electric Industrial Co., Ltd.Image encoding/decoding device and methodUS6307886Jan 20, 1998Oct 23, 2001International Business Machines Corp.Dynamically determining group of picture size during encoding of video sequenceUS6314139Sep 1, 1998Nov 6, 2001Kabushiki Kaisha ToshibaMethod of inserting editable point and encoder apparatus applying the sameUS6337881Mar 23, 2000Jan 8, 2002Microsoft CorporationMultimedia compression system with adaptive block sizesUS6363208Mar 10, 1998Mar 26, 2002Sony CorporationDigital signal reproduction method and apparatusUS6483875 *Jun 19, 1997Nov 19, 2002Sony CorporationPicture signal processing apparatusUS6496980Dec 7, 1998Dec 17, 2002Intel CorporationMethod of providing replay on demand for streaming digital multimediaUS6510553Oct 26, 1998Jan 21, 2003Intel CorporationMethod of streaming video from multiple sources over a networkUS6614936Dec 3, 1999Sep 2, 2003Microsoft CorporationSystem and method for robust video coding using progressive fine-granularity scalable (PFGS) codingUS6639943Jun 9, 2000Oct 28, 2003Koninklijke Philips Electronics N.V.Hybrid temporal-SNR fine granular scalability video codingUS7103669 *Feb 16, 2001Sep 5, 2006Hewlett-Packard Development Company, L.P.Video communication method and system employing multiple state encoding and path diversityUS20010024472Dec 11, 2000Sep 27, 2001Michael SporerComputer system and process for capture, editing and playback of motion video compressed using interframe and intraframe techniquesUS20010040700 *May 15, 2001Nov 15, 2001Miska HannukselaVideo codingUS20020051621 *Jun 15, 2001May 2, 2002U.S. Philips CorporationInstant replay of digital video optimized using non MPEG frame tagsUS20030063806 *Mar 5, 2002Apr 3, 2003Chang-Su KimSystems and methods for reducing error propagation in a video data streamCN1173783AMar 31, 1997Feb 18, 1998松下电器产业株式会社System and method for updating system time constant (STC) counter following discontinuity in MPEG-2 transport data streamEP0798932A2Mar 24, 1997Oct 1, 1997Matsushita Electric Industrial Co., Ltd.MPEG-2 transport decoderEP0898427A1Jan 22, 1998Feb 24, 1999Mitsubishi Denki Kabushiki KaishaMoving image estimating systemEP1005232A2Oct 25, 1999May 31, 2000General Instrument CorporationRate control for an MPEG transcoder without a priori knowledge of picture typeJPH04348690A Title not availableJPH08265694A Title not availableJPH10271511A Title not availableJPH11177987A Title not availableJPH11275576A Title not availableRU2123769C1 Title not availableRU2137197C1 Title not availableWO2000067469A1Apr 26, 2000Nov 9, 2000Nokia Mobile Phones LtdData transmissionWO2001047283A1Apr 10, 2000Jun 28, 2001Gen Instrument CorpVideo compression for multicast environments using spatial scalability and simulcast codingWO2001084850A1Apr 13, 2001Nov 8, 2001Koninkl Philips Electronics NvVideo compressionWO2002054776A1Jan 3, 2002Jul 11, 2002Nokia CorpSwitching between bit-streams in video transmission* Cited by examinerNon-Patent CitationsReference11997, Illgner et al., "Spatially Scalable Video Compression Employing Resolution Pyramids", IEEE Journal on Selected Areas in Communications, vol. 15, No. 9, Dec. 1, 2007, pp. 1688-1703.22001, B.A. Lokshin, "Digital Broadcasting: from Studio to Audience" Cyrus Systems, Moscow, 2001. (translation included).32010, English Translation of the Office Action of parallel Japanese application No. 2006-120296 dated Jan. 6, 2010.4Allowance Notification with translation dated Feb. 4, 2010 from parallel Russian Application No. 2006110322, 17 pages.5Elloumi et al., "Issues in Multimedia Scaling: the MPEG Video Streams Case", Emerging Technologies and Applications in Communications, IEEE Computer Society, May 7, 1996.6File History for EP Application No. 03700321.7 as retrieved from the European Patent Office Electronic File System on Apr. 5, 2011, 222 pages.7Hannuksela, "Enhanced Concept of GOP", Joint Video Team of ISO-IES MPEG 7 itu-T VCEG, Feb. 1, 2002.8Hannuksela, "Signaling of Enhanced GOPs", Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, 4th Meeting, Austria, Jul. 22-26, 2002.9Information Technology-Generic Coding of Moving Pictures and Associated Audio Information: Systems, ISO/IEC 13818-1, Second edition, Dec. 1, 2000, 174 pages.10Information Technology�Generic Coding of Moving Pictures and Associated Audio Information: Systems, ISO/IEC 13818-1, Second edition, Dec. 1, 2000, 174 pages.11Jan. 15, 1998, ITU-Telecommunications Standardization Union, Draft Text of Recommendation H.263 Version 2 ("H.263+") for Decision.12Jul. 10, 2002, ITU-Telecommunications Standardization Union, H.26L Test Model Long Term No. 8 (TML-8) Draft0, Document VCEG-N10. pp. 1-46.13Jul. 12, 2001, Wang, Y.K. et al.; Core Experiment Description of Sub-Picture Coding, ITU 15. Meeting Dec. 3-7, 2001, Pattaya, Thailand (internet publication).14May 6, 2006, Office Action Response of parallel U.S. Appl. No. 10/306,942 dated Aug. 6, 2006, 13 pages.15Notice of Allowance dated Aug. 2, 2011 from Japanese Application No. 2006-120296, 3 pages.16Notice of Allowance dated May 5, 2010 from Russian Application No. 2006110321/09, 11 pages.17Notice of Allowance of parallel U.S. Appl. No. 10/306,942 dated Dec. 7, 2009, 8 pages.18Nov. 12, 2002, David Singer and Toby Walker, Study Text of ISO/IEC 14496-15/FCD (Revised), 26 pages.19Nov. 12, 2002, David Singer and Toby Walker, Study Text of ISO/IEC 14496-15/FCD, pp. 1-25.20Nov. 2000, ITU-Telecommunications Standardization Union, Draft for "H.263++" Annexes U,V, and W to Recommendation H.263.21Oct. 9-17, 2002, Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, Editor's Proposed Draft Text Modification for Joint Video Specification (ITU-T Rec. 264 ISO/IEC 14496-10 AVC), Geneva modifications draft 37.22Office Action dated Apr. 9, 2009 from U.S. Appl. No. 10/306,942, 4 pages.23Office Action dated Feb. 18, 2011 from U.S. Appl. No. 11/338,996, 18 pages.24Office Action dated Jun. 17, 2010 from U.S. Appl. No. 11/338,996, 30 pages.25Office Action dated Jun. 23, 2010 from U.S. Appl. No. 10/306,942, 6 pages.26Office Action dated May 25, 2010 from U.S. Appl. No. 10/306,942, 6 pages.27Office Action of parallel U.S. Appl. No. 10/306,942 dated Aug. 10, 2006, 16 pages.28Office Action of parallel U.S. Appl. No. 10/306,942 dated Mar. 13, 2007, 7 pages.29Office Action of parallel U.S. Appl. No. 10/306,942 dated Mar. 16, 2006, 4 pages.30Office Action of parallel U.S. Appl. No. 10/306,942 dated Sep. 11, 2007, 4 pages.31Office Action of related European application No. 06101013.8 dated Feb. 2, 2010.32Office Action of related European application No. 06101014.6 dated Feb. 2, 2010.33Office Action Response dated May 17, 2011 from U.S. Appl. No. 11/338,996, 9 pages.34Office Action Response dated May 8, 2006 from U.S. Appl. No. 10/306,942, 11 pages.35Office Action Response dated Sep. 10, 2010 from U.S. Appl. No. 11/338,996, 10 pages.36Office Action Response dated Sep. 15, 2010 from U.S. Appl. No. 10/306,942, 12 pages.37Office Action Response of parallel U.S. Appl. No. 10/306,942 dated Jul. 9, 2009, 12 pages.38Office Action Response of parallel U.S. Appl. No. 10/306,942 dated May 31, 2007, 12 pages.39Office Action Response of parallel U.S. Appl. No. 10/306,942 dated Nov. 9, 2006, 16 pages.40Sep. 2002, Hannuksela, M et al.; Sub-Picture: ROI Coding and Unequal Error Protection, IEEE 2002 Conference, Sep. 2002, USA (internet publication).41Sep. 2002, Hannuksela, M et al.; Sub-Picture: Video-Coding for Unequal Error Protection, XI European Signal Processing Conference, Sep. 2002, Toulouse, France (internet publication).42Soderquist et al., "Memory Traffic and Data Cache Behavior of an MPEG-2 Software Decoder", IEEE Computer Society, Oct. 12, 1997.43Translated Office Action dated Aug. 17, 2010 from parallel Japanese Application No. 2006-120297, 4 pages.44Translated Office Action dated Aug. 24, 2010 from parallel Japanese Application No. 2006-120296, 5 pages.45Translated Office Action dated Feb. 25, 2010 from parallel Japanese Application No. 2006-120297, 5 pages.46Wenger, "Temporal Scalability Using P-pictures for Low-latency Applications", IEEE Workshop, Dec. 1998, pp. 559-564.Referenced byCiting PatentFiling datePublication dateApplicantTitleUS20110035669 *Aug 10, 2009Feb 10, 2011Sling Media Pvt LtdMethods and apparatus for seeking within a media stream using scene detectionUS20120072955 *Jun 4, 2010Mar 22, 2012Electronics And Telecommunications Research InstituteStreaming server and mobile terminal for reducing channel-changing delay, and a method therefor* Cited by examinerClassifications U.S. Classification375/240.12, 375/240.25International ClassificationH04N7/46, H04N7/26, H04N7/68, H04N7/50, H04N7/36, H04N7/12, G06T9/00, H04N7/32, H03M7/36Cooperative ClassificationH04N19/00054, H04N19/00024, H04N19/00266, H04N19/00545, H04N19/00193, H04N19/0026, H04N19/00939, H04N19/00721, H04N19/00587, H04N19/00884, H04N19/00781, H04N19/00127, H04N19/00751, H04N19/00163, H04N19/0043, H04N19/00854European ClassificationH04N7/26A8P, H04N7/26A6C6, H04N7/46E, H04N7/26Y, H04N7/46T, H04N7/26A4C6, H04N7/36C, H04N7/26A8R, H04N7/26E2, H04N7/26A4B, H04N7/68, H04N7/50, H04N7/26A6E6, H04N7/26A10S, H04N7/46T2, H04N19/00C1, H04N19/00RRotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google