Source: https://patents.google.com/patent/US7894521B2/en
Timestamp: 2019-12-07 07:05:57
Document Index: 762336898

Matched Legal Cases: ['Application No. 2006110322', 'application No. 2006', 'Application No. 2006110321', 'application No. 06101013', 'application No. 06101014', 'Application No. 2006', 'Application No. 2006', 'Application No. 2006']

US7894521B2 - Grouping of image frames in video coding - Google Patents
Grouping of image frames in video coding Download PDF
US7894521B2
US7894521B2 US10/306,942 US30694202A US7894521B2 US 7894521 B2 US7894521 B2 US 7894521B2 US 30694202 A US30694202 A US 30694202A US 7894521 B2 US7894521 B2 US 7894521B2
US10/306,942
US20030138043A1 (en
2002-01-23 Priority to FI20020127A priority Critical patent/FI114527B/en
2002-01-23 Priority to FI20020127 priority
2003-01-22 Priority claimed from PCT/FI2003/000053 external-priority patent/WO2003063505A1/en
2003-02-10 Assigned to NOKIA CORPORATION reassignment NOKIA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HANNUKSELA, MISKA
2003-07-24 Publication of US20030138043A1 publication Critical patent/US20030138043A1/en
2011-02-22 Publication of US7894521B2 publication Critical patent/US7894521B2/en
239000010410 layers Substances 0 claims description 210
Further, according to a second preferred embodiment of the invention, when the number of the scalability layers is to be kept low, the first scalability layer in particular can be coded to comprise both the INTRA-layer and the base layer. From the point of view of coding hierarchy, the simplest way to conceive this is to leave out the INTRA-layer altogether, and to provide the base layer with coded frames consisting of both independently defined I-frames, the image information of which has not been determined using motion-compensated temporal prediction, and image frames predicted from previous frames, which image frames in this case are motion-compensated P-frames predicted from the I-frames of the same layer. The layer number 0 can thus still be used for the base layer and, if enhancement layers are coded into the video sequence, enhancement layer 1 is assigned layer number 1. This is illustrated in the following, with reference to FIGS. 3 a and 3 b.
FIG. 3 a shows a non-scalable video sequence structure, in which all image frames are placed on the same scalability layer, i.e. the base layer. The video sequence comprises a first image frame 300 which is an I-frame (1.0.0) and which thus initiates a first sub-sequence. The image frame 300 is used for predicting a second image frame 302 of the sub-sequence, i.e. a P-frame (P.0.1), which is then used for predicting a third image frame 304 of the sub-sequence, i.e. a P-frame (P.0.2), which is in turn used for predicting the next image frame 306, i.e. a P-frame (P.0.3). The video sequence is then provided with an I-frame (1.1.0) coded therein, i.e. an I-frame 308, which thus initiates a second sub-sequence in the video sequence. This kind of non-scalable coding can be used for example when the application employed does not allow scalable coding to be used, or there is no need for it. In a circuit-switched videophone application, for example, channel bandwidth remains constant and the video sequence is coded in real-time, and therefore there is typically no need for scalable coding.
US10/306,942 2002-01-23 2002-11-29 Grouping of image frames in video coding Active 2028-11-26 US7894521B2 (en)
KR20047011467A KR100698938B1 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
PCT/FI2003/000053 WO2003063505A1 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
BR0306958A BR0306958A (en) 2002-01-23 2003-01-22 Method and apparatus for encoding video frames, method and apparatus for decoding a compressed video stream scalably, software, and video signal
EP03700321A EP1479245A1 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
RU2004125579/09A RU2297729C2 (en) 2002-01-23 2003-01-22 Method for grouping image frames during video decoding
MXPA04007020A MXPA04007020A (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding.
JP2003563229A JP2005516498A (en) 2002-01-23 2003-01-22 Grouping the image frames in the video coding
EP06101013A EP1670259A3 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
KR1020067008831A KR100931915B1 (en) 2002-01-23 2003-01-22 Grouping of image frames during video coding
CN 03802521 CN1288915C (en) 2002-01-23 2003-01-22 Video sequence coder and decoder and corresponding coder and decoder
KR20067008830A KR100959573B1 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
EP06101014A EP1670260A3 (en) 2002-01-23 2003-01-22 Grouping of image frames in video coding
US11/338,996 US8204134B2 (en) 2002-01-23 2006-01-25 Grouping of image frames in video coding
US11/338,934 US8050321B2 (en) 2002-01-23 2006-01-25 Grouping of image frames in video coding
JP2006120297A JP2006279972A (en) 2002-01-23 2006-04-25 Grouping of image frame in video coding
JP2006120296A JP4819562B2 (en) 2002-01-23 2006-04-25 Image frame grouping in video coding.
RU2006110321/09A RU2402886C2 (en) 2002-01-23 2006-06-30 Grouping of image frames on video coding
JP2011260088A JP2012070427A (en) 2002-01-23 2011-11-29 Grouping of image frames in video coding
US11/338,996 Continuation US8204134B2 (en) 2002-01-23 2006-01-25 Grouping of image frames in video coding
US11/338,934 Continuation US8050321B2 (en) 2002-01-23 2006-01-25 Grouping of image frames in video coding
US20030138043A1 US20030138043A1 (en) 2003-07-24
US7894521B2 true US7894521B2 (en) 2011-02-22
US10/306,942 Active 2028-11-26 US7894521B2 (en) 2002-01-23 2002-11-29 Grouping of image frames in video coding
US10123027B2 (en) 2014-01-07 2018-11-06 Nokia Technologies Oy Method and apparatus for video coding and decoding
MXPA05008405A (en) * 2003-02-18 2005-10-05 Nokia Corp Picture decoding method.
MXPA05008404A (en) * 2003-02-18 2005-10-05 Nokia Corp Picture coding method.
AR048535A1 (en) * 2004-04-07 2006-05-03 Qualcomm Inc Method and apparatus for frame prediction in hybrid video compression to enable temporal scalability.
DE102004061906A1 (en) * 2004-12-22 2006-07-13 Siemens Ag Shape coding method, and associated image decoding method, encoding device and decoding device
KR101340937B1 (en) * 2005-09-29 2013-12-13 톰슨 리서치 펀딩 코포레이션 Method and apparatus for constrained variable bit rate(vbr) video encoding
WO2007067990A2 (en) * 2005-12-08 2007-06-14 Vidyo, Inc. Systems and methods for error resilience and random access in video communication systems
MX2008012437A (en) * 2006-03-30 2008-11-18 Lg Electronics Inc A method and apparatus for decoding/encoding a video signal.
TWI375469B (en) * 2006-08-25 2012-10-21 Lg Electronics Inc A method and apparatus for decoding/encoding a video signal
KR101345073B1 (en) * 2006-09-07 2013-12-26 톰슨 라이센싱 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures
WO2008086423A2 (en) * 2007-01-09 2008-07-17 Vidyo, Inc. Improved systems and methods for error resilience in video communication systems
JP5765920B2 (en) * 2010-11-16 2015-08-19 キヤノン株式会社 Transmitting apparatus and transmitting method
KR102036383B1 (en) * 2013-05-13 2019-10-24 주식회사 알티캐스트 Content creation method and apparatus
JP6239472B2 (en) * 2014-09-19 2017-11-29 株式会社東芝 Encoding device, decoding device, streaming system, and streaming method
CN109275029B (en) * 2018-08-28 2019-10-01 北京达佳互联信息技术有限公司 Video stream processing method and device, mobile terminal and storage medium
US4390966A (en) 1979-07-23 1983-06-28 Omron Tateisi Electronics Co. Sequence controller
JPH04348690A (en) 1991-05-27 1992-12-03 Mitsubishi Electric Corp Picture storage transmitter
EP0798932A2 (en) 1996-03-29 1997-10-01 Matsushita Electric Industrial Co., Ltd. MPEG-2 transport decoder
JPH10271511A (en) 1997-01-22 1998-10-09 Matsushita Electric Ind Co Ltd Image encoder and image decoder
US5838265A (en) 1995-07-07 1998-11-17 Deutsche Thomson Brandt Gmbh Method, encoder and decoder for resynchronization to a data stream which contains errors
EP0898427A1 (en) 1997-02-13 1999-02-24 Mitsubishi Denki Kabushiki Kaisha Moving image estimating system
JPH11177987A (en) 1997-12-10 1999-07-02 Matsushita Electric Ind Co Ltd Video information processing device and method
JPH11275576A (en) 1998-01-23 1999-10-08 Matsushita Electric Ind Co Ltd Image transmission method, image processing method, image processor and data storage medium
EP1005232A2 (en) 1998-11-24 2000-05-31 General Instrument Corporation Rate control for an MPEG transcoder without a priori knowledge of picture type
US6094456A (en) 1994-03-25 2000-07-25 Nec Corporation Compact image transmission system and image reproducing device capable of reproducing a DCT-based code at a high speed without deterioration of picture quality
WO2001047283A1 (en) 1999-12-22 2001-06-28 General Instrument Corporation Video compression for multicast environments using spatial scalability and simulcast coding
US6314139B1 (en) 1997-09-02 2001-11-06 Kabushiki Kaisha Toshiba Method of inserting editable point and encoder apparatus applying the same
WO2001084850A1 (en) 2000-04-27 2001-11-08 Koninklijke Philips Electronics N.V. Video compression
US6363208B2 (en) * 1997-03-19 2002-03-26 Sony Corporation Digital signal reproduction method and apparatus
US20020051621A1 (en) 1997-09-11 2002-05-02 U.S. Philips Corporation Instant replay of digital video optimized using non MPEG frame tags
US20030063806A1 (en) 2001-03-05 2003-04-03 Chang-Su Kim Systems and methods for reducing error propagation in a video data stream
JP3907860B2 (en) 1999-02-16 2007-04-18 三菱電機株式会社 Moving picture decoding apparatus and moving picture decoding method
Allowance Notification with translation dated Feb. 4, 2010 from parallel Russian Application No. 2006110322, 17 pages.
B.A. Lokshin, "Digital Broadcasting: from Studio to Audience" Cyrus Systems, Moscow, 2001. (translation included).
Elloumi et al., "Issues in Multimedia Scaling: the MPEG Video Streams Case", Emerging Technologies and Applications in Communications, IEEE Computer Society, May 7, 1996.
English Translation of the Office Action of parallel Japanese application No. 2006-120296 dated Jan. 6, 2010.
Hannuksela, "Enhanced Concept of GOP", Joint Video Team of ISO-IES MPEG 7 itu-T VCEG, Feb. 1, 2002.
Hannuksela, M et al.; Sub-Picture: ROI Coding and Unequal Error Protection, IEEE 2002 Conference, Sep. 2002, USA (Internet publication).
Hannuksela, M et al.; Sub-Picture: Video-Coding and Unequal Error Protection, XI European Signal Processing Conference, Sep. 2002, Toulouse, France (internet publication).
Illgner et al., "Spatially Scalable Video Compression Employing Resolution Pyramids", IEEE Journal on Selected Areas in Communications, vol. 15, No. 9, Dec. 1, 2007, pg. 1688-1703.
Information Technology - Generic Coding of Moving Pictures and Associated Audio Information: Systems, ISO/IEC 13818-1, Second edition, Dec. 1, 2000, 174 pages.
Information Technology — Generic Coding of Moving Pictures and Associated Audio Information: Systems, ISO/IEC 13818-1, Second edition, Dec. 1, 2000, 174 pages.
Jan. 15, 1998, ITU-Telecommunications Standardization Union, Draft Text of Recommendation H.263 Version 2 ("H.263+") for Decision.
Jul. 10, 2002, ITU-Telecommunications Standardization Union, H.26L Test Model Long Term No. 8 (TML-8) Draft0, Document VCEG-N10. pp. 1-46.
Notice of Allowance dated May 5, 2010 from Russian Application No. 2006110321/09, 11 pages.
Nov. 12, 2002, David Singer and Toby Walker, Study Text of ISO/IEC 14496-15/FCD (Revised), pp. 1-26.
Nov. 12, 2002, David Singer and Toby Walker, Study Text of ISO/IEC 14496-15/FCD, pp. 1-25.
Nov. 2000, ITU-Telecommunications Standardization Union, Draft for "H.263++" Annexes U, V, and W to Recommendation H.263.
Oct. 9-17, 2002, Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, Editor's Proposed Draft Text Modification for Joint Video Specification (ITU-T Rec. 264 ISO/IEC 14496-10 AVC), Geneva modifications draft 37.).
Office Action dated Jun. 17, 2010 from U.S. Appl. No. 11/338,996, 30 pages.
Office Action dated May 25, 2010 from U.S. Appl. No. 11/338,934, 29 pages.
Office Action of related European application No. 06101013.8 dated Feb. 2, 2010.
Office Action of related European application No. 06101014.6 dated Feb. 2, 2010.
Office Action Response dated Sep. 10, 2010 from U.S. Appl. No. 11/338,996, 10 pages.
Office Action Response dated Sep. 17, 2010 from U.S. Appl. No. 11/338,934, 10 pages.
Soderquist et al., "Memory Traffic and Data Cache Behavior of an MPEG-2 Software Decoder", IEEE Computer Society, Oct. 12, 1997.
Translated Office Action dated Aug. 17, 2010 from parallel Japanese Application No. 2006-120297, 4 pages.
Translated Office Action dated Aug. 24, 2010 from parallel Japanese Application No. 2006-120296, 5 pages.
Translated Office Action dated Feb. 25, 2010 from parallel Japanese Application No. 2006-120297, 5 pages.
Wang, Y.K. et al.: Core Experiment Description of Sub-Picture Coding. ITU 15. Meeting 3.-Jul. 12, 2001, Pattaya, Thailand (internet publication).
Wenger, "Temporal Scalability Using P-pictures for Low-latency Applications", IEEE Workshop, Dec. 1998, pp. 559-564.
CN100592801C (en) 2010-02-24
US8755445B2 (en) 2014-06-17 Method, device, and system for multiplexing of video streams
US8612498B2 (en) 2013-12-17 Channel switch frame
KR101075860B1 (en) 2011-10-25 Method for error concealment in video sequences
KR100972403B1 (en) 2010-07-27 Random access points in video encoding
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HANNUKSELA, MISKA;REEL/FRAME:013741/0536