Source: http://www.google.com/patents/US8208738?dq=6,263,507
Timestamp: 2016-05-28 04:39:19
Document Index: 379821

Matched Legal Cases: ['art 1', 'art 1', 'Application No. 200510007933', 'Application No. 200710197162', 'Application No. 2005100079334', 'Application No. 2004', 'Application No. 2004', 'Application No. 2004', 'Application No. 2004', 'Application No. 2004', 'Application No. 2004', 'Application No. 2007', 'Application No. 2007', 'Application No. 2007', 'Application No. 2007', 'Application No. 2007', 'Application No. 2007', 'Application No. 2007', 'Application No. 2010', 'Application No. 2004', 'Application No. 10', 'Application No. 10', 'Application No. 10', 'Application No. 2004', 'Application No. 2004', 'Application No. 94137601']

Patent US8208738 - Image coding method and apparatus, and image decoding method and apparatus - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsIn an image coding apparatus, a ROI setting unit sets a ROI region in an image. An entropy coding unit entropy-codes the image. A ROI information coding unit encodes information for specifying the ROI region. A codestream generator generates a codestream in a manner that the coded image and the coded...http://www.google.com/patents/US8208738?utm_source=gb-gplus-sharePatent US8208738 - Image coding method and apparatus, and image decoding method and apparatusAdvanced Patent SearchPublication numberUS8208738 B2Publication typeGrantApplication numberUS 11/718,291PCT numberPCT/JP2005/019583Publication dateJun 26, 2012Filing dateOct 25, 2005Priority dateOct 29, 2004Fee statusPaidAlso published asCN101049006A, CN101049006B, CN101175208A, CN101175208B, US8150173, US20070230658, US20080075373, WO2006046551A1Publication number11718291, 718291, PCT/2005/19583, PCT/JP/2005/019583, PCT/JP/2005/19583, PCT/JP/5/019583, PCT/JP/5/19583, PCT/JP2005/019583, PCT/JP2005/19583, PCT/JP2005019583, PCT/JP200519583, PCT/JP5/019583, PCT/JP5/19583, PCT/JP5019583, PCT/JP519583, US 8208738 B2, US 8208738B2, US-B2-8208738, US8208738 B2, US8208738B2InventorsShigeyuki Okada, Kazuhiko TaketaOriginal AssigneeSanyo Electric Co., Ltd.Export CitationBiBTeX, EndNote, RefManPatent Citations (70), Non-Patent Citations (39), Referenced by (3), Classifications (34), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetImage coding method and apparatus, and image decoding method and apparatus
US 8208738 B2Abstract
1. A computer-implemented image decoding method characterized in that a region including a region of interest is decoded from a codestream by referring to information for specifying the region of interest defined on an image wherein the information is explicitly described, not as a header, but in the codestream that contains coded data of the image, the image decoding method performed by a processor in accordance with instructions stored in a memory, wherein
when a plurality of regions of interest are defined on the image, the information for specifying the plurality of regions of interest includes information indicating a degree of priority thereof, and information indicating whether the display of each of the regions of interest is essential, wherein if the information indicates a region of interest as not essential, that region of interest is not displayed.
2. The computer-implemented image decoding method according to claim 1, wherein the information for specifying the plurality of the regions of interest includes a degree of priority of the respective region of interest, and wherein the respective region of interest is processed according to the degree of priority thereof.
3. An image decoding apparatus, comprising:
a region-of-interest information decoding unit including at least one processor acting in accordance with instructions stored in a memory, which decodes information for specifying a region of interest defined on an image wherein the information is explicitly described, not as a header, but in a codestream that contains coded data of the image; and
an image decoding unit which decodes a region including the region of interest from the codestream by referring to the decoded information, wherein
when a plurality of regions of interest are defined on the image, the information for specifying the plurality of regions of interest includes information indicating a degree of priority thereof, and information indicating whether the display of each region of interest is essential, wherein if the information indicates a region of interest as not essential, that region of interest is not displayed.
4. The image decoding apparatus according to claim 3, wherein when a plurality of regions of interest are defined on the image, the region-of-interest information decoding unit decodes information for specifying the plurality of the regions of interest defined on the image, and wherein the image decoding unit decodes the plurality of the regions of interest from the codestream by referring to the decoded information.
5. The image decoding apparatus according to claim 4, wherein the image decoding unit processes the respective region of interest of the plurality of regions of interest according to the degree of priority thereof.
6. A computer-implemented image decoding method characterized in that a region including a region of interest is decoded from a codestream by referring to information for specifying the region of interest defined on a moving image wherein the information is explicitly described, not as a header for each frame of the moving image, but in the codestream that contains coded data of the moving image, the image decoding method performed by a processor in accordance with instructions stored in a memory, wherein
when a plurality of regions of interest are defined on the moving image, the information for specifying the plurality of regions of interest includes information indicating a degree of priority thereof, and information indicating whether the display of each region of interest is essential, wherein if the information indicates a region of interest as not essential, that region of interest is not displayed.
7. The computer-implemented image decoding method according to claim 6, wherein when a plurality of regions of interest are defined on the moving image, the plurality of the regions of interest is decoded from a codestream by referring to information for specifying the plurality of the regions of interest defined on the moving image.
8. The computer-implemented image decoding method according to claim 7, wherein the respective region of interest of the plurality of regions of interest is processed according to the degree of priority thereof.
9. An image decoding apparatus, comprising:
a region-of-interest information decoding unit including at least one processor acting in accordance with instructions stored in a memory, which decodes information for specifying a region of interest defined on a moving image wherein the information is explicitly described, not as a header for each frame of the moving image, but in a codestream that contains coded data of the moving image; and
10. The image decoding apparatus according to claim 9, wherein when a plurality of regions of interest are defined on the moving image, the region-of-interest information decoding unit decodes information for specifying the plurality of the regions of interest defined on the moving image, and wherein the image decoding unit decodes the plurality of the regions of interest from the codestream by referring to the decoded information.
11. The image decoding apparatus according to claim 10, wherein the image decoding unit processes the respective region of interest of the plurality of regions of interest according to the degree of priority thereof.
This application is related to, and claims the benefit of the earlier filing date under 35 U.S.C. �119(a) of, PCT/JP 2005/019583, filed Oct. 25, 2005, and Foreign Application JAPAN 2004-316735, filed Oct. 29, 2004.
[Patent Document 1] Japanese Patent Application Laid-Open No. Hei07-203434. Nevertheless, in the above-mentioned Patent Document 1, images in a specified range and those in other ranges are coded by their respectively specified image qualities. Accordingly, at the time of a decoding they are limited by their specified image qualities, so that it is difficult to decode them with a various resolutions. Also, it is difficult to achieve a reproduction processing such as one for reproducing only an image of a specified range.
In order to resolve the above problems, an image coding method according to one embodiment of the present invention is such that information for specifying a region of interest defined on an image is explicitly described in a codestream containing coded data of the image. The “information for specifying a region of interest” may be information which is coded by referring to difference information between frames. This “different information” may be represented by a variation between frames in at least one of position, size and shape of the region of interest. It may be a difference between an average value of at least one of values representing the position, size and shape of the region of interest in each frame and values corresponding to those of a frame to be coded. Alternatively, it may be a difference between an average value of a variation, between frames, of at least one of the position, size and shape of the region of interest and a variation of a corresponding value between frames in a frame to be coded. Further, it may be a difference between an average value of variations between frames and at least one of values representing the position, size and shape of the region of interest in each frame. This is effective if the region of interest is greatly enlarged and reduced and the like. The “information for specifying a region of interest defined on an image” may be coded as a function of time. This is effective in a case when the region of interest varies with a certain rule.
Another embodiment of the present invention relates to an image coding apparatus. This apparatus comprises: a region-of-interest setting unit which defines a region of interest (ROI) on an image; an image coding unit which encodes the image; a ROI information coding unit which encodes information for specifying the region of interest; and a codestream generator which generates a codestream by including therein the coded image and the coded information in an explicit manner. The “region-of-interest setting unit” may define the region of interest on the image by a specification from a user or by an automatic recognition of an object.
Still another embodiment of the present invention relates to an image decoding method. This method is characterized in that a region including a region of interest is decoded from a codestream by referring to information for specifying the region of interest defined on an image wherein the information is explicitly described in the codestream that contains coded data of the image. The “region including a region of interest” may be a region of interest, a region including the region of interest and its peripheral region, or the entire image.
FIG. 3 is a diagram showing an example of a codestream. Here, the codestream is indicated by a term “sequence” used in MPEG (Moving Picture Experts Group). In MPEG, a coded signal for the one entire video program is called a sequence. The sequence starts with a sequence header and ends with a sequence end as shown in FIG. 3, and a plurality of GOPs are described between them. The GOP describes a GOP header and a plurality of pictures. In the example shown in FIG. 3, a plurality of pieces of ROI information are described in this GOP header. Various parameters, such as coding conditions, required for a decoding are described in the GOP header. In the present embodiment, the ROI information is described therein, too.
Next, a description is given of a method for determining by the ROI region control unit 44 the coordinates and the size of regions containing a ROI region and its peripheral region. FIGS. 5A-5C show ROI regions in each division level of wavelet transform coefficients. FIG. 5A shows a state where a ROI 90 is set on an original image 80 of division level “0”. FIG. 5B shows an image 82 of division level “1” obtained by performing one time wavelet transform on the original image 80. A transform image 82 of division level “1” is constituted by four sub-bands LL1, HL1, LH1 and HH1. The ROI region control unit 44 specifies ROI regions 91 to 94 in the transform image 82 of division level “1” necessary for restoring the ROI region 90 in the original image 80 at each of sub-bands LL1, HL1, LH1 and HH1 of division level “1”.
FIG. 5C shows a transform image 84 of division level “2” which is obtained by performing another wavelet transform on the sub-band LL1 that is the lowest frequency component of the transform image 82 shown in FIG. 5B. As shown in the figure, the transform image 84 contains four sub-bands LL2, HL2, LH2 and HH2 of division level “2” in addition to three sub-bands HL1, LH1 and HH1. The ROI region control unit 44 specifies ROI regions 95 to 98 on the transform image 84 of division level “2” necessary for restoring the ROI region 91 in the sub-band LL1 of division level “2” at each of the sub-bands LL2, HL2, LH2 and HH2.
Division level 1-
Starting coordinate P/2 − α, Size Q/2 + β
Division level 2-
Starting coordinate (P/2 − α)/2 − α,
Size (Q/2 + β)/2 + β
Division level 3-
Starting coordinate {(P/2 − α)/2 −
α}/2 − α, Size {(Q/2 + β)/2 + β}/2 + β
Division level J-
Starting coordinate [ . . . ]/2 − α,
Size [ . . . ]/2 + β
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4903317Jun 23, 1987Feb 20, 1990Kabushiki Kaisha ToshibaImage processing apparatusUS5563960 *Dec 17, 1993Oct 8, 1996David Sarnoff Research Center, Inc.Apparatus and method for emphasizing a selected region in the compressed representation of an imageUS5608458Oct 13, 1994Mar 4, 1997Lucent Technologies Inc.Method and apparatus for a region-based approach to coding a sequence of video imagesUS5799109Jun 7, 1995Aug 25, 1998Hyundai Electronics Industries Co., Ltd.Object-by shape information compression apparatus and method and coding method between motion picture compensation framesUS5978034Feb 18, 1998Nov 2, 1999Sony CorporationMoving picture encoding method and apparatus, moving picture decoding method and apparatus and recording mediumUS6457030 *Jan 29, 1999Sep 24, 2002International Business Machines CorporationSystems, methods and computer program products for modifying web content for display via pervasive computing devicesUS6584230Dec 10, 2001Jun 24, 2003Kabushiki Kaisha ToshibaImage decoding of image content within a boundary based on a map resolution transformed signalUS7650567 *Feb 24, 2004Jan 19, 2010Panasonic CorporationReception apparatus and information browsing methodUS20010024525May 1, 2001Sep 27, 2001Koichi HataImage encoding apparatus, image decoding apparatus, image encoding method, image decoding method, and mediumUS20010048770Jun 5, 2001Dec 6, 2001Mitsuru MaedaImage processing apparatus and method, and its computer program and storage mediumUS20020126906Apr 6, 2001Sep 12, 2002Charilaos ChristopoulosMethod and a system for coding roisUS20020154823Feb 14, 2002Oct 24, 2002Shigeyuki OkadaImage decoding with a simplified processUS20030025812 *Jul 5, 2002Feb 6, 2003Slatter David NeilIntelligent feature selection and pan zoom controlUS20040095477Aug 8, 2003May 20, 2004Takashi MakiROI setting method and apparatus, electronic camera apparatus, program, and recording mediumUS20040228403 *May 11, 2004Nov 18, 2004Lg Electronics Inc.Moving picture coding methodUS20050025371Aug 27, 2004Feb 3, 2005Mitsubishi Electric CorporationMethod and apparatus for compressing and decompressing imagesUS20050175251Feb 8, 2005Aug 11, 2005Sanyo Electric Co., Ltd.Image coding apparatus, image decoding apparatus, image display apparatus and image processing apparatusUS20060072667Oct 29, 2003Apr 6, 2006Koninklijke Philips Electronics N.V.Transcoder for a variable length coded data streamUS20060168517 *Feb 24, 2004Jul 27, 2006Tomoaki ItohReception apparatus and information browsing methodUS20070230658Jun 13, 2007Oct 4, 2007Sanyo Electric Co., Ltd.Image coding method and apparatus, and image decoding method and apparatusUS20070237409Mar 28, 2007Oct 11, 2007Mitsubishi Electric CorporationMethod and apparatus for compressing and decompressing imagesCN1305684AJun 10, 1999Jul 25, 2001艾利森电话股份有限公司Method and apparatus in transmission of imagesCN1320337AOct 6, 1999Oct 31, 2001艾利森电话股份有限公司Method and system for coding ROIsCN1420633AOct 15, 2002May 28, 2003日本胜利株式会社Image coding device and methodCN1496110AAug 9, 2003May 12, 2004株式会社理光ROI set-up method and equipment, electronic camera equipment, program and recording mediumCN1655620AFeb 5, 2005Aug 17, 2005三洋电机株式会社Image coding apparatus, image decoding apparatus, image display apparatusCN1717058AJun 29, 2005Jan 4, 2006三洋电机株式会社Method and apparatus for coding images and method and apparatus for decoding the imagesCN101049006AOct 25, 2005Oct 3, 2007三洋电机株式会社Image coding method and apparatus, and image decoding method and apparatusJP2001045484A Title not availableJP2001119625A Title not availableJP2001128126A Title not availableJP2001160062A Title not availableJP2001313944A Title not availableJP2002044551A Title not availableJP2002094991A Title not availableJP2002135593A Title not availableJP2002325257A Title not availableJP2002330951A Title not availableJP2002508606A Title not availableJP2003204436A Title not availableJP2003284071A Title not availableJP2003299033A Title not availableJP2003399047A Title not availableJP2004032383A Title not availableJP2004040429A Title not availableJP2004072655A Title not availableJP2004094449A Title not availableJP2004190802A Title not availableJP2004228680A Title not availableJP2004240844A Title not availableJP2004272712A Title not availableJP2004316735A Title not availableJPH0422280A Title not availableJPH0918876A Title not availableJPH0946710A Title not availableJPH1098732A Title not availableJPH1175178A Title not availableJPH05300516A Title not availableJPH07203434A Title not availableJPH07288806A Title not availableJPH08280030A Title not availableJPH10271510A Title not availableJPH10304353A Title not availableWO1999049412A1Sep 15, 1998Sep 30, 1999University Of MarylandMethod and apparatus for compressing and decompressing imagesWO1999049413A1Mar 20, 1998Sep 30, 1999Mitsubishi Electric Corp.Lossy/lossless region-of-interest image codingWO2000001153A1Jun 10, 1999Jan 6, 2000Telefonaktiebolaget Lm Ericsson (Publ)Method and apparatus in transmission of imagesWO2000022832A1Oct 6, 1999Apr 20, 2000Telefonaktiebolaget Lm Ericsson (Publ)A METHOD AND A SYSTEM FOR CODING ROIsWO2003034740A1Oct 11, 2002Apr 24, 2003Koninklijke Philips Electronics N.V.Selective decoding of enhance video streamWO2004081799A1Feb 24, 2004Sep 23, 2004Matsushita Electric Industrial Co., Ltd.Receiver apparatus and information browsing methodWO2006046551A1Oct 25, 2005May 4, 2006Sanyo Electric Co., LtdImage encoding method and device, and image decoding method and device* Cited by examinerNon-Patent CitationsReference1"Information technology-JPEG 2000 image coding system-Part 1: Core coding system," ISO/IEC 15444-1, Dec. 15, 2000, Annex H "Coding of images with regions of interest".2"Information technology—JPEG 2000 image coding system—Part 1: Core coding system," ISO/IEC 15444-1, Dec. 15, 2000, Annex H "Coding of images with regions of interest".3Chinese Office Action for corresponding CN Application No. 200510007933.4, dated Jan. 22, 2010, pp. 1-15, China.4Chinese Office Action for corresponding CN Application No. 200710197162.9, dated Oct. 30, 2009, China.5Chinese Office Action for corresponding Patent Application No. CN200510007933.4, dated Jul. 17, 2009, China.6Chinese Office Action issued in Chinese Application No. 2005100079334, dated Nov. 3, 2006 (issued in corresponding CN application to related U.S. Appl. No. 11/052,094).7Japanese Office Action for corresponding Application No. JP 2007-157542, dated Aug. 31, 2010, pp. 1-14 Japan.8Japanese Office Action for corresponding Application No. JP 2007-157544, dated Aug. 31, 2010, pp. 1-13 Japan.9Japanese Office Action for corresponding JP Application No. 2004-032394, dated Jan. 19, 2010, pp. 1-5, Japan.10Japanese Office Action for corresponding JP Application No. 2004-251939, Jun. 30, 2009, Japan.11Japanese Office Action for corresponding JP Application No. 2004-316734, dated Dec. 8, 2009, pp. 1-4, Japan.12Japanese Office Action for corresponding JP Application No. 2004-316734, dated Jun. 22, 2010, pp. 1-4 Japan.13Japanese Office Action for corresponding JP Application No. 2004-316734, dated Mar. 29, 2011, pp. 1-6, Japan.14Japanese Office Action for corresponding JP Application No. 2004-316735, dated Feb. 9, 2010, pp. 1-15, Japan.15Japanese Office Action for corresponding JP Application No. 2007-144869, dated Jun. 14, 2001, pp. 1-8, Japan.16Japanese Office Action for corresponding JP Application No. 2007-144869, dated Jun. 14, 2011, pp. 1-8, Japan.17Japanese Office Action for corresponding JP Application No. 2007-144869, dated Jun. 22, 2010, pp. 1-6 Japan.18Japanese Office Action for corresponding JP Application No. 2007-157542, Jun. 9, 2009, Japan.19Japanese Office Action for corresponding JP Application No. 2007-157542, Sep. 1, 2009, Japan.20Japanese Office Action for corresponding JP Application No. 2007-157544, Jun. 9, 2009, Japan.21Japanese Office Action for corresponding JP Application No. 2007-157544, Sep. 1, 2009, Japan.22Japanese Office Action for corresponding JP Application No. 2010-257512, dated Feb. 8, 2011, pp. 1-26 Japan.23Japanese Office Action for related JP Application No. 2004-316735, Dec. 9, 2008, 4P, Japan.24Korean Office Action for corresponding KR Application No. 10-2007-7012013, Aug. 31, 2009, Korea.25Korean Office Action for corresponding KR Application No. 10-2008-7008106, Aug. 31, 2009, Korea.26Korean Office Action for corresponding KR Application No. 10-2008-7008107, Aug. 31, 2009, Korea.27Office Action for related U.S. Appl. No. 11/762,456, Jun. 10, 2011, pp. 1-95.28Office Action for U.S. Appl. No. 13/029,748 dated Mar. 15, 2012, pp. 1-34.29Official Action Dated Oct. 14, 2008 From the JP Patent Office Re.: Application No. 2004-190802 (with English translation).30Official Action Dated Sep. 9, 2008 From the JP Patent Office Re.: Application No. 2004-316735 (with English translation).31Response to Non-Final Office Action for corresponding U.S. Appl. No. 11/718,211, filed May 5, 2011, pp. 1-10.32Response to U.S. Office Action for corresponding U.S. Appl. No. 11/762,456, filed Apr. 5, 2011, pp. 1-8.33Taiwanese Office Action for related TW Application No. 94137601, Feb. 25, 2009, Taiwan.34U.S. Appl. No. 11/052,094, filed Feb. 8, 2005, Taketa et al.35U.S. Appl. No. 11/718,211, filed Apr. 27, 2007, Taketa et al.36U.S. Office Action for corresponding U.S. Appl. No. 11/718,211, dated Feb. 17, 2011, pp. 1-15.37U.S. Office Action for corresponding U.S. Appl. No. 11/718,211, dated May 18, 2010, pp. 1-47.38U.S. Office Action for corresponding U.S. Appl. No. 12/621,952, dated Dec. 27, 2010, pp. 1-26.39United States Office Action for corresponding U.S. Appl. No. 11/762,456, dated Jan. 18, 2011, pp. 1-17.Referenced byCiting PatentFiling datePublication dateApplicantTitleUS8442109 *Jul 9, 2007May 14, 2013Nokia CorporationSignaling of region-of-interest scalability information in media filesUS20080007651 *Aug 18, 2006Jan 10, 2008Broadcom Corporation, A California CorporationSub-frame metadata distribution serverUS20080013621 *Jul 9, 2007Jan 17, 2008Nokia CorporationSignaling of region-of-interest scalability information in media files* Cited by examinerClassifications U.S. Classification382/232, 382/233, 382/236, 382/240, 382/243International ClassificationH04N19/134, H04N19/635, H04N19/513, H04N19/91, H04N19/102, H04N19/34, H04N19/463, H04N19/51, H04N19/61, H04N19/167, H04N19/503, H04N19/70, H04N19/46, G06K9/46, G06K9/36, H04N19/00, H04N1/41, H03M7/30Cooperative ClassificationH04N19/70, H04N19/105, H04N19/17, H04N19/63, H04N19/537European ClassificationH04N7/26A8R, H04N7/36C6, H04N7/26H30, H04N7/26A4B, H04N7/26Y, H04N7/26H30C2JLegal EventsDateCodeEventDescriptionApr 30, 2007ASAssignmentOwner name: SANYO ELECTRIC CO., LTD., JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OKADA, SHIGEYUKI;TAKETA, KAZUHIKO;REEL/FRAME:019228/0502Effective date: 20070412Jun 15, 2014ASAssignmentOwner name: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMEFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SANYO ELECTRIC CO., LTD.;REEL/FRAME:033104/0874Effective date: 20140527Dec 9, 2015FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services