Source: http://www.google.com/patents/US7911537?ie=ISO-8859-1&dq=5,825,352
Timestamp: 2015-07-04 05:26:15
Document Index: 231678547

Matched Legal Cases: ['art-10', 'art-2', 'art-10', 'art-2', 'art-10', 'art-2', 'art-10', 'art-2', 'art-10', 'art-2', 'art-10', 'art-10', 'art-10']

Patent US7911537 - Multichannel video reception apparatus and method for digital broadcasting - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsProvided is a multichannel video reception apparatus of a mobile communication terminal for digital broadcasting. An RF processor receives a broadcast signal of a digital broadcast service via an antenna. A baseband processor processes the received broadcast signal in a baseband. A controller controls...http://www.google.com/patents/US7911537?utm_source=gb-gplus-sharePatent US7911537 - Multichannel video reception apparatus and method for digital broadcastingAdvanced Patent SearchPublication numberUS7911537 B2Publication typeGrantApplication numberUS 11/441,512Publication dateMar 22, 2011Filing dateMay 26, 2006Priority dateMay 26, 2005Fee statusPaidAlso published asUS20060285015Publication number11441512, 441512, US 7911537 B2, US 7911537B2, US-B2-7911537, US7911537 B2, US7911537B2InventorsKwang-Pyo Choi, Kwang-Cheol Choi, Young-O ParkOriginal AssigneeSamsung Electronics Co., LtdExport CitationBiBTeX, EndNote, RefManPatent Citations (46), Referenced by (3), Classifications (25), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetMultichannel video reception apparatus and method for digital broadcasting
US 7911537 B2Abstract
Provided is a multichannel video reception apparatus of a mobile communication terminal for digital broadcasting. An RF processor receives a broadcast signal of a digital broadcast service via an antenna. A baseband processor processes the received broadcast signal in a baseband. A controller controls the RF processor and the baseband processor to receive the broadcast signal including video frames of a main channel and a sub-channel. A memory stores a program code, reference data, and updatable user data, for an operation of the controller. A video processor receives the video frames of the main channel and the sub-channel, decodes the latest key frame of the sub-channel if a key frame of the main channel occurs while decoding the video frames of the main channel, and after decoding the key frame of the sub-channel, decodes the frames of the main channel. A display divides the decoded video signal into a main-channel image and a sub-channel image and separately displays the images. An audio processor outputs an audio signal of the digital broadcast service included in the broadcast signal.
1. A multichannel video reception apparatus of a mobile communication terminal for receiving digital broadcasting, the apparatus comprising:
a radio frequency (RF) processor for receiving a broadcast signal of a digital broadcast service via an antenna;
a baseband processor for processing the received broadcast signal in a baseband;
a controller for controlling the RF processor and the baseband processor to receive the broadcast signal including video frames of a main channel and a sub-channel, the video frames representing coded video data;
a memory for storing a program code, reference data, and updatable user data, for an operation of the controller;
a video processor for receiving the video frames of the main channel and the sub-channel, decoding a latest key frame of the sub-channel when a key frame of the main channel occurs while decoding the video frames of the main channel, and decoding the frames of the main channel after decoding the latest key frame of the sub-channel; and
a display for dividing the decoded video signal into a main-channel image and a sub-channel image and separately displaying the images,
wherein the main channel and the sub-channel are respectively determined among a plurality of channels according to a predetermined priority.
2. The multichannel video reception apparatus of claim 1, further comprising an audio processor for outputting an audio signal of the digital broadcast service included in the broadcast signal.
3. The multichannel video reception apparatus of claim 1, wherein the video processor comprises:
a key frame extractor for receiving frames representing coded video data of the sub-channel, extracting a key frame among the frames of the sub-channel, and storing the extracted key frame;
a key frame recognizer for receiving frames representing coded video data of the main channel, and detecting a key frame among the frames of the main channel;
a channel selector for outputting the frames of the main channel upon failure to detect the key frame of the main channel, outputting the stored key frame of the sub-channel upon detecting the key frame of the main channel by the key frame recognizer, and after outputting the key frame of the sub-channel, outputting the key frame of the main channel and its succeeding frames; and
a video decoder for decoding frames of one of the main channel and the sub-channel, output from the channel selector, and outputting video signals.
4. The multichannel video reception apparatus of claim 3, further comprising a video selector for separately outputting the decoded video signals for the main channel and the sub-channel.
5. The multichannel video reception apparatus of claim 4, wherein upon failure to detect the key frame of the main channel, the video selector outputs the video signal output from the video decoder as a main-channel video image after waiting a one-frame processing time of the video decoder, and upon detecting the key frame of the main channel, the video selector outputs the video signal output from the video decoder as a sub-channel video image after waiting the one-frame processing time of the video decoder.
6. The multichannel video reception apparatus of claim 3, wherein the key frame includes an Instantaneous Decoder Refresh (IDR) type frame defined in MPEG-4 part-10/H.264.
7. The multichannel video reception apparatus of claim 3, wherein the key frame includes an Intra (I) type frame defined in one of MPEG-4 part-2 and H.263.
8. The multichannel video reception apparatus of claim 3, wherein the key frame extractor stores the latest sub-channel key frame until the key frame of the main channel is detected.
9. A multichannel video reception method for receiving digital broadcasting, the method comprising the steps of:
receiving a frame representing coded video data of a main channel, and determining whether the received frame of the main channel is a key frame;
if the received frame of the main channel is not a key frame, decoding a non-key frame of the main channel and outputting the decoded non-key frame as a video signal of the main channel;
if the received frame of the main channel is a key frame, decoding a previously stored latest key frame of a sub-channel, and outputting the decoded key frame as a video signal of the sub-channel; and
after decoding the key frame of the sub-channel, decoding a key frame of the main channel and outputting the decoded key frame of the main channel as a video signal of the main channel,
10. The multichannel video reception method of claim 9, wherein the decoded video signals are separately output for the main channel and the sub-channel according to whether the key frame of the main channel is detected.
11. The multichannel video reception method of claim 9, wherein the key frame includes an Instantaneous Decoder Refresh (IDR) type frame defined in MPEG-4 part-10/H.264.
12. The multichannel video reception method of claim 9, wherein the key frame includes an Intra (I) type frame defined in one of MPEG-4 part-2 and H.263.
13. A multichannel video reception apparatus for receiving digital broadcasting, the apparatus comprising:
a key frame extractor for receiving frames representing coded video data of a sub-channel, extracting a key frame among the frames of the sub-channel, and storing the extracted key frame;
a key frame recognizer for receiving frames representing coded video data of a main channel, and detecting a key frame among the frames of the main channel;
a channel selector for outputting the frames of the main channel upon failure to detect the key frame of the main channel, and upon detecting the key frame of the main channel by the key frame recognizer, outputting the stored key frame of the sub-channel, and after outputting the key frame of the sub-channel, outputting the key frame of the main channel and its succeeding frames; and
a video decoder for decoding frames of one of the main channel and the sub-channel, output from the channel selector, and outputting video signals,
14. The multichannel video reception apparatus of claim 13, further comprising a video selector for separately outputting the decoded video signals for the main channel and the sub-channel.
15. The multichannel video reception apparatus of claim 14, wherein upon failure to detect the key frame of the main channel, the video selector outputs the video signal output from the video decoder as a main-channel video image after waiting a one-frame processing time of the video decoder, and upon detecting the key frame of the main channel, the video selector outputs the video signal output from the video decoder as a sub-channel video image after waiting the one-frame processing time of the video decoder.
16. The multichannel video reception apparatus of claim 13, wherein the key frame includes an Instantaneous Decoder Refresh (IDR) type frame defined in MPEG-4 part-10/H.264.
17. The multichannel video reception apparatus of claim 13, wherein the key frame includes an Intra (I) type frame defined in one of MPEG-4 part-2 and H.263.
18. The multichannel video reception apparatus of claim 13, wherein the key frame extractor stores a latest sub-channel key frame until the key frame of the main channel is detected. Description
This application claims the benefit under 35 U.S.C. �119(a) of an application entitled “Multichannel Video Reception Apparatus and Method for Digital Broadcasting” filed in the Korean Intellectual Property Office on May 26, 2005 and assigned Serial No. 2005-44693, the entire contents of which are incorporated herein by reference.
The present invention relates generally to video decoding, and in particular, to a multichannel video reception apparatus and method for digital broadcasting.
In general, a digital broadcasting system, such as Digital Multimedia Broadcasting (DMB), simultaneously transmits the video data generated through coding/modulation/multiplexing processes over several service channels. A receiver receives desired video service data by demultiplexing a particular service channel. As there is an increasing demand for Quality-of-Service (QoS), and as the video technology has developed, the user can view video images of multiple channels (i.e., multichannel video images) on one screen of the receiver. Picture-in-Picture (PiP) is a typical example of the multichannel video images. PiP is useful when the user desires to view or scan other service programs with a smaller display screen while viewing a first selected service program with a larger display screen. The technology associated therewith includes an Electronic Program Guide (EPG) in which the user scans other service channels while receiving (or viewing) video data of a desired service channel on a screen.
In order to simultaneously decode video data received through more than two service channels in this way, there is a need for more than two video decoders.
FIG. 1 is a block diagram illustrating a multichannel video receiver with two video decoders according to the prior art.
As illustrated, a service channel primarily desired by the user is mapped to a main channel 100, and a service channel secondarily desired by the user is mapped to a sub-channel 110. In another case, a service channel desired by the user is mapped to the main channel 100, and a service channel the user desires to scan is mapped to the sub-channel 110. A received signal including video data of the main channel 100 is demultiplexed/demodulated by a channel receiver A 102, and then input to a video decoder A 104. The video decoder A 104 decodes the data output from the channel receiver A 102, and outputs a main-channel video signal 106. The main-channel video signal 106 is displayed on a screen after passing through a video buffer (not shown). Similarly, a received signal including video data of the sub-channel 110 is demultiplexed/demodulated by a channel receiver B 112, and then input to a video decoder B 114. The video decoder B 114 decodes the data output from the channel receiver B 112, and outputs a sub-channel video signal 116. The sub-channel video signal 116 is displayed on a screen after passing through a video buffer (not shown). The sub-channel video image can be down-sized according to its displaying size on the screen.
The use of two or multiple video decoders can maximize video decoding performance, but is not appropriate for a portable DMB receiver due to the high system complexity. In addition, the use of an additional decoder for the service requiring lower-resolution video processing for the sub-channel, like the PiP and EPG, unnecessarily increases the system complexity.
To substantially solve at least the above problems and/or disadvantages and to provide at least the advantages below, the present invention provides an apparatus and method for efficiently simultaneously decoding video images transmitted from more than two service channels, using one video decoder.
According to one aspect of the present invention, there is provided a multichannel video reception apparatus of a mobile communication terminal for digital broadcasting. The apparatus includes a radio frequency (RF) processor for receiving a broadcast signal of a digital broadcast service via an antenna; a baseband processor for processing the received broadcast signal in a baseband; a controller for controlling the RF processor and the baseband processor to receive the broadcast signal including video frames of a main channel and a sub-channel, the video frames representing coded video data; a memory for storing a program code, reference data, and updatable user data, for an operation of the controller; a video processor for receiving the video frames of the main channel and the sub-channel, decoding the latest key frame of the sub-channel if a key frame of the main channel occurs while decoding the video frames of the main channel, and after decoding the key frame of the sub-channel, decoding the frames of the main channel; a display for dividing the decoded video signal into a main-channel image and a sub-channel image and separately displaying the images; and an audio processor for outputting an audio signal of the digital broadcast service included in the broadcast signal.
Preferably, the video processor includes a key frame extractor for receiving frames representing coded video data of the sub-channel, extracting a key frame among the frames of the sub-channel, and storing the extracted key frame; a key frame recognizer for receiving frames representing coded video data of the main channel, and detecting a key frame among the frames of the main channel; a channel selector for outputting the frames of the main channel upon failure to detect a key frame of the main channel, outputting the stored key frame of the sub-channel upon detecting the key frame of the main channel by the key frame recognizer, and after outputting the key frame of the sub-channel, outputting the key frame of the main channel and its succeeding frames; and a video decoder for decoding frames of the main channel or the sub-channel, output from the channel selector, and outputting video signals.
According to another aspect of the present invention, there is provided a multichannel video reception method for digital broadcasting. The method includes receiving a frame representing coded video data of a main channel, and determining whether the received frame of the main channel is a key frame; if the received frame of the main channel is not a key frame, decoding a non-key frame of the main channel and outputting the decoded non-key frame as a video signal of the main channel; if the received frame of the main channel is a key frame, decoding the previously stored latest key frame of a sub-channel, and outputting the decoded key frame as a video signal of the sub-channel; and after decoding the key frame of the sub-channel, decoding a key frame of the main channel and outputting the decoded key frame of the main channel as a video signal of the main channel.
FIG. 1 is a block diagram illustrating a multichannel video receiver with two video decoders according to the prior art;
FIG. 2 is a diagram illustrating a format of MPEG-4 part-10/H.264 frames;
FIG. 3 is a diagram illustrating a structure of a mobile communication terminal capable of multichannel video reception according to the present invention;
FIG. 4 is a block diagram illustrating a multichannel video receiver with a single video decoder according to the present invention;
FIG. 5 is a conceptual diagram illustrating a decoding procedure of a main channel and a sub-channel according to the present invention;
FIG. 6 is a diagram illustrating an exemplary display screen through which a main channel and a sub-channel are simultaneously output;
FIG. 7 is a flowchart illustrating an operation of storing a sub-channel key frame according to the present invention; and
FIG. 8 is a flowchart illustrating an operation of decoding a multichannel video image according to the present invention.
The present invention efficiently and simultaneously decodes video images received from two or more service channels, using one video decoder. A service channel primarily desired by a user becomes a main channel, and another service channel secondarily desired by the user, or another service channel the user desires to scan becomes a sub-channel. One video decoder connectable to both the main channel and the sub-channel decodes major frames of the sub-channel at a possible time, while decoding video frames of the main channel.
Herein, the term “possible time” refers to the time when a key frame occurs in the main channel. Most video technologies transmit a differential frame indicating a difference between a previous video frame and the current video frame, i.e., a non-key frame, in order to minimize a size of video frames transmitted at a predetermined frame rate. The differential frame includes only the coded video information for the part non-identical to the previous video frame, depending on the previous frame. For decoding of the differential frame, a key frame including coded video information having no correlation with the previous/next video frames is transmitted. The key frame includes coded video information for the entire video image at a corresponding time regardless of the previous video frame. This key frame can be transmitted periodically, or at a time when the video image undergoes a great change. An example of the key frame includes an Intra (I) type frame for H.263 or Moving Picture Experts Group (MPEG)-4 part-2, and an Instantaneous Decoder Refresh (IDR) type frame for MPEG-4 part-10/H.264.
Aside from the coded video data included in the key frame, the important information necessary for decoding, such as size information and basic quantization value of the video image, can be included in the key frame. For example, the important information includes Video Object Layer (VOL) for MPEG-4 part-2, and Sequence Parameter Set (SPS) and Picture Parameter Set (PPS) for MPEG-4 part-10/H.264.
It is possible to determine whether the coded video frame is a key frame, from a header of the coded video information. For example, for MPEG-4 part-10/H.264, if nal_unit_type of a Network Adaptation Layer (NAL) header is ‘00101’, it indicates that the coded video frame is an IDR type coded video frame. With the use of the nal_unit_type, it is possible to determine the type of the coded video frame without fully decoding the coded video data.
FIG. 2 is a diagram illustrating a format of MPEG-4 part-10/H.264 frames.
As illustrated, the first 8 bits of each of an IDR type frame 30 and a non-IDR type frame 32 constitute an NAL header. Of the 8 bits, 5 Least Significant Bit (LSB) bits constitute an nal_unit_type field indicating a type of the succeeding coded video data. If a value of the nal_unit_type field is ‘00101’, it indicates that the succeeding coded video data is the IDR type, and if a value of the nal_unit_type field is ‘00001’, it indicates that the succeeding coded video data is the non-IDR type.
FIG. 3 is a diagram illustrating a structure of a mobile communication terminal capable of multichannel video reception according to the present invention. The mobile communication terminal includes a Radio Frequency (RF) processor 12, a baseband processor 14, a controller 10, a video processor 16, a display 18, a key input unit 20, a memory 22, and an audio processor 24. Herein, the mobile communication terminal capable of receiving digital broadcast service, such as DMB service and Digital Video Broadcasting-Handheld (DVB-H) service, is shown as an example of the multichannel video receiver of the present invention.
Referring to FIG. 3, the RF processor 12 can receive a communication signal based on a radio access technology of the mobile communication terminal and can also receive a broadcast signal from a digital broadcasting system via an antenna. The baseband processor 14 processes the communication signal and the broadcast signal in a baseband. The controller 10 operates using program codes, reference data and various updatable user data, stored in the memory 22, and controls communication of the RF processor 12 and the baseband processor 14. The display 18, under the control of the controller 10, displays a state of the mobile communication terminal and the user information, and in particular, outputs video data of the digital broadcast service according to the procedure described below. The audio processor 24, connected to a speaker and a microphone, performs voice communication and outputs audio data of the digital broadcast service according to the procedure described below, under the control of the controller 10.
If the user requests reception of the DMB service by manipulating the key input unit 20, or if a DMB service request is received in another method, the controller 10 receives a broadcast signal using the video processor 16 by controlling the RF processor 12 and the baseband processor 14. The received broadcast signal includes video data coded by the digital broadcasting system, i.e., includes video frames. If the user desires to receive multiple broadcast service channels, the baseband processor 14 demodulates/decodes broadcast signals of the requested broadcast service channels, and provides the resultant broadcast signals to the video processor 16.
The video processor 16 receives the video frames. In this case, video frames of a main channel, which is a service channel primarily desired by the user, and video frames of a sub-channel, which is a service channel secondarily desired by the user, or a service channel the user desires to scan, are input to the video processor 16. The video processor 16 temporarily holds a key frame of the main frame (for example, for a one-frame duration) and decodes the latest key frame of the sub-channel at the time that the key frame of the main channel occurs, while it is decoding video frames of the main channel. After decoding the key frame of the sub-channel, the video processor 16 resumes the decoding of the main channel. The decoded video signal is divided into a main-channel video signal and a sub-channel video signal, and then output through the display 18.
The display 18 can have a single screen or multiple screens. The display 18 outputs the main-channel video signal with a larger part in the single screen, and outputs the sub-channel video signal with a smaller part in the single screen. Alternatively, the display 18 separately outputs the main-channel video signal and the sub-channel video signal on their associated screens.
FIG. 4 is a block diagram illustrating a multichannel video receiver with a single video decoder according to the present invention. The multichannel video receiver includes a channel receiver A 202 for a main channel 200, a channel receiver B 212 for a sub-channel 210, a key frame recognizer 203 for the main channel 200, a key frame extractor 214 for the sub-channel 210, a channel selector 204, a video decoder 206, and a video selector 208. The channel receivers 202 and 212 are included in the RF processor 12 and the baseband processor 14 of FIG. 3.
Referring to FIG. 4, a service channel primarily desired by the user is mapped to the main channel 200, and a service channel secondarily desired by the user is mapped to the sub-channel 210. In another case, a service channel desired by the user is mapped to the main channel 200, and a service channel the user desires to scan is mapped to the sub-channel 210. A received signal including video data of the main channel 200 is demultiplexed/demodulated by the channel receiver A 202. Similarly, a received signal including video data of the sub-channel 210 is demultiplexed/demodulated by the channel receiver B 212.
The channel receiver A 202 outputs consecutive frames containing coded video information of the main channel 200. The key frame recognizer 203 recognizes key frames by analyzing headers of the main-channel frames, and upon detecting a main-channel key frame, provides a control signal to the channel selector 204 and the video selector 208.
The channel receiver B 212 outputs consecutive frames containing coded video information of the sub-channel 210. The key frame extractor 214 attempts to detect a key frame by analyzing the sub-channel frames, and upon detecting a sub-channel key frame, stores the sub-channel key frame in its buffer (not shown). If the next sub-channel key frame is detected before the current sub-channel key frame is output, the key frame extractor 214 clears the buffer to the previously stored sub-channel key frame, and stores the next sub-channel key frame in the buffer. In this manner, the key frame extractor 214 always stores the latest sub-channel key frame. At this time, differential frames of the sub-channel 210 are discarded.
The channel selector 204 simply bypasses the main-channel frames received via the key frame recognizer 203 to the video decoder 206, when a control signal indicating generation of the main-channel key frames is not generated by the key frame recognizer 203. On the contrary, when the control signal is generated, the channel selector 204 reads out the sub-channel key frame buffered in the key frame extractor 214 and delivers the read sub-channel key frame to the video decoder 206. After delivering the sub-channel key frame, the channel selector 204 delivers again the main-channel key frames to the video decoder 206 beginning at the sub-channel key frame.
When the control signal is generated as stated above, the decoding of the main-channel key frames is temporarily held and the sub-channel key frame is input to the video decoder 206 by the channel selector 204. That is, the sub-channel key frame is input to the video decoder 206 before the main-channel key frame is input to the video decoder 206. At this moment, the main-channel key frame can be temporarily stored in the buffer of the channel receiver A 202 together with the succeeding non-key frames. In another case, the video decoder 206, if it has a capability of operating at sufficiently high speed, decodes the sub-channel key frame, while the decoding of the main channel is temporarily held, and successively decodes the main-channel key frame and the non-key frames.
The video decoder 206 decodes the video frames received via the channel selector 204, and outputs video signals mapped to the respective frames. If the received frame is not a key frame but a differential frame, the video decoder 206 combines the received differential frame with the previously processed frame to restore a video signal of the corresponding channel. On the contrary, if the received frame is a key frame, the video decoder 206 refreshes the existing video processing, and restores a video signal of the corresponding channel only with the key frame. Herein, the procedure for restoring the video signal by the video decoder 206 follows the video coding technology, and a detailed description thereof will be omitted, because it is not related to the gist of the present invention.
The video signals output from the video decoder 206 are input to the video selector 208. When the control signal indicating generation of the main-channel key frames is not generated by the key frame recognizer 203, the video selector 208 outputs the video signals output from the video decoder 206 as a main-channel image 216, after waiting a one-frame processing time of the video decoder 206. The main-channel image 216 is displayed on a main screen, or stored at the user's request. On the contrary, when the control signal is generated, the video selector 208 outputs the video signal output from the video decoder 206 as a sub-channel image 218, after waiting the one-frame processing time of the video decoder 206. Similarly, the sub-channel image 218 is displayed on a sub-screen, or stored at the user's request. In the case of PiP, the main screen may be the entire display screen, and the sub-screen may be a part (or window) of the main screen.
FIG. 5 is a conceptual diagram illustrating a decoding procedure of a main channel and a sub-channel according to the present invention. FIG. 6 is a diagram illustrating an exemplary display screen through which a main channel and a sub-channel are simultaneously output.
As illustrated, coded video data 302 obtained from a main channel includes several differential frames 304 and a key frame 306. Similarly, coded video data 312 of a sub-channel includes several differential frames 310 and a key frame 308. A video decoder 314, in the course of normally decoding frames of the main channel, receives the previously extracted key frame 308 of the sub-channel before the key frame 306 of the main channel is received, and decodes the received key frame 308. At this time, the main-channel key frame 306 and its succeeding non-key (differential) frames 304 can be temporarily stored by a channel receiver A 202 or other constituent elements. After the sub-channel key frame 308 is decoded by the video decoder 314, the decoded video signal is output to a sub-screen 404 as a sub-channel image 318 by the video selector 208. After the sub-channel key frame 308 is decoded, the video decoder 314 starts again decoding the main-channel key frame 306 and its succeeding non-key frames 304. The decoded video signal corresponding to the main-channel frames 306 and 304 is output to a main screen 402 as a main-channel image 316 by the video selector 208.
In this way, by temporarily delaying the main-channel key frame and decoding the previously stored sub-channel key frame whenever the main-channel key frame occurs, it is possible to obtain a sub-channel image without affecting the quality of the main-channel image. In most cases, because the user simply desires to recognize the service contents of the sub-channel, it is possible to meet the user's demand for the sub-channel by simply providing a sub-screen that is smaller in size and lower in frame rate than the main screen.
FIG. 7 is a flowchart illustrating an operation of storing a sub-channel key frame according to the present invention.
As illustrated, a multichannel video receiver receives a coded sub-channel video frame in step 502, and analyzes a header of the received frame in step 504 to determine whether the received frame is a sub-channel key frame. If the received frame is not a sub-channel key frame, the multichannel video receiver determines the received frame to a sub-channel differential frame and discards the sub-channel differential frame in step 506. On contrary, if the received frame is a sub-channel key frame, the multichannel video receiver stores the sub-channel key frame in a key frame extractor in step 508. Thereafter, the multichannel video receiver returns to step 502, and repeats its succeeding steps every time a sub-channel key frame is received. By doing so, the key frame extractor always stores the latest sub-channel key frame.
As illustrated, a multichannel video receiver receives a coded main-channel video frame in step 602, and analyzes a header of the received frame in step 604 to determine whether the received frame is a main-channel key frame. If the received key frame is not a main-channel key frame, the multichannel video receiver determines the received frame is a main-channel differential frame, and immediately delivers the main-channel differential frame to a video decoder. On the contrary, if the received frame is a main-channel key frame, the multichannel video receiver temporarily holds inputting of the main-channel video image to the video decoder in step 608, and delivers the latest sub-channel key frame stored in a key frame extractor to the video decoder in step 610.
In step 612, the video decoder decodes the received sub-channel differential frame or the sub-channel key frame, and outputs a video signal. Although not illustrated, if there is no sub-channel key frame stored in the key frame extractor at the time when the main-channel key frame occurs, the main-channel key frame is immediately delivered to the video decoder. The multichannel video receiver determines in step 614 whether the video signal is related to the main-channel video image or the sub-channel video image. If the video signal is related to the main-channel video image, the multichannel video receiver outputs the video signal to a main screen and returns to step 602 to receive the next main-channel frame. However, if the video signal is related to the sub-channel video image, the multichannel video receiver outputs the video signal to a sub-screen. Thereafter, the multichannel video receiver delivers the main-channel key frame to the video decoder in step 616, and the video decoder decodes the temporarily held main-channel key frame into a video signal in step 612. After the main-channel key frame is decoded, the multichannel video receiver returns to step 602 to receive the next main-channel frame.
If the multichannel video receiver decodes a sub-channel video image with one general video decoder in the course of decoding a coded main-channel video image, the contents stored in a frame buffer of the video decoder are damaged, causing considerable image degradation when the video receiver later decodes again the main-channel video image. However, the multichannel video receiver of the present invention decodes a sub-channel key frame every time a main-channel key frame occurs, making it possible to obtain a sub-channel video image in units of key frames without deteriorating the quality of the main-channel video image. In particular, this technology can be effectively applied to PiP and realtime EPG services in the digital broadcasting system such as DMB and DVB-H systems.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5598222 *Apr 18, 1995Jan 28, 1997Hatachi American, Ltd.Method and apparatus for decoding multiple video bitstreams using a common memoryUS5926227 *Jul 28, 1997Jul 20, 1999Lsi Logic CorporationVideo decoder dynamic memory allocation system and method with error recoveryUS5969768 *Oct 26, 1998Oct 19, 1999Hitachi America, Ltd.Methods and apparatus for re-using decoder circuitryUS6041068 *Aug 11, 1997Mar 21, 2000U.S. Philips CorporationMethod and apparatus for multiplexing and transmitting autonomously/intra coded pictures along with the main or I, P, B pictures/videoUS6100932 *Dec 11, 1998Aug 8, 2000Hitachi Of America, Ltd.Methods and apparatus for efficiently storing reference frame data and using the stored data to perform motion compensated predictionsUS6115080 *Jun 5, 1998Sep 5, 2000Sarnoff CorporationChannel selection methodology in an ATSC/NTSC television receiverUS6212680 *Mar 4, 1998Apr 3, 2001Kabushiki Kaisha ToshibaMulti-channel electronic programming guide and soft picture-in-picture acquisition for use with digital televisionUS6262770 *Apr 28, 1998Jul 17, 2001Hitachi America, Ltd.Methods and apparatus for decoding high and standard definition images and for decoding digital data representing images at less than the image's full resolutionUS6272680 *Apr 18, 2000Aug 7, 2001Zenith Electronics CorporationVideo display initiated by internet module of web TVUS6473130 *Nov 5, 1998Oct 29, 2002Samsung Electronics Co., Ltd.Method and apparatus for displaying sub-picturesUS6473137 *Jun 28, 2000Oct 29, 2002Hughes Electronics CorporationMethod and apparatus for audio-visual cues improving perceived acquisition timeUS6636271 *Jan 7, 1999Oct 21, 2003Thomson Licensing S.A.Apparatus and method for playing back a recorded video signal in a time compressed mannerUS6680754 *Jun 26, 2000Jan 20, 2004Samsung Electronics Co., Ltd.Digital broadcasting receiving realizing picture-in-picture function using a plurality of decodersUS6774918 *Jun 28, 2000Aug 10, 2004Koninklijke Philips Electronics N.V.Video overlay processor with reduced memory and bus performance requirementsUS6784945 *Oct 1, 1999Aug 31, 2004Microtune (Texas), L.P.System and method for providing fast acquire time tuning of multiple signals to present multiple simultaneous imagesUS6804824 *Jun 30, 2000Oct 12, 2004Microsoft CorporationSystems and methods using multiple tunersUS6917652 *Jan 11, 2001Jul 12, 2005Lg Electronics, Inc.Device and method for decoding video signalUS6950624 *Aug 2, 2002Sep 27, 2005Samsung Electronics Co., Ltd.Apparatus and method for providing television broadcasting service in a mobile communication systemUS6980257 *Nov 18, 2002Dec 27, 2005Sharp Laboratories Of America, Inc.Plural-source, selectable, combined image/text single-screen displayUS6985188 *Nov 30, 1999Jan 10, 2006Thomson LicensingVideo decoding and channel acquisition systemUS7043059 *Jan 9, 2002May 9, 2006Hewlett-Packard Development Company, L.P.Method of selectively storing digital imagesUS7164448 *Nov 28, 2002Jan 16, 2007Advanced Digtial Broadcast Polska Sp. z o.o.Method for scrolling MPEG-compressed picturesUS7307669 *Jun 24, 2003Dec 11, 2007Broadcom CorporationSystem, method, and apparatus for displaying streams with dynamically changing formatsUS7375761 *Jan 22, 2004May 20, 2008Hitachi, Ltd.Receiver having motion picture data decoderUS7400360 *Sep 22, 2003Jul 15, 2008Lsi CorporationDevice for simultaneous display of video at two resolutions with different fractions of active regionsUS7528889 *Oct 29, 2007May 5, 2009Broadcom CorporationSystem, method, and apparatus for displaying streams with dynamically changing formatsUS7532253 *Jul 26, 2005May 12, 2009Pixelworks, Inc.Television channel change picture-in-picture circuit and methodUS7561777 *Mar 13, 2001Jul 14, 2009Thomson LicensingMethod and apparatus for simultaneous recording and displaying two different video programsUS7634794 *Jul 14, 2000Dec 15, 2009Lg Electronics Inc.Broadcasting service system using mobile communication terminalUS7644425 *Mar 22, 2006Jan 5, 2010Alcatel LucentPicture-in-picture mosaicUS20010007576 *Jan 11, 2001Jul 12, 2001Lg Electronics Inc.Device and method for decoding video signalUS20020106025 *Dec 11, 2001Aug 8, 2002Ikuo TsukagoshiVideo decoder and method for using the sameUS20020110286 *Jan 9, 2002Aug 15, 2002Cheatle Stephen PhilipMethod of selectively storing digital imagesUS20030016304 *Oct 1, 1999Jan 23, 2003John P. NorsworthySystem and method for providing fast acquire time tuning of multiple signals to present multiple simultaneous imagesUS20040003399 *Jun 16, 2003Jan 1, 2004Cooper J. CarlChannel surfing compressed television sign method and television receiverUS20040028142 *Aug 5, 2003Feb 12, 2004Kim Eung TaeVideo decoding systemUS20040181813 *Mar 22, 2004Sep 16, 2004Takaaki OtaMethods and systems for rapid channel change within a digital systemUS20040189690 *Mar 28, 2003Sep 30, 2004Sony CorporationSystem and method for previewing digital contentUS20040194134 *Mar 25, 2003Sep 30, 2004Gunatilake Priyan DevekaMethod and system for rapid channel change providing stored images of current channel programsUS20060050790 *Sep 19, 2003Mar 9, 2006Onno EerenbergManipulating sub-pictures of a compressed video signalUS20060082685 *Sep 20, 2005Apr 20, 2006Samsung Electronics Co., Ltd.PIP image reproducing apparatus for image reproducing during firmware upgrade of cable card and image reproducing method using the sameUS20060109380 *Nov 27, 2003May 25, 2006Koninklijke Philips Electronics N.V.Television display unitUS20070192816 *Feb 7, 2007Aug 16, 2007Jean-Luc ColletMethod and apparatus for providing a picture in picture serviceUS20070250896 *Mar 22, 2006Oct 25, 2007AlcatelPicture-in-picture mosaicUS20090015725 *Jan 18, 2008Jan 15, 2009Samsung Electronics Co., Ltd.Method and apparatus for outputting video frames while changing channels with digital broadcast receiverKR20030009669A Title not available* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS8964838 *Jul 1, 2011Feb 24, 2015Apple Inc.Video coding system using sub-channels and constrained prediction references to protect against data transmission errorsUS20100150230 *Dec 17, 2008Jun 17, 2010Apple Inc.Video coding system using sub-channels and constrained prediction references to protect against data transmission errorsUS20110274167 *Jul 1, 2011Nov 10, 2011Apple Inc.Video coding system using sub-channels and constrained prediction references to protect against data transmission errors* Cited by examinerClassifications U.S. Classification348/565, 348/718, 348/706, 348/714, 348/567, 348/731International ClassificationH04N5/50, H04N9/64, H04N5/268, H04N5/45, H04N5/445, H04N5/44Cooperative ClassificationH04N21/440263, H04N21/4263, H04N21/4316, H04N5/4401, H04N21/4383, H04N5/45, H04N5/46European ClassificationH04N5/44N, H04N5/45, H04N21/438T, H04N21/4402S, H04N21/426B3, H04N21/431L3Legal EventsDateCodeEventDescriptionAug 23, 2006ASAssignmentOwner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OFFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHOI, KWANG-PYO;CHOI, KWANG-CHEOL;PARK, YOUNG-O;REEL/FRAME:018213/0414Effective date: 20060810Sep 16, 2014FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services