Source: http://www.google.com/patents/US5793433?dq=5572193
Timestamp: 2016-05-07 02:04:17
Document Index: 181881534

Matched Legal Cases: ['art 40', 'art 96', 'art 26', 'art 28', 'art 26', 'art 40', 'art 40', 'art 40', 'art 40', 'art 96', 'art 96', 'art 96', 'art 96']

Patent US5793433 - Apparatus and method for vertically extending an image in a television system - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsAn apparatus and method for extending the height of an image to display a video signal having a 4:3 aspect ratio on a screen having a 16:9 aspect ratio. The apparatus includes: a field memory for storing pixel data of horizontal scanning lines of an input region which will be extended vertically, among...http://www.google.com/patents/US5793433?utm_source=gb-gplus-sharePatent US5793433 - Apparatus and method for vertically extending an image in a television systemAdvanced Patent SearchPublication numberUS5793433 APublication typeGrantApplication numberUS 08/581,491Publication dateAug 11, 1998Filing dateDec 29, 1995Priority dateMar 31, 1995Fee statusPaidPublication number08581491, 581491, US 5793433 A, US 5793433A, US-A-5793433, US5793433 A, US5793433AInventorsJeong-Hoon Kim, Min-Seung LeeOriginal AssigneeSamsung Electronics Co., Ltd.Export CitationBiBTeX, EndNote, RefManPatent Citations (10), Referenced by (49), Classifications (13), Legal Events (5) External Links: USPTO, USPTO Assignment, EspacenetApparatus and method for vertically extending an image in a television system
US 5793433 AAbstract
An apparatus and method for extending the height of an image to display a video signal having a 4:3 aspect ratio on a screen having a 16:9 aspect ratio. The apparatus includes: a field memory for storing pixel data of horizontal scanning lines of an input region which will be extended vertically, among the horizontal scanning lines of a field unit being inputted, and outputting the pixel data of the horizontal scanning lines of a region which will be extended vertically among the stored pixel data; line memories for sequentially inputting and delaying the pixel data outputted from the field memory by a horizontal scanning line unit, the number of the line memories corresponding to a vertical extension rate of the image; and a low-pass filtering and sub-sampling part for low-pass filtering and sub-sampling by respectively multiplying different filter coefficients having values determined by positions of new vertically extended horizontal scanning lines by the pixel data of the horizontal scanning lines which are each outputted with a different delay from the line memories and by adding the multiplied pixel data in correspondence with the positions of the new horizontal scanning lines, to thereby output the pixel data of the vertically extended horizontal scanning lines.
1. An apparatus for vertically extending an image in order to display an input video signal having said image in letter box format having an aspect ratio of 4:3 on a screen having an aspect ratio of 16:9, said apparatus comprising:a field memory for storing pixel data of initial horizontal scanning lines of an input region which will be extended vertically, among said initial horizontal scanning lines of a field unit being inputted, and outputting said pixel data of said horizontal scanning lines of a region which will be extended vertically among said stored pixel data; line memories for sequentially inputting and delaying said stored pixel data outputted from said field memory by units of said initial horizontal scanning lines, the number of said line memories corresponding to a vertical extension ratio of said image; and low-pass filtering and sub-sampling means for low-pass filtering and su b-sampling by respectively multiplying filter coefficients, the value of the filter coefficients being determined by positions of new vertically extended horizontal scanning lines, by said pixel data of said initial horizontal scanning lines, each of said pixel data being delay-outputted with a different delay from said line memories, and by adding said multiplied pixel data in correspondence with said positions of said new horizontal scanning lines, to thereby output new pixel data of said new vertically extended horizontal scanning lines. 2. The apparatus as claimed in claim 1, wherein said low-pass filtering and sub-sampling means generates four of said new vertically extended horizontal scanning lines for each three of said initial horizontal scanning lines of said input video signal.
3. The apparatus as claimed in claim 2, wherein said low-pass filtering and sub-sampling means simultaneously performs a zero-insertion and said sub-sampling by not multiplying said filter coefficients by three pixel data having a zero value which are inserted between pixel data of said initial horizontal scanning lines outputted respectively from said line memories.
4. The apparatus as claimed in claim 1, wherein said low-pass filtering and sub-sampling means generates three of said new vertically extended horizontal scanning lines for two of said initial horizontal scanning lines of said input video signal.
5. The apparatus as claimed in claim 4, wherein said low-pass filtering and sub-sampling means simultaneously performs a zero-insertion and said sub-sampling by not multiplying said filter coefficients by two pixel data having a zero value which are inserted between pixel data of said initial horizontal scanning lines outputted respectively from said line memories.
6. A method for extending height of an image in order to display a video signal having said image in letter box format having an aspect ratio of 4:3 on a screen having an aspect ratio of 16:9, said method comprising the steps of:inserting pixel data having zero value, the number of inserted pixel data being set in accordance with a vertical extension ratio, between pixels of initial horizontal scanning lines of an input video signal, thereby producing a zero-inserted signal; and generating new horizontal scanning lines for use in vertically extending said image by multiplying filter coefficients, the value of the filter coefficients being determined by a position of a corresponding one of the new horizontal scanning lines being generated, by every nth pixel of said zero-inserted signal, wherein n is one more than the number of said zero value pixel data inserted between each of said pixels of said initial horizontal scanning lines, thereby producing a spectrum elimination signal, and then sub-sampling the spectrum elimination signal in accordance with said vertical extension ratio. 7. The method as claimed in claim 6, wherein the step of inserting pixel data having zero value is performed simultaneously with said sub-sampling by not multiplying said filter coefficients by the pixel data having a zero value.
8. A method for vertically extending an image in order to display a video signal having said image of a letter box format having a 4:3 aspect ratio on a screen having 16:9 aspect ratio, said method comprising the steps of:inserting three pixel data having zero value between pixels of horizontal scanning lines of an input video signal, thereby producing a zero-inserted signal; and generating new horizontal scanning lines for use in vertically extending said image by multiplying filter coefficients, the value of the filter coefficients being determined by a position of a corresponding one of the new horizontal scanning lines being generated, by every fourth pixel of said zero-inserted signal, thereby producing a spectrum elimination signal, and then sub-sampling the spectrum elimination signal by a 3:1 rate in a vertical direction. 9. The method as claimed in claim 8, wherein the step of inserting pixel data having zero value is performed simultaneously with said sub-sampling by not multiplying said filter coefficients by the pixel data having a zero value.
10. A method for vertically extending an image in order to display a video signal having said image of a letter box format having a 4:3 aspect ratio on a screen having a 16:9 aspect ratio, said method comprising the steps of:inserting two pixel data having zero value between pixels of horizontal scanning lines of an input video signal, thereby producing a zero-inserted signal; and generating new horizontal scanning lines for use in vertically extending said image by multiplying filter coefficients, the value of the filter coefficients being determined by a position of a corresponding one of the new horizontal scanning lines being generated, by every third pixel of said zero-inserted signal, thereby producing a spectrum elimination signal, and then sub-sampling the spectrum elimination signal by a 2:1 rate in a vertical direction. 11. The method as claimed in claim 10, wherein the step of inserting pixel data having zero value is performed simultaneously with said sub-sampling by not multiplying said filter coefficients by the pixel data having a zero value.
The present invention relates to a television system for displaying an image of a letter box format having a 4:3 aspect ratio on a screen having a 16:9 aspect ratio, and more particularly to an apparatus and method for extending in a vertical direction a vertical height of an image having either a letter box size or a cinemascope size and displaying the extended image on a screen having a 16:9 aspect ratio.
Until now, most display formats for television systems have had a 4:3 aspect ratio. This aspect ratio is used for both a screen of a projection television system and a display means embodied by an image display region of a general cathode ray tube. The aspect ratio of most video sources is also 4:3.
However, not all video sources are created with a 4:3 aspect ratio. For example, cinema sources are converted from a film format to a video tape format in order to be reproduced or transmitted as a television signal. When such cinema sources are transformed to video format, the aspect ratio has been conventionally transformed to the 4:3 aspect ratio adapted to most television devices. One example of the cinema source is wide screen sources having a 16:9 aspect ratio display format. When such cinema sources are transformed to video tape format, a device such as a flying spot telecine is used. The flying spot telecine has a window and frame having the 4:3 aspect ratio. In general, the operator cuts down a left and right portion of the image as necessary while tracking a center portion of action in a film, and simultaneously moves the window to the left and right. The reason for this is that the horizontal width of the film image is wider than the horizontal width of the 4:3 aspect ratio screen in the case of a vertical height of the film image being adapted to the 4:3 aspect ratio screen. Accordingly, a portion of the video signal transformed from the 16:9 aspect ratio of the cinema source to the 4:3 aspect ratio is lost because much of the left and right portions of the film image are cut down.
If the wide screen image is decreased in scale until the horizontal width coincides with a left and right boundary line of the 4:3 aspect ratio screen, the vertical height of the image is smaller. As a result, the film source image is fully displayed on the 4:3 aspect ratio screen, but there are upper and lower portions of the 4:3 aspect ratio screen which are not filled in. In the same manner as above, in order to avoid a spurious signal being generated in a portion of the screen on which the image is not displayed, a dark bar is transmitted to the upper and lower portions of the image transformed to the 4:3 aspect ratio. The particular display format processed as described above is generally called "the letter box format". Accordingly, a letter box signal can be thought of as a video signal having a smaller active screen portion than that of a general video signal.
Video signals of letter box format can be, for example, a letter box size or a cinemascope size. And, for example, the video signal of the letter box size has 360 effective horizontal scanning lines, and the video signal of the cinemascope size has 320 effective horizontal scanning lines.
FIG. 1 illustrates a display state having upper and lower black bars when the image of the letter box size is displayed on the 4:3 aspect ratio screen having, for example, 360 effective horizontal scanning lines. In the same manner, the display has upper and lower black bars when the image of the cinemascope size is displayed on the 4:3 aspect ratio screen, but the number of effective horizontal scanning lines is reduced to 320 lines.
If the image of the letter box or cinemascope size as described above is displayed on a television screen having a 16:9 aspect ratio without an additional signal process, an incompatibility phenomenon is generated which causes the image of the video source to be spread to the left and right as shown in FIG. 2.
In order to prevent the incompatibility phenomenon as described above, the vertical height of the image of letter box or cinemascope size should be extended, so that, as shown in FIG. 3, the image of the video source is not spread to the left and right, even when displayed on a television screen having a 16:9 aspect ratio and so that the upper and lower black bars are not displayed.
Accordingly, several techniques for extending the vertical height of the image of the letter box or cinemascope size have been suggested.
One of the techniques is to utilize a vertical deflection system of the television device. As shown in FIG. 4, the vertical height of the image of the letter box or cinemascope size is extended by controlling a gain of a vertical size control circuit 4 provided for a general vertical deflection circuit. In general, the vertical size control circuit 4 is used for controlling the vertical size of a raster, and it has a function of changing a voltage level of a saw wave oscillated by a vertical oscillating circuit 2, in proportion to the gain being controlled by an element such as a variable resistor. The saw wave voltage controlled by the vertical size control circuit 4 is amplified by a vertical amplifier 6 and then is applied to a vertical output circuit 8, to thereby accomplish the vertical deflection in a CRT 10. Therefore, the gain of the vertical size control circuit 4 is increased as much as the vertical height of the image is extended according to the letter box or cinemascope size, so that as shown in FIG. 3, the image of the video source is not spread toward the left and right, even when displayed on a television screen having a 16:9 aspect ratio, and the upper and lower black bars are not displayed.
However, there is a drawback in that the degree of resolution is reduced because the interval between the horizontal scanning lines is widened due to the vertical height of the video image being extended.
Another technique for extending the vertical height of the image of the letter box or cinemascope size is to utilize "the distance inverse proportion coefficient". FIG. 5 illustrates one example of vertically extending the image of the letter box size using the distance inverse proportion coefficient. According to this example, the source video signal has seven horizontal scanning lines. Referring to FIG. 5, a coefficient inversely proportional to the distance between pixels P1 to P7 of the source video signal and pixels which will be reconstructed is multiplied by a pixel value of the source video signal, and then two adjacent values of the multiplied values are each added by adders 12 to 22, to thereby generate new pixels P1' to P9'. At this time, a basic processing unit is a block drawn in a dotted line, wherein three pixels of the horizontal scanning lines of the source video signal are processed to thereby reconstruct four pixels of the horizontal scanning lines. Accordingly, the widening of the interval between the horizontal scanning lines which can be perceived by the human eye is prevented, unlike the deflection system as described above.
However, there has been a problem that the resolution degree is still decreased in the case of vertically extending a video signal by an interpolation method using the distance inverse proportion coefficient as described above. Furthermore, there has been a problem that the coefficient should be changed every field when the source video employs an interlaced scanning method, while conversely a single coefficient should be used after interpolating when the source video employs a sequential scanning method.
Accordingly, an object of the present invention is to provide a vertical extension apparatus and method thereof for extending a vertical height of an image of a letter box format having a 4:3 aspect ratio, to thereby improve the degree of resolution when displayed on a 16:9 aspect ratio screen.
Another object of the present invention is to provide a vertical extension apparatus and method thereof for allowing identical processing irrespective of the scanning method of the video source when the vertical height of the image is extended, to thereby display a video of letter box format having a 4:3 aspect ratio on a screen having a 16:9 aspect ratio.
According to an aspect of the present invention, there is provided a vertical extension apparatus comprising a field memory for storing pixel data of horizontal scanning lines of an input region which will be extended vertically, among the horizontal scanning lines of a field unit being inputted, and outputting the pixel data of the horizontal scanning lines of a region which will be extended vertically among the stored pixel data; line memories for sequentially inputting and delaying the pixel data outputted from the field memory by the horizontal scanning line unit, the number of the line memories corresponding to a vertical extension rate of the image; and a low-pass filtering and sub-sampling part for low-pass filtering and sub-sampling by respectively multiplying different filter coefficients which are determined according to the positions of the new vertically extended horizontal scanning lines, by the pixel data of each of the differently delayed horizontal scanning lines outputted from the line memories and by adding the multiplied pixel data in correspondence with the positions of the new horizontal scanning lines, to thereby output the pixel data of the vertically extended horizontal scanning lines.
According to another aspect of the present invention, there is provided a vertical extension method comprising the steps of inserting a number of pixel data having zero value, the number being set in accordance with the vertical extension rate, between each of the pixels of the horizontal scanning lines for an input video signal having an image which is to be extended in vertical height; and generating new horizontal scanning lines for use in vertically extending the image by multiplying filter coefficients, the values of which are determined by a position of a corresponding one of the new horizontal scanning lines being generated, by every nth pixel of the zero-inserted signal, wherein n is one more than the number of the zero value pixel data inserted between each of the pixels of the horizontal scanning lines, thereby producing a spectrum elimination signal, and then sub-sampling the spectrum elimination signal in accordance with the vertical extension ratio.
FIG. 1 is a view illustrating one example of a display state when an image of a letter box format is displayed on a screen having a 4:3 aspect ratio.
FIG. 2 is a view illustrating one example of a display state when an image of a letter box format is displayed on a screen having a 16:9 aspect ratio.
FIG. 3 is a view illustrating a state when an image of a letter box format is extended vertically to be displayed on a screen having a 16:9 aspect ratio.
FIG. 4 is a block diagram illustrating vertical extension of an image of a video source used in a conventional vertical deflection system.
FIG. 5 is a view diagram illustrating vertical extension of an image of a video source by a conventional distance inverse proportion coefficient.
FIG. 6 is a block diagram illustrating a construction of a vertical extension apparatus according to the present invention.
FIGS. 7(A) to (E) are views illustrating processing states of pixels in accordance with a vertical extension in a first embodiment of the present invention.
FIGS. 8(A) to (D) are views illustrating spectrum changes in accordance with a vertical extension in the first embodiment of the present invention.
FIG. 9 is a block diagram illustrating a construction of a vertical extension apparatus in the first embodiment of the present invention.
FIG. 10 is a diagram illustrating an input/output timing of field memory 30 of the FIG. 9 apparatus.
FIG. 11 is a diagram illustrating operation timing and operation steps of the FIG. 9 apparatus.
FIG. 12 is a view illustrating one example of a detailed construction of a low-pass filtering and sub-sampling part 40 of the FIG. 9 apparatus.
FIGS. 13(A) to (E) are views illustrating processing states of pixels in accordance with a vertical extension in a second embodiment of the present invention.
FIGS. 14(A) to (D) are views illustrating spectrum changes in accordance with a vertical extension in the second embodiment of the present invention.
FIG. 15 is a block diagram illustrating a construction of a vertical extension apparatus in a second embodiment of the present invention.
FIG. 16 is a diagram illustrating an input/output timing of a field memory 88 shown in FIG. 15.
FIG. 17 is a diagram illustrating an operation timing and operation steps of the FIG. 15 apparatus.
FIG. 18 is a view illustrating one example of a detailed construction of a low-pass filtering and sub-sampling part 96 shown in FIG. 15.
In the following detailed description, particular details such as a detailed process procedure, a circuit construction, the number of horizontal scanning lines, and the filter coefficient are provided for a more comprehensive understanding of the present invention. It is evident that a person who has ordinary knowledge in the present technical field can easily execute the subject matter of the present invention without description of the particular details. For the sake of clarity, known functions and construction of the present invention are not described in detail.
In order to improve resolution and to allow identical processing irrespective of a scanning method of a video source when a vertical height of a image of letter box or cinemascope size is extended as described in FIG. 3, the present invention varies the number of scanning lines of a video source on the basis of "the general sampling rate conversion theory". The sampling rate conversion theory relates to converting a sampling rate by sequentially interpolating, filtering processing, and decimating an input signal, and is disclosed in p35-p40 of "MULTIRATE DIGITAL SIGNAL PROCESSING" by Ronald E. Crochiere and Lawrence R. Rabiner, published by Prentice-Hall Co., U.S.A., in 1983.
FIG. 6 is a block diagram illustrating a construction of a vertical extension apparatus according to the present invention which is configured on the basis of the sampling rate conversion theory. A zero inserter 24 performs interpolation by inserting pixels having zero value between the pixels of horizontal scanning lines. The number of inserted pixels is equal to the number of pixels being set for the inputted video signal of a letter box format. A low-pass filtering part 26 multiplies the different filter coefficients which are determined according to the positions of the new horizontal scanning lines which are extended in a vertical direction of a zero-inserted signal by the zero-inserter 24, by the pixel data of each of the differently delayed horizontal scanning lines outputted from the line memories and by adding the multiplied pixel data in correspondence with the positions of the new horizontal scanning lines, to thereby perform low-pass filtering. A sub-sampling part 28 performs sub-sampling of the signal filtered by the low-pass filtering part 26 at a set rate in the vertical direction.
In a first embodiment of the present invention, the vertical height of an image of letter box size having 360 effective horizontal scanning lines is extended to thereby be converted to an image having 480 effective horizontal scanning lines by use of the vertical extension apparatus of FIG. 6 as described above. At this time, the 480 new horizontal scanning lines are generated from the 360 horizontal scanning lines, that is, the number of new horizontal scanning lines is 4/3 times the number of the horizontal scanning lines of an initial signal. Therefore, four new horizontal scanning lines are generated for every three horizontal scanning lines of the initial signal. The initial signal represents a signal having a letter box size image.
Referring to FIG. 7 which illustrates processing states of the pixels in accordance with a vertical extension, a vertical extension process according to a first embodiment of the present invention is described as follows. Twelve pixels are generated by inserting three pixels having zero value between each of the pixels of the horizontal scanning lines as shown in FIG. 7(B) for every three horizontal scanning lines of the initial signal as shown in FIG. 7(A). After a spectrum between 0 and 4 fs is eliminated by performing low-pass filtering as shown in FIG. 7(C), the sub-sampling shown in FIG. 7(D) extracts one of three pixels to thereby generate the pixels of the four new horizontal scanning lines as shown in FIG. 7(E). In FIG. 7, the pixels colored in black are the pixels having zero value, and "fs" is a color sub-carrier.
FIG. 8 is a view illustrating spectrum changes in accordance with a vertical extension of the first embodiment of the present invention. FIG. 8A illustrates the spectrum of the initial signal as shown in FIG. 7(A); FIG. 8B illustrates the spectrum of the zero-inserted signal as shown in FIG. 7(B); FIG. 8C illustrates the spectrum of the low-pass-filtered signal as shown in FIG. 7(C); and FIG. 8D illustrates the last spectrum change in which the spectrum of 4 fs is changed into the spectrum of 4/3 fs.
Referring to FIG. 9 which illustrates a construction of the vertical extension apparatus of the first embodiment of the present invention, a field memory 30 stores the pixel data of the horizontal scanning lines of an input region which will be vertically extended, among the horizontal scanning lines of an input signal of a field unit being inputted, and then outputs the pixel data of the horizontal scanning lines of a region which will be extended vertically, among the stored pixel data. At this time, as shown in FIG. 10, the input region of the field memory 30 is set to a period of storing data to the field memory 30 by a write signal WE, and an extension region is set to a period of being read from the field memory 30 by a read signal RE. Regarding the total number of horizontal scanning lines per frame, the input region is set to correspond to 360 horizontal scanning lines and the extension region is set to correspond to 480 horizontal scanning lines. In FIG. 10, "VS" signifies a vertical synchronous signal.
First, second, third, and fourth line memories 32 to 38 sequentially input and delay the pixel data outputted from the field memory 30 in the horizontal scanning line unit, and then output the pixel data to the low-pass filtering and sub-sampling part 40. At this time, as shown in FIG. 11, the read signal RE is inputted in a "high" state to the field memory 30 during the period of one horizontal scanning line of every three horizontal scanning lines to thereby disable an output of the field memory 30, so that the extension region during the period of the 480 horizontal scanning lines (which is 4/3 times the 360 horizontal scanning lines) is designated as in FIG. 10. And in the same manner as the read signal RE, the write signal WE' designating an input period of the first, second, third, and fourth line memories 32 to 38 also are inputted to the first, second, third, and fourth line memories 32 to 38 in the "high" state during the period of one horizontal scanning line of every three horizontal scanning lines. And a read address for the field memory 30 is increased every horizontal scanning line during the period when the read signal RE and the write signal WE' are in a "low" state as shown in FIG. 11. Accordingly, the first, second, third, and fourth line memories 32 to 38 delay the pixel data of each inputted horizontal scanning line in the horizontal scanning line unit during the period when the read signal RE and the write signal WE' are in the "low" state as shown in FIG. 11, and retain the pixel data of previous horizontal scanning lines during the period in which the read signal RE and the write signal WE' are in the "high" state. As a result, each horizontal scanning line outputted from the first, second, third, and fourth line memories 32 to 38 is rendered to be as in FIG. 11. In FIG. 11, "HS" designates a horizontal synchronous signal.
The low-pass filtering and sub-sampling part 40 performs low-pass filtering and sub-sampling by multiplying each of the different filter coefficients determined by the positions of the new vertically extended horizontal scanning lines i to (i+1) by the pixel data LM1 to LM4 of the different horizontal scanning lines which are each delay-outputted from the first, second, third, and fourth line memories 32 to 38, and by adding the multiplied pixel data in correspondence with the positions of the new horizontal scanning lines i to (i+3), to thereby output the pixel data i to (i+3) of the vertically extended horizontal scanning lines. At this time, the four new horizontal scanning lines are generated from the three horizontal scanning lines of the input video signal.
One example of the construction of the low-pass filtering and sub-sampling part 40 is shown in FIG. 12. In FIG. 12, for example, (J-2) to (J+4) represent the initial pixels in the vertical direction of seven consecutive horizontal scanning lines, and the pixels colored in black are the pixel data having zero value, three of which are inserted between each of the initial pixels (J-2) to (J+4). Furthermore, slashed pixels represent the four new pixels i, (i+1), (i+2), and (i+3) generated from the three initial pixels J, (J+1), and (J+2). At this time, the three initial pixels J, (J+1), and (J+2) are converted into twelve pixels by zero-insertion. Accordingly, a total of twelve low-pass filters would normally be needed. However, only four results of the low-pass filtering are needed because one of the three zero-inserted pixels is extracted by performing the sub-sampling as described above among the twelve zero-inserted pixels. Consequently, only four low-pass filters are required; that is, the first, second, third, and fourth low-pass filters 42 to 48. At this time, in performing the low-pass filtering, the pixels having zero value are rendered to be zero even though they are multiplied by the filter coefficients. Therefore, only the initial pixels are multiplied by the filter coefficient and the pixels having zero value are not multiplied by the filter coefficients, thereby performing a zero insertion process without actually performing zero insertion.
Accordingly, multipliers 50 to 54 of the first low-pass filter 42 respectively multiply the initial pixels (J-1), J and (J+1) by the filter coefficients h(-4), h(0), and h(4), and adder 56 adds all outputs of the multiplier 50 to 54, to thereby generate new pixel i. At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-7), h(-6), h(-5), h(-3) , h(-2) , h(-1), h(1), h(2), h(3), h(5), h(6), and h(7) are not used. Multipliers 58 to 64 of the second low-pass filter 44 respectively multiply the initial pixels (J-1), J, (J+1), and (J+2) by the filter coefficients h(-7), h(-3), h(1), and h(5), and adder 66 adds all outputs of the multipliers 58 to 64, to thereby generate new pixel (i+1). At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-6), h(-5), h(-4), h(-2), h(-1), h(0), h(2), h(3), h(4), h(6), and h(7) are not used. Furthermore, multipliers 68 to 74 of the third low-pass filter 46 respectively multiply the initial pixels J, (J+1), (J+2), and (J+3) by the filter coefficients h(-6), h(-2), h(2), and h(6), and adder 76 adds all outputs of the multipliers 68 to 74, to thereby generate new pixel (i+2). At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-7), h(-5), h(-4), h(-3), h(-1), h(0), h(1), h(3), h(4), h(5), and h(7) are not used. And furthermore, multipliers 78 to 84 of the fourth low-pass filter 48 respectively multiply the initial pixels (J+1), (J+2), (J+3), and (J+4) by the filter coefficients h(-5), h(-1), h(3), and h(7) and adder 86 adds all outputs of the multipliers 78 to 84, to thereby generate new pixel (i+3). At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-7), h(-6), h(-4), h(-3), h(-2), h(0), h(1), h(2), h(4), h(5), and h(6) are not used.
As a result, the four new pixels i, (i+1), (i+2), and (i+3) of the horizontal scanning lines which are vertically extended from the three initial pixels J, (J+1), and (J+2) of the horizontal scanning lines are generated.
The vertical height of the image of letter box size having 360 effective horizontal scanning lines is extended by sequentially repeating the above steps every three horizontal scanning lines, to thereby convert the image to one having 480 effective horizontal scanning lines. Accordingly, even in the television screen having a 16:9 aspect ratio as shown in FIG. 3, the image of the video source is not spread to the left and right and at the same time the upper and lower black bars do not appear.
Also in case that the three horizontal scanning lines J, (J+1), and (J+2) are extended as described above to thereby generate the four horizontal scanning lines i, (i+1), (i+2), and (i+3), that is, in case that the three initial pixels are converted to four pixels, the six pixels (J-1) to (J+4) of the horizontal scanning lines are required as shown in FIG. 12. This can be more readily understood by referring to FIG. 11 where pixels which are processed in the first, second, third, and fourth low-pass filter 42 to 48 of the low-pass filtering and sub-sampling part 40 are separately illustrated in a dotted line block.
On the other hand, if the write signal WE and the read signal RE for the field memory 30 are controlled to thereby move the sections of the input region and the vertical extension region as shown in FIG. 10, the screen can be moved in the vertical direction.
In a second embodiment of the present invention, the vertical height of the image of the cinemascope size having 320 effective horizontal scanning lines is extended to be converted to an image having 480 effective horizontal scanning lines using the vertical extension apparatus of FIG. 6 as described above. At this time, the 480 new horizontal scanning lines are generated from the 320 horizontal scanning lines; that is, the number of the new horizontal scanning lines is 3/2 times the number of the horizontal scanning lines of an initial signal. Therefore, three new horizontal scanning lines are generated for every two horizontal scanning lines of the initial signal. The initial signal represents a signal having an image of cinemascope size.
A vertical extension process according to the second embodiment of the present invention will be described with reference to FIG. 13, which illustrates processing states of the pixels in accordance with a vertical extension. Six pixels are generated by inserting two pixels having zero value between each of the pixels of the horizontal scanning lines, as shown in FIG. 13(B), for every two horizontal scanning lines of the initial signal, as shown in FIG. 13(A). Then, after a spectrum between 0 and 3 fs is eliminated by performing low-pass filtering as shown in FIG. 13(C), every other pixel is extracted by sub-sampling as shown in FIG. 13(D), to thereby generate the pixels of the three new horizontal scanning lines as shown in FIG. 13(E). In FIG. 13, the pixels colored in black correspond to pixel data having zero value, and "fs" designates a color sub-carrier.
FIG. 14 is a view illustrating spectrum changes in accordance with a vertical extension of the second embodiment of the present invention. FIG. 14A illustrates the spectrum of the initial signal as shown in FIG. 13(A), FIG. 14B illustrates the spectrum of the zero-inserted signal as shown in FIG. 13(B), FIG. 14C illustrates the spectrum of the low-pass-filtered signal as shown in FIG. 13(C), and FIG. 14D illustrates the last spectrum change in which the spectrum of 3 fs is changed into the spectrum of 3/2 fs.
Referring to FIG. 15 which illustrates a construction of the vertical extension apparatus of the second embodiment according to the present invention, a field memory 88 stores the pixel data of the horizontal scanning lines of an input region which will be vertically extended, among the horizontal scanning lines of an input signal of a field unit being inputted, and then outputs the pixel data of the horizontal scanning lines of a region which will be extended vertically, among the stored pixel data. At this time, as shown in FIG. 16, the input region of the field memory 88 is set to a period of being stored to the field memory 88 by a write signal WE, and an extension region is set to the period of being read from the field memory 88 by a read signal RE. Regarding the total number of horizontal scanning lines per frame, the input region is set to 320 horizontal scanning lines and the extension region is set to 480 horizontal scanning lines. In FIG. 16, "VS" represents a vertical synchronous signal.
First, second, and third line memories 90 to 94 sequentially input and delay the pixel data outputted from the field memory 88 in the horizontal scanning line unit, and then output the pixel data to the low-pass filtering and sub-sampling part 96. At this time, as shown in FIG. 17, the read signal RE is inputted in a "high" state to the field memory 88 during the period of one horizontal scanning line of two horizontal scanning lines to thereby disable an output of the field memory 88, so that the extension region during the period of the 480 horizontal scanning lines (3/2 times 320 horizontal scanning lines) is designated as in FIG. 16. And in the same manner of the read signal RE, the write signal WE' designating an input period of the first, second, and third line memories 90 to 94, is also inputted to the first, second, and third line memories 90 to 94 in the "high" state during the period of one horizontal scanning line of two horizontal scanning lines. And a read address for the field memory 88 is increased every horizontal scanning line during the period of which the read signal RE and the write signal WE' are in a "low" state as shown in FIG. 17. Accordingly, the first, second, and third line memories 90 to 94 delay the pixel data of each inputted horizontal scanning line in the horizontal scanning line unit during the period in which the read signal RE and the write signal WE' are in the "low" state as shown in FIG. 17, and retain the pixel data of previous horizontal scanning lines during the period in which the read signal RE and the write signal WE' are in the "high" state. As a result, each horizontal scanning line outputted from the first, second, and third line memories 90 to 94 is rendered to be as shown in FIG. 17. In FIG. 17, "HS" refers to a horizontal synchronous signal.
The low-pass filtering and sub-sampling part 96 performs low-pass filtering and sub-sampling by multiplying the different filter coefficients determined by the positions of the new vertically extended horizontal scanning lines i to (i+2) by the pixel data LM1 to LM3 of the different horizontal scanning lines which are each delay-outputted from the first, second, and third line memories 90 to 94, and by adding the multiplied pixel data in correspondence with the positions of the new horizontal scanning lines i to (i+2), to thereby output the pixel data i to (i+2) of the vertically extended horizontal scanning lines. At this time, the three new horizontal scanning lines are generated from the two horizontal scanning lines of the input video signal.
One example of the construction of the low-pass filtering and sub-sampling part 96 is shown in FIG. 18. In FIG. 18, for example, (J-2) to (J+4) represents the initial pixels of the vertical direction in seven consecutive horizontal scanning lines. The pixels colored in black are the pixel data having zero value, two of which are inserted between each of the initial pixels (J-2) to (J+4). Furthermore, slashed pixels represent the three new pixels i, (i+1), and (i+2) which are generated from the two initial pixels J and (J+1). At this time, the two initial pixels J and (J+1) are converted into six pixels by zero-insertion. Accordingly, a total of six low-pass filters would normally be required. However, only three results of the low-pass filtering are needed because one of the two zero-inserted pixels is extracted by performing the sub-sampling as described above among the six zero-inserted pixels. Consequently only the three low-pass filters, that is, the first, second, and third low-pass filters 98 to 102, are required. In the same manner as the first embodiment, only the initial pixels are multiplied by the filter coefficient and the pixels having zero value are not multiplied by the filter coefficient.
Accordingly, multiplier 104 of the first low-pass filter 98 respectively multiplies the initial pixels J by the filter coefficient h(0), to thereby generate new pixel i. Multipliers 106 to 112 of the second low-pass filter 100 respectively multiply the initial pixels (J-1), J, (J+1), and (J+2) by the filter coefficients h(-4), h(-1), h(2), and h(5) and adder 114 adds all outputs of the multipliers 106 to 112, to thereby generate new pixel (i+1). At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-5), h(-3), h(-2), h(0), h(1), h(3), and h(4) are not used. Furthermore, multipliers 116 to 122 of the third low-pass filter 102 respectively multiply the initial pixels (J-1), J, (J+1), and (J+2) by the filter coefficients h(-5), h(-2), h(1), and h(4) and adder 124 adds all outputs of the multipliers 116 to 122, to thereby generate new pixel (i+2). At this time, because the filter coefficients are not multiplied by the pixels having zero value, the filter coefficients h(-4), h(-3), h(-1), h(0), h(2), h(3), and h(5) are not used.
As a result, the three new pixels i, (i+1), and (i+2) of the horizontal scanning lines which are vertically extended from the two initial pixels J and (J+1) of the horizontal scanning lines are generated.
The vertical height of the image of cinemascope size having 320 effective horizontal scanning lines is extended by sequentially repeating the above steps every two horizontal scanning lines, so that the image is converted to an image having 480 effective horizontal scanning lines. Accordingly, even in a television screen having a 16:9 aspect ratio as in FIG. 3, the image of the video source is not spread to the left and right and at the same time the upper and lower black bars do not appear.
Also, in case that the two horizontal scanning lines J and (J+1) are extended as described above to thereby generate the three horizontal scanning lines i, (i+1), and (i+2), that is, in case that the two initial pixels are converted to three pixels, the four pixels (J-1) to (J+2) of the horizontal scanning lines are required, as shown in FIG. 18. This can be more readily understood by referring to FIG. 17 where the pixels which are processed in the first, second, and third low-pass filter 98 to 102 of the low-pass filtering and sub-sampling part 96 are separately illustrated in a dotted line block.
On the other hand, if the write signal WE and the read signal RE for the field memory 88 are controlled to thereby move the sections of the input region and the vertical extension region as shown in FIG. 16, the screen can be moved in the vertical direction.
As illustrated above, the present invention has an advantage of ensuring stability of a circuit by performing identical processing irrespective of the scanning method of the video source. This is possible because a field separation is not required. In addition, the degree of resolution is improved by use of an improved frequency characteristic in comparison with the conventional frequency characteristic.
While there have been illustrated and described what are considered to be preferred embodiments of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made, and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. In particular, embodiments of the present invention, extending the vertical height of the image of the letter box or the cinemascope size have been illustrated, but the invention can be applied to any video signal having letter box format. Also, it has been illustrated that the image of the letter box size having 360 effective horizontal scanning lines and the image of the cinemascope size having 320 effective horizontal scanning lines are extended vertically to images having 480 horizontal scanning lines. However, cases where the number of effective horizontal scanning lines are different can also be applied to the present invention in the same manner. In such cases, the ratio of vertical extension corresponds to the ratio of the number of horizontal scanning lines of the video source to the number of effective horizontal scanning lines. Accordingly, the scope of the present invention should not be determined by the above embodiments, but should be determined by the claims and equivalents thereof.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5274449 *Apr 10, 1992Dec 28, 1993Deutsche Thomson-Brandt GmbhLetterbox television signal with edge regions containing transformed pixel valuesUS5307156 *Jul 16, 1993Apr 26, 1994Canon Kabushiki KaishaTelevision signal converting apparatusUS5347313 *Mar 29, 1993Sep 13, 1994Goldstart Co., Ltd.Video signal compensation apparatus for television receiverUS5363140 *May 21, 1993Nov 8, 1994Sony CorporationVideo signal conversion system with a vertical enhancement circuitUS5386236 *Dec 28, 1992Jan 31, 1995Goldstar Co., Ltd.Television screen aspect ratio converting method and the device thereofUS5471249 *Aug 11, 1993Nov 28, 1995Matsushita Electric Industrial Co., Ltd.Scan converting apparatus for transferring subtitles on a screenUS5473381 *Aug 1, 1994Dec 5, 1995Goldstar Co., Ltd.Apparatus for converting frame format of a television signal to a display format for a high definition television (HDTV) receiverUS5506625 *Feb 23, 1995Apr 9, 1996Samsung Electronics Co., Ltd.Video signal conversion method for displaying a 4:3 video signal on a 16:9 screenUS5534934 *Jun 16, 1994Jul 9, 1996Hitachi, Ltd.Television receiver capable of enlarging and compressing imageUS5537157 *Aug 30, 1994Jul 16, 1996Kinya WashinoMulti-format audio/video production system* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS6025883 *Oct 16, 1997Feb 15, 2000Samsung Electronics Co., Ltd.Resolution conversion apparatus and method for a display deviceUS6100934 *Jan 5, 1998Aug 8, 2000Winbond Electronics CorporationApparatus and method to convert a non-interlaced computer graphics signal to an interlaced video signalUS6268887 *Dec 29, 1997Jul 31, 2001Hitachi, Ltd.Image display apparatus and personal computer for displaying personal computer signals and broadcast signalsUS6433832Jun 11, 2001Aug 13, 2002Hitachi, Ltd.Image display apparatus and personal computer for displaying personal computer signals and broadcast signalsUS6704056 *May 22, 2001Mar 9, 2004Matsushita Electric Industrial Co., Ltd.Horizontal deflection circuit and television receiverUS6710810 *Jul 1, 1999Mar 23, 2004Pioneer Electronic CorporationVideo signal processing apparatus with resolution enhancing featureUS6958780 *Apr 28, 2000Oct 25, 2005Sony CorporationImage displaying and controlling apparatus and methodUS7064792 *Mar 29, 2001Jun 20, 2006Mti Film, LlcFormat conversionUS7623187 *Nov 2, 2005Nov 24, 2009Funai Electric Co., Ltd.Video display apparatus where display format can be easily changedUS8373718Dec 10, 2008Feb 12, 2013Nvidia CorporationMethod and system for color enhancement with color volume adjustment and variable shift along luminance axisUS8456547Dec 31, 2009Jun 4, 2013Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS8456548Jun 4, 2013Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS8456549Jun 4, 2013Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS8471852May 30, 2003Jun 25, 2013Nvidia CorporationMethod and system for tessellation of subdivision surfacesUS8570634Oct 11, 2007Oct 29, 2013Nvidia CorporationImage processing of an incoming light field using a spatial light modulatorUS8571346Oct 26, 2005Oct 29, 2013Nvidia CorporationMethods and devices for defective pixel detectionUS8588542 *Dec 13, 2005Nov 19, 2013Nvidia CorporationConfigurable and compact pixel processing apparatusUS8594441Sep 12, 2006Nov 26, 2013Nvidia CorporationCompressing image-based data using luminanceUS8698908Feb 11, 2008Apr 15, 2014Nvidia CorporationEfficient method for reducing noise and blur in a composite still image from a rolling shutter cameraUS8698918Dec 30, 2009Apr 15, 2014Nvidia CorporationAutomatic white balancing for photographyUS8712183Apr 2, 2010Apr 29, 2014Nvidia CorporationSystem and method for performing image correctionUS8723969Mar 20, 2007May 13, 2014Nvidia CorporationCompensating for undesirable camera shakes during video captureUS8724895Jul 23, 2007May 13, 2014Nvidia CorporationTechniques for reducing color artifacts in digital imagesUS8737832Feb 9, 2007May 27, 2014Nvidia CorporationFlicker band automated detection system and methodUS8749662Apr 1, 2010Jun 10, 2014Nvidia CorporationSystem and method for lens shading image correctionUS8768160Dec 30, 2009Jul 1, 2014Nvidia CorporationFlicker band automated detection system and methodUS8780128Dec 17, 2007Jul 15, 2014Nvidia CorporationContiguously packed dataUS9177368Dec 17, 2007Nov 3, 2015Nvidia CorporationImage distortion correctionUS9307213Nov 5, 2012Apr 5, 2016Nvidia CorporationRobust selection and weighting for gray patch automatic white balancingUS20010048480 *May 22, 2001Dec 6, 2001Matsushita Electric Industrial Co., Ltd.Horizontal deflection circuit and television receiverUS20020021365 *Mar 29, 2001Feb 21, 2002Chengda YangFormat conversionUS20030053710 *Jul 9, 2002Mar 20, 2003Shih-Yu KuDevice of sample rate conversion for digital image and the method of the sameUS20060092324 *Nov 2, 2005May 4, 2006Funai Electric Co., Ltd.Video display apparatus where display format can be easily changedUS20070091187 *Oct 26, 2005Apr 26, 2007Shang-Hung LinMethods and devices for defective pixel detectionUS20080231718 *Mar 20, 2007Sep 25, 2008Nvidia CorporationCompensating for Undesirable Camera Shakes During Video CaptureUS20090027525 *Jul 23, 2007Jan 29, 2009Nvidia CorporationTechniques For Reducing Color Artifacts In Digital ImagesUS20090097092 *Oct 11, 2007Apr 16, 2009David Patrick LuebkeImage processing of an incoming light field using a spatial light modulatorUS20090154822 *Dec 17, 2007Jun 18, 2009Cabral Brian KImage distortion correctionUS20090157963 *Dec 17, 2007Jun 18, 2009Toksvig Michael J MContiguously packed dataUS20090201383 *Feb 11, 2008Aug 13, 2009Slavin Keith REfficient method for reducing noise and blur in a composite still image from a rolling shutter cameraUS20090257677 *Apr 10, 2008Oct 15, 2009Nvidia CorporationPer-Channel Image Intensity CorrectionUS20100103310 *Dec 30, 2009Apr 29, 2010Nvidia CorporationFlicker band automated detection system and methodUS20100141671 *Dec 10, 2008Jun 10, 2010Nvidia CorporationMethod and system for color enhancement with color volume adjustment and variable shift along luminance axisUS20100171845 *Jul 8, 2010Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS20100173669 *Dec 31, 2009Jul 8, 2010Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS20100173670 *Jul 8, 2010Nvidia CorporationUsing a graphics processing unit to correct video and audio dataUS20100265358 *Apr 1, 2010Oct 21, 2010Nvidia CorporationSystem and method for image correctionUS20100266201 *Oct 21, 2010Nvidia CorporationSystem and method for performing image correctionUS20110096190 *Apr 28, 2011Nvidia CorporationAutomatic white balancing for photography* Cited by examinerClassifications U.S. Classification348/445, 348/556, 348/441, 348/458, 348/E07.012, 348/469, 348/E05.111International ClassificationH04N7/01, H04N5/44Cooperative ClassificationH04N7/0135, H04N7/0122European ClassificationH04N7/01T, H04N7/01G5Legal EventsDateCodeEventDescriptionApr 10, 1996ASAssignmentOwner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OFFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, JEONG-HOON;LEE, MIN-SEUNG;REEL/FRAME:007933/0166Effective date: 19960214Aug 22, 1996ASAssignmentOwner name: SAMSUNG ELECTRONICS CO. LTD., KOREA, REPUBLIC OFFree format text: TO CORRECT THE EXECUTION DATE FOR THE SECOND NAMED ASSIGNOR AT REEL 7933 FRAME 0166;ASSIGNORS:KIM, JEONG-HOON;LEE, MIN-SEUNG;REEL/FRAME:008123/0510;SIGNING DATES FROM 19960214 TO 19960216Jan 17, 2002FPAYFee paymentYear of fee payment: 4Jan 20, 2006FPAYFee paymentYear of fee payment: 8Jan 14, 2010FPAYFee paymentYear of fee payment: 12RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services