Source: https://patents.google.com/patent/TWI466547B/en
Timestamp: 2019-12-13 05:43:11
Document Index: 422435067

Matched Legal Cases: ['art 500', 'art 500', 'arts 700', 'art 600', 'art 500', 'art 500', 'arts 700', 'art 700', 'art 500', 'art 600', 'art 800', 'art 700', 'art 800', 'art 500', 'art 600', 'art 800', 'art 800', 'art 800', 'art\n502']

TWI466547B - Methods and systems for improving low-resolution video - Google Patents
Methods and systems for improving low-resolution video Download PDF
TWI466547B
TWI466547B TW097100393A TW97100393A TWI466547B TW I466547 B TWI466547 B TW I466547B TW 097100393 A TW097100393 A TW 097100393A TW 97100393 A TW97100393 A TW 97100393A TW I466547 B TWI466547 B TW I466547B
TW097100393A
TW200845762A (en
Balram Nikhil
Edwards Gwyn
2007-01-05 Priority to US87896707P priority Critical
2008-01-04 Application filed by Marvell World Trade Ltd filed Critical Marvell World Trade Ltd
2008-11-16 Publication of TW200845762A publication Critical patent/TW200845762A/en
2014-12-21 Publication of TWI466547B publication Critical patent/TWI466547B/en
Method and system for improving low resolution video
The present invention relates to a method of improving images, and more particularly to a system and method for improving the display of low resolution images on a large screen display.
As more and more portable media players, such as video-capable MP3 players, become popular, today's established images are typically used for these devices. For example, an online store provides movies, television episodes, and other video content for downloading to a portable media device. The video content provided to these devices has video characteristics suitable for display on the small screens of these portable devices.
Another form of video content that is becoming more and more common is online video. In particular, many TV shows and movies are easy to download based on user needs. Moreover, many users share it with the public through various image sharing websites. Traditionally, the images provided by these Internet sites have been displayed on a personal computer (PC) or laptop screen with a small screen size. Therefore, online images and images produced for portable media players typically have lower resolution.
In addition to having a lower resolution, images generated by users on the Internet are often created by amateurs who are unfamiliar or unable to use professional technology. For example, a user-generated image can be taken on a handheld camera. Therefore, due to the shaking of the camera, the frame-by-frame may change even for a constant background, resulting in disproportionate image data on the background and other still images at a fixed data transmission rate. The amount of compression. For this and other reasons, user-generated content is often not only affected by low resolution, but also by artifacts. The artifact is here a portion of the display that is visually unpleasant due to image compression. Common artifacts include blocking artifacts and mosquito noise. Block artifacts are blocky displays of low-resolution images, often found in areas with less detail in the image. Mosquito noise is a ringing effect caused by the combination of high-frequency luminance and/or chrominance coefficients, usually found near the sharp edges in the image.
As technology advances, especially in network technology, Internet content and portable media player content can be displayed on other devices, such as TV screens. But these are The screen of his device may be larger than the image content provided by the Internet or portable media player, so it has a higher resolution. Therefore, when an image having a low resolution (in some cases, a compressed artifact) is enlarged to a larger size, the picture quality may become unacceptably poor, giving the user an unpleasant viewing experience.
Moreover, when an image signal for display on a large screen device is prepared, the processing technique performed by the display device may degrade the presentation of the low resolution image. One such processing technique performed by the display is deinterlacing, which is a way of changing the way pixels are drawn on the screen. The image is displayed by the display device by drawing successive images at a sufficiently fast rate (e.g., 50 frames per second). Typically, displays use sequential or interlaced scanning to render these images pixel by pixel. A progressive scan plots each pixel in the image from the top to the bottom of the screen. Therefore, after each scan, the sequential scan display shows the entire picture. On the other hand, an interlaced scan plots odd pixel rows in the image and then plots even pixel rows at the next instant. Therefore, the interlaced scanning produces an image by alternating between odd-numbered lines and even-numbered lines displaying continuous images. These half-resolution images are called fields.
Currently, many display devices (such as some digital televisions, liquid crystal displays (LCDs), etc.) are sequential scan displays. However, image transmission standards such as television broadcast standards typically use interlaced scanning. Therefore, these displays often include deinterlacing circuitry for converting interlaced scanned images into sequentially scanned images. There are a number of deinterlacing techniques used today by digital display devices. These techniques are all used to display interlaced scanned images with the best image quality. Therefore, deinterlacing circuits in televisions and other display devices are becoming more and more complex and sophisticated in order to effectively display television broadcasts and other interlaced images.
In general, because of these de-interlacing and other novel and sophisticated techniques for efficiently processing higher resolution image signals, viewers expect a high quality image that is vivid on their televisions. In particular, these technologies are being incorporated into the introduction of televisions that are generally available, and can display large images with high brightness, contrast, and resolution. However, these complex processing techniques may not be effective when performing low resolution and possibly low quality images, such as content from the Internet or a portable media player. In fact, these techniques may also worsen the presentation of low-resolution images. Therefore, there is currently no effective way to present higher resolution video content (such as television broadcasts) and low resolution video content (such as internet content) on a large screen device. Therefore, improving the image quality of low-resolution images on large-screen displays is highly desirable.
The present invention is to provide a system and method for improving the visual display of low resolution images displayed on high resolution large screen devices.
One aspect of the invention is an image format converter for processing the low resolution image prior to processing the low resolution image by the large screen device. Typically, low-resolution images are transmitted using high-resolution image transmission standards, so low-resolution images look higher than the actual resolution. Therefore, in order to determine whether to use low resolution techniques to interleave and/or process image signals, the image format converter can detect the true resolution of the image content. In some embodiments, if the image converter detects that the image is low resolution and is interlaced, the deinterleaver of the image converter can deinterlace the received using a technique determined based on real resolution. Video signal. In other embodiments, the deinterleaver of the image converter can convert the received image signal to its true resolution and deinterleave the converted image signal. In any of the above methods, the image converter generates a sequential scan image signal (for example, in HDMI or DVI format, etc.). Therefore, the deinterleaving circuit of a large screen device that may not be suitable for low resolution images is avoided.
Another aspect of the present invention is an image format converter that can take additional processing steps to improve low quality low resolution image display. In some embodiments, to determine if image signals require additional processing, the image converter can reference low quality markers in the image signal. If the image converter determines that the image signal is of low quality, it first uses techniques such as MPEG noise reduction to reduce mosquito noise and block artifacts to reduce artifacts in the image signal. After the noise is reduced, the image signal with little information is left. The reduced image signal is then enhanced to improve the display of the image that reduces noise. In some embodiments, enhancing the image signal involves increasing the contrast of the picture; in other embodiments, enhancing the image signal includes adding film grain to create a phantom of the texture and overlaying defects in the picture. These related techniques for enhancing image signals improve the viewer's visual perception when there are fewer details in the picture.
FIG. 1 illustrates an illustrative system 100 for providing video content to a display device. Display device 104 in system 100 can be a television or any other device that can display images. The image content 106 can be provided by the image providing device 102. Image providing device 102 can be a portable media player, a DVD player, a set top box, or any other suitable device that can provide images. The image content 106 can be stored in a memory in the image providing device 102, or the image providing device 102 can obtain the image content 106 directly from an external source (eg, internet, DVD, etc.). Image content 106 may have any suitable resolution (e.g., 320x240, 160x120, 640x480, etc.), any suitable encoding (e.g., uncompressed, H.264, MPEG, etc.) may be used, and may have any other suitable image characteristics.
Image providing device 102 includes processing circuitry 108. Processing circuitry 108 converts video content 106 into video signals suitable for transmission to display device 104. The image signal can have any suitable format. For example, the image signal may have a composite video, S-Video, or component video (eg, YPbPr, RGB, etc.) format. The image signal can use a digital format such as a high definition multimedia interface (HDMI) or a digital video interface (DVI) format. Processing circuitry 108 may include an encoder for mapping video content 106 to a video signal of a given image transmission standard. Processing circuitry 108 may include, for example, National Television System Board (NSTC), Progressive Phase Inversion (PAL), or SECAM encoders. In order to simplify the explanation, the following "image content" and "image signal" can be used alternately. For example, "low resolution video signal" means an image signal corresponding to low resolution image content.
Image signals from processing circuitry 108 can be sent to display device 104 using connection line 110. Connection line 110 can be one or more cables or other wired connections. Connection line 110 can also be a wireless connection. The display device 104 receives the transmitted video signal from the connection line 110. Display device 104 can include processing circuitry 112 and display screen 114. The display screen 114 displays the video content 106 to the user. Display screen 114 can have any suitable resolution (eg, 640x480, 1280x720, 1920x1080, etc.). The processing circuit 112 processes the image signal received from the connection line 110 and prepares an image for display on the display screen 114. The processing circuit 112 can process the image signal according to the resolution or other features of the display screen 114 and can attempt to improve the image quality of the image.
For sequential scanning displays or displays that display full screen at each moment, processing circuitry 112 includes circuitry for deinterlacing to interlace scanned images. An interlaced scanned image is an image composed of two types of fields: an odd field composed of odd lines of pixels in the image and an even field composed of even lines in the image. To create an interlaced scanned image, the two fields are displayed in an alternating manner at each time interval (e.g., every 16.67 milliseconds for NTSC, every 20 milliseconds for PAL, etc.). Therefore, an odd field is displayed every other time interval, and an even field is displayed in the remaining time interval. Because only half of the pixels in the display are used at any given instant, the interlaced scanned image has at most half the resolution of the display. On the other hand, sequential scanning of images can use the full resolution of the display. Converting an interlaced scanned image into a sequential scanned image involves a process known as deinterlacing. Deinterlacing involves using incomplete information to determine odd pixel rows in even fields and/or to determine even pixel rows in odd fields. Further attributes of the display device 104 are described below in conjunction with FIG.
System 200 in Figure 2 is an illustrative system that includes various types of image providing devices. The image providing device in the system 200 may include a portable media player 208 (eg, an image MP3 player, an image mobile phone, etc.), a DVD player 210, a set top box 206, a video recorder (VCR) 212, and a computer/notebook computer. Device 204. It should be understood that any other type of image providing device can be included in system 200, and thus system 200 is not limited to the image providing device shown in FIG. For example, system 200 can include image providing devices other than DVD player 210 that supports removable digital optical discs, such as HD-DVD and Blu-ray Blu-ray discs. Accordingly, while DVDs are described in various embodiments in this application, it should be understood that these embodiments are applicable to both HD-DVD and Blu-ray.
Each of the image providing devices in system 200 can support one or more of the formats and standards described with reference to FIG. 1 or any other suitable format or standard. For example, the portable media player 208 can provide video signals in a composite video and S-Video format via the connection line 214. Connection line 214 may include any number of wired (e.g., cables, etc.) or wireless connection lines. Although portable media player 208 is shown in Figures 2 and 4 for providing video signals in composite video and S-Video formats, this is merely an illustrative example. In some embodiments, instead of or in addition to composite and S-Video, portable media player 208 can support other suitable output formats, such as any of the formats described with reference to FIG. For example, the portable media player 208 can support sequential or interlaced scanned component video and/or can support one One or more digital image interfaces, such as HDMI or DVI.
As shown in FIG. 2, display device 104 can have one or more sockets/interfaces 202 (not shown in FIG. 1) to receive image signals, wherein each interface can support one or more of the above-described FIG. Image format. For example, display device 104 can have separate input jacks for composite video, S-Video, component video, HDMI, and DVI. Thus, any image providing device in system 200 can provide image content via one or more outlets 202. If connection line 214 is wireless, socket/interface 202 can be a network interface. In system 200, portable media player 208 is shown coupled to display device 104 via a composite video and S-Video jack. However, any other image providing device can be coupled to display device 104 using one or more of these or other outlets. Therefore, various types of image providing devices can use the same interface to provide image content to the display device 104.
Processing circuit 112 (FIG. 2) receives image signals from one of outlets 202. The processing circuit 112 processes the received video signal to display the video content on the display screen 114. For example, for interlaced scanned image signals, processing circuitry 112 may use three dimensional (3D) deinterlacing to convert the received image signals into a sequential scan format. 3D de-interlacing may obtain a full picture from a semi-resolution field by spatial interpolation (eg, pixel copying, averaging adjacent pixels, etc.) and/or by temporal combination (eg, combining odd and even fields, etc.). Therefore, 3D de-interlacing can use all relevant information (such as space and time) to deinterlace the image signal. This processing technique is suitable for images that have been somewhat high resolution and high quality, such as images intended to be displayed on a television set (e.g., television broadcasts received by set top box 206, commercial movies from DVD player 210, etc.).
However, the characteristics of the image content often vary depending on the type of image providing device. While many devices offer high resolution (eg 720x480) and high quality (professional generated) images, there are many devices that may offer lower resolution (eg 320x240, 160x120, etc.) and/or low quality (eg amateurs) )image. For example, portable media player 208 can provide images with low resolution due to its small screen size. Computer/notebook device 204 and set top box 206 can provide internet content, which is often low resolution and/or user generated. Moreover, any of the image providing devices shown in system 200 (Fig. 2) can provide highly compressed and therefore low quality image content. In general, the resolution and quality of the image provided to the display device 104 may be comparable due to differences between the image providing device and the image compression/encoding algorithm. Different places. However, the processing circuit 112 generally does not know the origin of the video signal, so it is possible to process the low-resolution video signal in substantially the same manner as the high-resolution signal. These processing techniques, such as the 3D deinterlacing techniques described above, may be less effective for low resolution video signals. In fact, in some cases, the application of processing techniques intended for high-resolution images may actually reduce the quality of low-resolution image signals.
FIG. 3 illustrates a 3D de-interlacing circuit of display device 104 for a counter-effect that may be caused by low resolution images provided by portable media player 208. The portable media player 208 can store and display images with low resolution such as 320x240. One picture (or two combined fields) of a 320x240 still image is represented as an image/picture 302, where each box represents one pixel. That is, image 302 represents a series of images that are not changing in the image so that the resulting image does not move over a period of time. In the event that the user wants to view images stored in the portable media player 208 or another display (eg, display device 104), the video content may be transmitted as an image signal over connection line 214. In some embodiments, the transmitted image signal has a standard format that requires image signals to be transmitted at a higher resolution (eg, 640x480). Thus, the portable media player 208 can simply increase (eg, double) the number of rows and the number of pixels in each row. Image 304 represents the odd field of image 302 after conversion to 640x480. The even field is the same as the odd field. Obviously, even if image 304 is sent as such, it does not have a resolution of 640x480. The processing circuitry 112 of the display device 104, which does not know the origin of the video signal, may blindly apply 3D deinterlacing at 306 as if it were applied to a real 640x480 resolution image. Therefore, the processing circuit 112 detects that the image has not changed at successive instants and combines the odd and even fields. For a typical 640x480 image, the combination will produce a full resolution picture with complete information. However, for 3D deinterlacing of 320x240 images transmitted as 640x480, an image 308 is produced. Note that the image 308 does not improve the original image 302 and is displayed on a larger size, resulting in a jagged and blocky visual effect.
For low resolution images sent with higher resolution standards, 2D deinterlacing can produce better image quality results. 2D de-interlacing does not use time information to interpolate, but interpolates unknown pixels based on surrounding known pixels. This form of de-interlacing may be more suitable for 320x240 images transmitted at 640x480 because no information is obtained by combining odd and even fields. in In some embodiments, 2D deinterlacing may involve vector interpolation, where edges in each image (eg, contours of objects, etc.) are determined, the angle of the edges is calculated, and from the calculated edge angles The positioned neighboring pixels interpolate the unknown pixels. Performing 2D deinterlacing with vector interpolation at 310 can produce an image 312. Image 312 may be an improvement with respect to image 308, and the serrated and agglomerated edges have been softened. Vector interpolation and its function are described in more detail in the following: U.S. Patent Application Serial No. 11/294,709, the entire disclosure of which is incorporated herein by reference.
Therefore, in order to improve the presentation of low resolution and possibly low quality images, image signals corresponding to low resolution images may be processed prior to receipt by processing circuitry 112 (FIG. 1). Instead of providing image signals directly from the image providing device to the display device 104, as shown in Figures 1 and 2, the image signals may first be processed by the image format converter. In some embodiments, the image format converter can be embedded in a device external to both the image providing device and the display device. FIG. 4 shows an illustrative system 400 that uses such an external device, such as docking station 408. The low resolution image content can be provided by the portable media player 208, which is a type of image providing device 102. The low resolution image content can be stored in a storage device 402 within the portable media player. Processing circuitry 404 can convert the stored image content to an image signal using any of the techniques described in connection with processing circuitry 108 in FIG. The image signal can be sent to the docking station 408 via the connection line 214. The converter 410 can convert the image providing device from the connection line 214 into an image signal 412, which will be more pleasing when displayed on the display device 104. In some embodiments, image format converter 410 can convert the composite video or S-Video output from connection line 214 to a sequential scan format, such as HDMI, at 412. Thus, image format converter 410 can perform deinterlacing using techniques appropriate to the particular frequency and quality of the image signal. For example, as described in connection with FIG. 3, image format converter 410 can interleave the erroneous video signal using 2D instead of 3D. Therefore, since the image is transmitted to the display device 104 using the sequential scan format, a de-interlacing circuit of the display 104 that may not be suitable may be avoided.
The docking station 408 can additionally include circuitry or functionality in addition to the image format converter 410. If the connection line 214 is wireless, the docking station 408 can include a network interface for receiving and processing wireless video signals. In some embodiments, the received video signal may have a compressed format (eg, H.264, MPEG4, VC-1, MPEG2, etc.). Dock 408 can therefore be packaged A circuit that decompresses the compressed image signal and provides the decompressed signal to image converter 410. In some embodiments, docking station 408 can support the use of one connection line (eg, a cable, wireless connection line) to receive multiple image formats. The docking station 408 can then additionally include a multi-format decoder (not shown). The multi-format decoder can pre-process the received video signal according to the format of the image. For example, as described above, decoding the video signal may involve decompressing the compressed video signal according to the type of compression used.
In some embodiments, the docking station 408 in FIG. 4 is designed for a particular type of portable media player (eg, an image MP3 player). For example, docking station 408 can include an interface for coupling a portable media player to the device. The shape of this interface can be such that only input signals from a brand or a type of portable media player are accepted. Alternatively, the interface can include a dedicated connector. In other embodiments, the interface for docking station 408 can support a set of portable media players, a set of DVD players, a set of computer/notebook devices, or a set of any other type of image providing device. In other embodiments, docking station 408 can support a set of image providing devices (eg, all image providing devices that provide NTSC, etc.). Thus, the invention described herein is not limited to portable media players, but can be applied to any device that provides low resolution images. Thus, docking station 408 can include any type of interface (eg, physical connector, network, dedicated interface, etc.) for coupling electronic devices to the docking station.
Moreover, image format converter 410 (Fig. 4) and any other circuitry described in connection with docking station 408 need not be embedded in the image providing device and the device external to the display. In some embodiments, image format converter 410 can be part of processing circuitry 112 (FIG. 1) in display device 104. For example, image format converter 410 can be embedded within a television set and can selectively process received video signals based on the resolution and/or quality of the images. Alternatively, image format converter 410 can process all received image signals regardless of resolution/quality. In other embodiments, image format converter 410 may be part of a processing circuit in an image providing device. For example, image format converter 410 can be embedded in a computer/notebook device and can selectively process image signals based on the resolution and/or quality of the image prior to transmission. Alternatively, image format converter 410 can process all of the image signals independently of resolution/quality prior to transmission. The image format converter embedded in the device can be activated or disabled by the user (for example by pressing a button on the remote control of the television, by selecting settings on the computer, etc.).
Flowchart 500 in FIG. 5 illustrates illustrative steps that image format converter 410 (FIG. 4) can use to deinterlace and process image signals. Image format converter 410 receives the video signal at step 502, which may be in any suitable format. At step 504, the image format converter 410 can detect the resolution of the image signal. In some embodiments, image format converter 410 may only capture image input from a particular type or brand of image providing device. For example, docking station 408 (Fig. 4) may include an interface that is shaped to fit a type of device, or image format converter 410 may be embedded in a particular image providing device. In these embodiments, the resolution detection at step 504 may be simpler because it may be hard-coded or hard-wired resolution depending on the known encoding of the image providing device. Other dedicated or more advanced connections may include embedded resolution information. In some embodiments, and for a particular type of product, the resolution information may also be provided in response to user input, such as in response to the user explicitly selecting content of a particular resolution. For example, when downloading web content, one can often explicitly choose the resolution for downloading web content. For the example described in connection with FIG. 3, image format converter 410 may be physically wired or hard coded to expect the resolution of each transmitted image to be 320x240, or equivalently, the actual resolution is expected to be the transmitted resolution. Half of it.
In other embodiments of system 400 in FIG. 4, image format converter 410 can be used with multiple image providing devices. Therefore, the resolution or scaling factor of the video signal received at step 502 in flowchart 500 (FIG. 5) may be different. In this case, the resolution detection of the image signal at step 504 is more complicated. The image converter may have, for example, a front end circuit that detects pixel reproduction in the image signal. The detector can compare adjacent pixels vertically and/or horizontally, or the detector can compare a plurality of surrounding pixels. The pixel radius or similar metric for a given comparison can be programmable. Also, the threshold percentage of pixels that should be met to form a convincing resolution is also programmable. For the example described in connection with FIG. 3, image format converter 410 can detect that the received 640x480 video signal actually has a resolution of 320x240. If a mobile phone having a resolution of 160x120 is actually coupled to the image format converter 410, the image format converter 410 may detect the true resolution or detect that the true resolution is a quarter of the transmitted resolution. One (again assume that the resolution sent is 640x480).
At step 506 in Figure 5, the received image signal can be deinterlaced. Can be sent with it The resolution is used to interleave the image signal regardless of any difference between the transmitted resolution and the actual resolution. However, the technique for deinterlacing the video signal can be selected based on the detected resolution. For the example described in connection with FIG. 3, the transmitted 640x480 resolution image may be directly deinterleaved by image format converter 410 and may be deinterleaved using 2D due to the detected 320x240 resolution. In other cases, de-interlacing may involve other forms of 2D de-interlacing, some form of 3D de-interlacing, or any other de-interlacing technique. An advanced form of 3D deinterlacing is described in more detail in the following documents: U.S. Patent Application Serial No. 11/932,686, the entire disclosure of which is incorporated herein by reference.
De-interlacing in step 506 of Figure 5 may additionally include scaling the image to an image size suitable for display on a television or other large screen display (e.g., display device 104). For example, image converter 410 can scale a 640x480 image to the resolution of display screen 114, which can have, for example, a resolution of 1280x720 or 1920x1080. Image format converter 410 can perform picture rate conversion. That is, when an image signal is being converted from one standard to another (e.g., from NTSC to PAL), image format converter 410 can adjust the picture rate in accordance with the specifications of the standard. In the event that the received video signal already has a sequential scan format, the image format converter 410 may not have to interleave the video signal, but may perform other processing steps, such as scaling the image and/or performing a picture rate conversion. For example, if the original content is determined to be 320x240 of a sequential scan of 30 frames per second, but the display screen 114 is 1280x720 of 60 frames per second, the converter 410 can scale the image signal to 1280x720 using vector interpolation and pass Each screen is repeated once and converted to 60 frames per second. Alternatively, picture rate conversion by converter 410 may involve more advanced forms of picture rate conversion, such as motion compensated picture rate conversion. The picture rate conversion, and more particularly the motion compensated picture rate conversion, and its function are described in more detail in the following documents: U.S. Patent Application Serial No. 11/803,535, issued to to-A. in. The image converter 410 can process the image signal in other ways. Additional processing may include any of the techniques described below in connection with steps 702 and 704 of flowcharts 700 and 800 (Figs. 7 and 8). These techniques can be selected based on the detected resolution of the image signal.
Flowchart 600 in FIG. 6 illustrates an alternate step that may be used by image format converter 410 (FIG. 4) to deinterlace and process image signals. At step 602, an image is received from an image providing device Signal. The image signal can be in any suitable format. At step 604, the resolution of the image is determined. Detection or determination of image resolution may be performed using any of the techniques described in connection with step 504 of flowchart 500 (FIG. 5). After determining the image resolution, image converter 410 may convert the image signal to its actual resolution at step 606. For the example described in connection with FIG. 3, image converter 410 can restore the received 640x480 video signal to a 320x240 video signal. The image converter 410 can cancel any pixel copying performed by the image providing device, thereby restoring the original image signal. Image converter 410 may ignore pixels that are determined to be replicas of other pixels, or image converter 410 may perform another processing technique that restores image signals having their true resolution.
After obtaining the image signal having its original resolution at step 606, image converter 410 (FIG. 3) may deinterleave and process the converted image signal at step 608. Because the image signal has its proper resolution, the deinterlacer can be optimally adapted to scale the image from its original true resolution (eg, 320x240 of the image in FIG. 4) to a display screen (eg, A de-interlacing technique that displays the final resolution of the screen 114). De-interlacing at step 608 may involve any type of de-interlacing (e.g., 2D, 3D, etc.) as described above in connection with step 506 of flowchart 500 (Fig. 5). Other processing is also applied to the image signal, including any of the techniques described below in conjunction with steps 702 and 704 in flowcharts 700 and 800 (Figs. 7 and 8). Any of these techniques can be selected based on the true resolution of the image.
Figures 7 and 8 show illustrative flow diagrams 700 and 800 for improving the display of low resolution images on a large screen display. In Figure 7, additional processing steps are performed after the deinterlacing of step 506. Although flowchart 700 illustrates de-interlacing using the steps from flowchart 500 (FIG. 5), the steps in flowchart 600 (FIG. 6) may be used instead (eg, by replacing steps 502 through 506 in FIG. 7). For steps 604 to 608). The particular processing techniques performed on the image may depend on whether the image is of high quality (eg, professionally generated images, low resolution images on the Internet, images from the portable media player 208, etc.) or low quality. (for example, images produced by amateurs on the Internet, highly compressed images, etc.). The quality of the image can be determined in any suitable manner. If, for example, docking station 408 only obtains input from one type of image providing device and the image providing device typically provides images of substantially the same quality, the quality may be hard coded or physically wired. Or you can Determine the appropriate metrics for accessing image quality. If the calculated metric is greater than a particular threshold, the image can be considered high quality.
Low quality images may be affected by artifacts such as square artifacts and mosquito noise. Square artifacts represent a blocky display of low resolution images that are typically seen in areas of less detail in the image. Mosquito noise is an excitation effect caused by truncating high frequency brightness and/or chromaticity coefficients, usually seen around sharp edges in the image. These and other artifacts can be caused by amateur recording and/or coding techniques (eg, using non-ideal compression settings, holding a handheld camera instead of using a tripod, etc.).
For low resolution images, compression artifacts may be reduced at step 702 (e.g., by converter 410 in Figure 4). The artifact reduction at step 702 can include reducing one or more types of artifacts (eg, mosquito noise, square artifacts, etc.). One or more hardware-based or software-based modules can be used to reduce artifacts. One or more types of artifacts can be reduced by combining different noise reduction techniques into a single module, by cascading various noise reduction modules, or using any other suitable technique. In some embodiments, block and mosquito noise reduction may be used at step 702. This can be referred to as "MPEG noise reduction," but its application benefits any compression scheme based on discrete cosine transform (DCT), including H.264, VC-1, MPEG4, and MPEG2. In some embodiments, 3D image noise reduction can be used to reduce temporal and spatial noise. The amount of noise reduction performed at step 702 (e.g., the number of noise reduction techniques used, the extent to which each technique is used, etc.) may depend on the assessment of the quality of the image. MPEG noise reduction and 3D image noise reduction are described in more detail in the following documents: U.S. Patent Application Serial No. 11/521,927 to Pathak, and U.S. Patent Application Serial No. 11/400,505, to, et al. The whole is incorporated herein. Each document also describes the manner in which the quality of the image is assessed. The former has block and mosquito noise measurements, the latter with automatic noise estimation. Any one or two or any other suitable measurement can be used to determine whether the image is of high quality or low quality and/or to determine the amount of noise reduction needed.
As described above, the video signal may include real information about the video content and the noise before the noise reduction of step 702 is performed. Because of the poor quality of the image signal, a disproportionate amount of image information in the signal may be noise information rather than real image information. Therefore, after the noise is reduced in step 702, it may be reduced or even completely removed. The raw information of the amount of proportionality. Therefore, simply displaying the remaining information may not produce a pleasant picture, as there may be little detail. For example, a low resolution image taken by a handheld camera may have a moving picture caused by a shaking camera, even if the background or other portion of the picture is substantially non-moving for successive images. Therefore, when the image is compressed, in other cases it will be noticed that the field/picture invariant inter-frame compression may not be as efficient. For a given data rate or file size, extra bits are used to capture the sway "noise", leaving fewer bits for details and other real information. Noise reduction can reduce noise caused by shaking cameras, effectively reducing or removing information from image signals. Therefore, if the remaining information is displayed to the user, there may not be enough image information to create a pleasing display. For example, the resulting image may have blurred edges because the original edges have noise and are removed. Similarly, the resulting image may have low contrast. In general, once artifacts are removed from the noise regions of the picture, there may be few details remaining in those areas.
Therefore, after the noise of step 702 is reduced, the image signal is enhanced at step 704 (eg, by image converter 410 in FIG. 4). Image enhancement at step 704 may involve enhancing different aspects of the image (eg, edges, color/light contrast, etc.). Image enhancement can be performed using one or more hardware-based or software-based modules. One or more aspects of the image may be enhanced by combining different image enhancement techniques into a single module, by cascading individual image enhancement modules, or using any other suitable technique. In some embodiments, image enhancement may involve color remapping. That is, a particular color in an image can be mapped to other tones or other colors. For example, a green hue that generally corresponds to the color of the grass can be remapped to a brighter, healthier hue of green. In some embodiments, image enhancement may include changing the contrast of color or brightness. For example, to make the picture more vivid, the image processor can increase the brightness contrast. Color remapping and image contrast enhancement and their functions are discussed in more detail in the following documents: U.S. Patent Application Serial No. 11/296,163 to Srinivasan et al., and U.S. Patent Application Serial No. 11/295,750, to Srinivasan et al. The citations are incorporated herein in their entirety.
Image enhancement at step 704 can include adding film grain. Film grain is a high frequency noise that is naturally present in the film but is not present in the digital image. Call it here can be added Noise source of any distribution rate and size into the image signal. Typically, film grain is produced by a film grain generator and applied to a high definition digital image. Film grain on high definition digital images is used to create a softer, creamier feel as a film feature in the picture. This is often done by adding a spatial time noise pattern, which is a particularly effective way to create "inductive masking" that reduces visual sharpness. On the other hand, for low resolution images, the increase in film grain can produce a textured appearance in the blurred image. Increasing the film grain can produce an illusion of detail in the picture, even though there may be little detail in detail due to low resolution and reduced noise at step 702. Film grain can be added to mask the remaining artifacts or other areas of poor image quality. For example, if a noise mode with a high spatial time frequency is used, then "inductive masking" may cause the viewer to be less aware of the remaining artifacts or be disturbed by the remaining artifacts. The production and addition of film granules and their function are discussed in more detail in the following documents: Balram et al., U.S. Patent Application Serial No. 11/313,577, which is incorporated herein in entirety by reference.
High quality but low resolution images (eg, professionally generated images from the Internet) may also be enhanced in accordance with the techniques described in connection with step 704. Step 702 can often be skipped because professionally generated images are typically not affected by a large number of compression artifacts. The above techniques for image enhancement or any other suitable technique can be used for masking deficiencies, for analog details, for smoothing block regions, for adding contrast to the picture, or for providing improvements in large screen displays ( For example, any other enhancements to the viewing comfort of a low resolution image (eg, 320x240 image from portable media player 208) on a display screen 114) having a resolution of 1280x720.
Referring now to Figure 8, an illustrative flow diagram 800 illustrates an alternate embodiment for improving the image quality of an image. Note that the steps in flowchart 800 are the same as those in flowchart 700 (FIG. 7), but are arranged in a different order. Although flowchart 800 illustrates de-interlacing using the steps from flowchart 500 (FIG. 5), the steps in flowchart 600 (FIG. 6) may be used instead (eg, by replacing steps 502 and 504 with steps 602-606). And replace step 506 with 608). Flowchart 800 illustrates that deinterlacing does not necessarily occur prior to additional processing steps. In particular, deinterlacing step 506 is shown in flowchart 800 as occurring between processing steps 702-704. However, it should be understood that deinterlacing can be performed at any time relative to each of the noise reduction and image enhancement techniques associated with steps 702 and 704. That is, the flowchart 800 can be changed, So that any noise reduction techniques associated with step 702 can be performed simultaneously or after deinterlacing (for low resolution images), and any image enhancement techniques associated with step 704 can be performed simultaneously or before deinterlacing. Thus, the de-interlacing step 506 can also follow the processing step 704.
Referring now to Figures 9A through 9G, various example implementations of the present invention are illustrated.
Referring now to Figure 9A, the present invention can be implemented in a hard disk drive (HDD) 900. The present invention can be implemented as part of a signal processing and/or control circuit, generally designated 902 in Figure 9A. In some implementations, signal processing and/or control circuitry 902 and/or other circuitry (not shown) in HDD 900 can process data, perform encoding and/or encryption, perform computations, and/or formatted output. Data received to magnetic storage medium 906 and/or received from magnetic storage medium 906.
The HDD 900 can communicate with a host device (not shown) via one or more wired or wireless communication connection lines 908, such as a computer, mobile computing device (such as a personal digital assistant, a mobile phone, a media, or an MP3 player, etc.) ) and / or other devices. The HDD 900 can be coupled to a memory 909, such as random access memory (RAM), non-volatile memory (such as flash memory), read only memory (ROM), and/or other suitable electronic data storage devices.
Referring now to Figure 9B, the present invention can be implemented in a digital versatile compact disc (DVD) drive 910. The present invention can be implemented as part of the signal processing and/or control circuitry of DVD drive 910 (which is generally designated 912 in Figure 9B) and/or mass data storage device 918. Signal processing and/or control circuitry and/or other circuitry in the DVD 910 can process the material, perform encoding and/or encryption, perform calculations, and/or format the material read from the optical storage medium 916 and/or be written. The data entered into the optical storage medium 916. In some implementations, signal processing and/or control circuitry 912 and/or other circuitry (not shown) in DVD 910 can also perform other functions, such as encoding and/or decoding and/or associated with a DVD drive. Any other signal processing features.
The DVD drive 910 can communicate with an output device (not shown), such as a computer, television, or other device, via one or more wired or wireless communication connections 917. The DVD 910 can communicate with a mass storage device 918 that stores data in a non-volatile manner. The mass data storage device 918 can include a hard disk drive (HDD). HDD can have in Figure 9A The configuration shown. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The DVD 910 can be connected to a memory 919 such as RAM, ROM, non-volatile memory (such as flash memory) and / Or other suitable electronic data storage device.
Referring now to Figure 9C, the present invention can be implemented in a high definition television (HDTV) 20. The present invention can be implemented as part of the signal processing and/or control circuitry of HDTV 920 (which is generally designated 922 in Figure 9C), WLAN interface 929, and/or mass data storage device 927. The HDTV 920 receives HDTV input signals in a wired or wireless format and generates HDTV output signals for the display 926. In some implementations, the signal processing circuitry and/or control circuitry 922 and/or other circuitry (not shown) of the HDTV 920 can process data, perform encoding and/or encryption, perform calculations, format data, and/or perform Other types of HDTV processing required.
The HDTV 920 can communicate with a mass data storage device 927 that stores data in a non-volatile manner, such as optical and/or magnetic memory (eg, a hard disk drive HDD and/or DVD). At least one HDD may have the configuration shown in FIG. 9A, and/or at least one DVD may have the configuration shown in FIG. 9B. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The HDTV 920 can be connected to a memory 928, such as RAM, ROM, non-volatile memory (such as flash memory). And/or other suitable electronic data storage devices. HDTV 920 can also support connection to WLAN via WLAN network interface 929.
Referring now to FIG. 9D, the present invention can be implemented in a digital entertainment system 932 of a vehicle 930 that can include a WLAN interface 944 and/or a mass storage device 940.
The digital entertainment system 932 can communicate with a mass storage device 940 that stores data in a non-volatile manner. The mass data storage device 940 can include optical and/or magnetic memory such as a hard disk drive (HDD) and/or a DVD drive. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The digital entertainment system 932 can be coupled to a memory 942, such as RAM, ROM, non-volatile memory (such as fast Flash memory) and/or other suitable electronic data storage devices. Digital entertainment system 932 may also support connection to WLAN via WLAN network interface 944. In some implementations, vehicle 930 includes an audio output 934 (such as a speaker), Display 936 and/or user input interface 938 ( Such as a small keyboard, touch panel, etc.).
Referring now to FIG. 9E, the present invention can be implemented in a mobile phone 950, which can include a mobile antenna 951. The present invention can be implemented as part of a signal processing and/or control circuit for mobile phone 950 (which is generally designated 952 in Figure 9E), WLAN interface 968, and/or mass data storage device 964. In some implementations, the mobile phone 950 includes a microphone 956, an audio output 958 (such as a speaker and/or audio output jack), a display 960, and/or an input device 962 (such as a keypad, pointing device, voice drive, and/or Other input devices). Signal processing and/or control circuitry 952 and/or other circuitry (not shown) in mobile phone 950 can process data, perform encoding and/or encryption, perform calculations, format data, and/or perform other mobile phone functions. .
The mobile phone 950 can communicate with a mass data storage device 964 that stores data in a non-volatile manner, such as optical and/or magnetic memory (eg, a hard disk drive HDD and/or DVD). At least one HDD may have the configuration shown in FIG. 9A, and/or at least one DVD may have the configuration shown in FIG. 9B. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The mobile phone 950 can be connected to a memory 966, such as RAM, ROM, non-volatile memory (such as flash memory). And/or other suitable electronic data storage device. The mobile phone 950 can also support connection to the WLAN network via the WLAN network interface 968.
Referring now to Figure 9F, the present invention can be implemented in a set top box 980. The present invention can be implemented as part of the signal processing and/or control circuitry of set top box 980 (which is generally designated 984 in FIG. 9F), WLAN interface 996, and/or mass data storage device 990. Set top box 980 receives signals from sources such as broadband and outputs standard and/or high definition audio/video signals suitable for display 988, such as televisions and/or monitors and/or other video and/or audio output devices. The signal processing and/or control circuitry 984 and/or other circuitry (not shown) of the set top box 980 can process the material, perform encoding and/or encryption, perform calculations, format the material, and/or perform any other set top box functions.
The set top box 980 can communicate with a mass storage device 990 that stores data in a non-volatile manner. The mass data storage device 990 can include optical and/or magnetic memory such as a hard disk drive (HDD) and/or a DVD drive. At least one HDD may have the one shown in Figure 9A Configuration, and/or at least one DVD may have the configuration shown in Figure 9B. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The set top box 980 can be connected to a memory 994, such as RAM, ROM, non-volatile memory (such as flash memory) And/or other suitable electronic data storage device. The set top box 980 can also support connection to the WLAN via the WLAN network interface 996.
Referring now to Figure 9G, the present invention can be implemented in media player 1000. The present invention can be implemented as part of the signal processing and/or control circuitry of media player 1000 (which is generally designated 1004 in Figure 9G), WLAN interface 1016, and/or mass data storage device 1010. In some implementations, the media player 1000 includes a display 1007 and/or a user input interface 1008 (such as a keypad, touch panel, etc.). In some implementations, the media player 1000 can use a graphical user interface (GUI) that typically uses a function table, a drop down menu, an icon, and/or an instructed click interface via the display 1007 and/or the user input interface 1008. The media player 1000 also includes an audio output 1009, such as a speaker and/or audio output jack. The signal processing and/or control circuitry 1004 and/or other circuitry (not shown) of the media player 1000 can process the material, perform encoding and/or encryption, perform calculations, format the material, and/or execute any other media player. Features.
The media player 1000 can communicate with a mass data storage device 1010 that stores data, such as compressed audio and/or video content, in a non-volatile manner. In some implementations, the compressed audio file includes files that conform to the MP3 format or other suitable compressed audio and/or image formats. The mass data storage device 1010 can include optical and/or magnetic storage devices such as a hard disk drive HDD and/or a DVD. At least one HDD may have the configuration shown in FIG. 9A, and/or at least one DVD may have the configuration shown in FIG. 9B. The HDD can be a miniature HDD that includes one or more magnetic disks having a diameter of less than about 1.8". The media player 100 can be coupled to a memory 1014, such as RAM, ROM, non-volatile memory (such as flash memory). And/or other suitable electronic data storage devices. The media player 1000 can also support connections to the WLAN via the WLAN network interface 1016. Implementations other than those described above are also contemplated.
The system and method for improving the image quality of low resolution images on large screen displays are described above. Those skilled in the art can make various modifications and changes to the present invention without biasing The spirit and scope of the present invention. It is intended that the present invention cover the modifications and variations of the inventions
100‧‧‧System for providing video content to display devices
102‧‧‧Image providing device
104‧‧‧Display device
106‧‧‧Image content
108‧‧‧Processing circuit
110‧‧‧Connected lines
112‧‧‧Processing Circuit
114‧‧‧Display screen
200‧‧‧ systems (multiple types of image providing devices)
202‧‧‧Socket/Interface
204‧‧‧Computer/notebook computer device
206‧‧‧Set top box
208‧‧‧Portable Media Player
210‧‧‧DVD player
212‧‧‧Video recorder
214‧‧‧Connected lines
302‧‧‧Low-resolution image/screen
304‧‧‧High-resolution images
306‧‧3D deinterlacing
308‧‧‧3D deinterlaced image
310‧‧‧2D deinterlacing
312‧‧‧2D deinterlaced image
402‧‧‧Storage device
404‧‧‧Processing Circuit
408‧‧‧Docking Station
410‧‧‧Image Format Converter
412‧‧‧Image signal
500, 600, 700, 800‧‧‧ flow chart
502, 504, 506‧ ‧ steps
602, 604, 606, 608‧ ‧ steps
702, 704‧‧‧ steps
900‧‧‧ hard disk drive
902‧‧‧ Signal processing and / or control circuit
906‧‧‧Magnetic storage media
908‧‧‧Connected lines
909‧‧‧ memory
910‧‧‧DVD drive
912‧‧‧ Signal processing and / or control circuit
916‧‧‧Optical storage media
917‧‧‧Connected lines
918‧‧‧large capacity data storage device
919‧‧‧ memory
920‧‧‧High Definition TV
922‧‧‧ Signal processing and / or control circuit
926‧‧‧ display
927‧‧‧ Large-capacity data storage device
928‧‧‧ memory
929‧‧‧WLAN (Wireless Local Area Network) interface
930‧‧‧ Vehicles
932‧‧‧Digital Entertainment System
934‧‧‧Audio output
936‧‧‧ display
938‧‧‧User input interface
940‧‧‧large capacity data storage device
942‧‧‧ memory
944‧‧‧Wireless network interface
950‧‧‧Mobile Phone
951‧‧‧Mobile antenna
952‧‧‧ Signal processing and / or control circuit
956‧‧‧ microphone
958‧‧‧Audio output
960‧‧‧ display
962‧‧‧Input device
964‧‧‧large capacity data storage device
966‧‧‧ memory
968‧‧‧WLAN network interface
980‧‧‧Set top box
984‧‧‧ Signal processing and / or control circuit
988‧‧‧ display
990‧‧‧ Large capacity data storage device
994‧‧‧ memory
996‧‧‧WLAN network interface
1000‧‧‧Media Player
1004‧‧‧ Signal processing and / or control circuit
1007‧‧‧ display
1008‧‧‧User input interface
1009‧‧‧Audio output
1010‧‧‧ Large-capacity data storage device
1014‧‧‧ memory
1016‧‧‧WLAN network interface
Figure 1 shows an image providing device coupled to a display device; Figure 2 illustrates a plurality of image providing devices connectable to a display device; Figure 3 illustrates the difference between two-dimensional (2D) and three-dimensional (3D) de-interlacing Figure 4 illustrates a system using a docking station or other hardware for processing image signals; Figures 5 through 6 are illustrative flow charts for processing low resolution image signals; Figures 7 through 8 are shown for improvement An illustrative flow chart of image quality for low resolution images; FIG. 9A is a block diagram of an exemplary hard disk drive that can use the disclosed technology; FIG. 9B is a block diagram of an exemplary digital versatile optical disk that can use the disclosed technology; FIG. A block diagram of an example high definition television set that can use the disclosed technology; FIG. 9D is a block diagram of an example vehicle that can use the disclosed technology; FIG. 9E is a block diagram of an example mobile phone that can use the disclosed technology; FIG. A block diagram of an example set top box of the disclosed technology can be used; Figure 9G is a block diagram of an example media player that can use the disclosed technology.
A method for processing low-resolution image content to be displayed on an image display, the method comprising: receiving an image signal at a first resolution; detecting an actual resolution of the received image signal, wherein the actual The resolution is less than the first resolution; and the image signal is processed according to the actual resolution, wherein one of the complex deinterlacing techniques is selected according to the actual resolution.
The method of claim 1, wherein processing the image signal comprises deinterlacing the image signal.
The method of claim 2, further comprising: outputting the deinterleaved image signal using a sequential scan format.
The method of claim 2, wherein the deinterlacing comprises performing spatial interpolation without combining successive fields.
The method of claim 4, wherein when the low-resolution image content has an image that does not substantially change for successive instants, spatial interpolation that does not combine successive fields is performed.
The method of claim 4, wherein performing spatial interpolation comprises performing vector interpolation.
The method of claim 6, wherein performing vector interpolation comprises: determining an edge in the low-resolution image content; calculating an angle of the edge; and interpolating in a direction of the angle Adjacent pixels.
The method of claim 1, wherein detecting the actual resolution comprises detecting pixel copying in the image signal.
The method of claim 8, wherein detecting pixel replication comprises comparing one or more pixels to horizontally adjacent pixels.
The method of claim 8, wherein detecting pixel replication comprises comparing one or more pixels to vertically adjacent pixels.
The method of claim 9, wherein detecting pixel copying further comprises: calculating a percentage of one or more pixels that conform to the neighboring pixels; and determining whether the percentage is greater than a threshold.
The method of claim 11, wherein the threshold is programmable.
The method of claim 9, wherein detecting pixel replication comprises comparing surrounding pixels within a radius surrounding the one or more pixels.
The method of claim 13, wherein the radius is programmable.
The method of claim 1, wherein processing the image signal comprises: scaling the image to a second resolution, wherein the second resolution is greater than the actual resolution.
The method of claim 15, wherein the second resolution is greater than the first resolution.
The method of claim 1, wherein processing the image signal comprises performing a picture rate conversion.
The method of claim 1, further comprising: converting the image signal into an image signal having the actual resolution.
The method of claim 18, wherein converting the image signal comprises ignoring pixel copying in the image signal.
A method for processing low-resolution image content to be displayed on an image display, the method comprising: receiving an image signal corresponding to the image content of the first resolution, wherein the image content has less than the first The actual resolution of the resolution; and processing the image signal according to the actual resolution, wherein processing the image signal comprises: selecting one of the plurality of noise reduction technologies according to the actual resolution; Defects in the image signal; and enhancing the image signal.
The method of claim 20, wherein the reducing artifacts comprise one or more of three-dimensional image noise reduction and MPEG noise reduction.
The method of claim 20, wherein the enhancing the image signal comprises one or more of color remapping, contrast enhancement, and film grain addition.
The method of claim 20, further comprising: detecting a quality of the image content; and bypassing the noise reduction step if the quality is greater than a threshold.
The method of claim 20, wherein processing the image signal further comprises: interlacing the image signal according to the actual resolution.
The method of claim 20, wherein detecting the actual resolution comprises detecting pixel duplication in the image signal.
The method of claim 20, wherein the processing the image signal further comprises: converting the image signal into an image signal having the actual resolution.
A method for displaying low-resolution image content on an image display, the method comprising: receiving a first resolution image signal; detecting an actual resolution of the received image signal, wherein the actual resolution is less than Decoding the first resolution according to the actual resolution, wherein the second resolution is greater than the first resolution, wherein the second resolution corresponds to a resolution of the image display; selecting one of a plurality of deinterlacing techniques according to the actual resolution; and displaying the scaled image signal on the image display.
The method of claim 27, wherein the scaling the image signal comprises: converting the received image signal into an image signal having the actual resolution; and scaling the converted image signal to have the image signal The second resolution video signal.
The method of claim 27, further comprising: deinterlacing the image signal.
The method of claim 27, further comprising: reducing artifacts in the image signal; and enhancing the image signal.
The method of claim 27, wherein detecting the actual resolution comprises: A pixel copy in the image signal is detected.
The method of claim 27, wherein the actual resolution is 320x240, the first resolution is 640x480, and the second resolution is one of 1280x720 and 1920x1080.
A method for processing low-resolution image content to be displayed on an image display, the method comprising: receiving resolution information for indicating a first resolution; and receiving an image signal corresponding to the image content of the second resolution The second resolution is greater than an actual resolution of the video content; and the image signal is processed according to the resolution information, wherein one of the complex deinterlacing techniques is selected according to the resolution information .
The method of claim 33, wherein the first resolution is substantially equal to the actual resolution.
The method of claim 33, wherein receiving the resolution information comprises: receiving a user selection of the first resolution.
The method of claim 33, wherein processing the image signal comprises: reducing artifacts in the image signal; and enhancing the image signal.
The method of claim 33, wherein processing the image signal further comprises: interleaving the image signal according to the resolution information.
The method of claim 33, wherein processing the image signal further comprises: converting the image signal into an image signal having the first resolution.
The method of claim 33, wherein processing the image signal comprises: scaling the image signal to a third resolution, wherein the third resolution is greater than the actual resolution.
A method for processing low-resolution image content to be displayed on an image display, the method comprising: receiving an image signal corresponding to the image content from a media device, wherein the actual resolution is greater than the image content First resolution to receive the image signal; The image signal is processed according to a second resolution, wherein the second resolution is associated with the media device, and one of a complex deinterlacing technique is selected according to the second resolution.
The method of claim 40, wherein the second resolution is substantially equal to the actual resolution.
The method of claim 40, wherein processing the image signal comprises: reducing artifacts in the image signal; and enhancing the image signal.
The method of claim 40, wherein processing the image signal further comprises: interlacing the image signal according to the second resolution.
The method of claim 40, wherein processing the image signal further comprises: converting the image signal into an image signal having the second resolution.
The method of claim 40, wherein processing the image signal comprises: scaling the image signal to a third resolution, wherein the third resolution is greater than the actual resolution.
A system for processing low-resolution image content to be displayed on an image display, comprising: means for receiving a first resolution image signal; and means for detecting an actual resolution of the received image signal, wherein The actual resolution is less than the first resolution; and means for processing the image signal according to the actual resolution, wherein one of the complex deinterlacing techniques is selected according to the actual resolution.
The system of claim 46, wherein the means for processing the image signal comprises means for deinterlacing the image signal.
The system of claim 47, further comprising: means for outputting the deinterleaved image signal using a sequential scan format.
The system of claim 47, wherein the means for deinterlacing comprises means for performing spatial interpolation without combining successive fields.
The system of claim 49, wherein the method for performing spatial interpolation The component includes means for performing spatial interpolation that does not combine successive fields when the low resolution image content has an image that does not substantially change for successive instants.
The system of claim 49, wherein the means for performing spatial interpolation comprises means for performing vector interpolation.
The system of claim 51, wherein the means for performing vector interpolation comprises: means for determining an edge in the low-resolution image content; and calculating an angle of the edge a component; and means for interpolating adjacent pixels in the direction of the angle.
The system of claim 46, wherein the means for detecting the actual resolution comprises: means for detecting pixel copying in the image signal.
The system of claim 53, wherein the means for detecting pixel duplication comprises means for comparing one or more pixels to horizontally adjacent pixels.
The system of claim 53, wherein the means for detecting pixel copying comprises: means for comparing one or more pixels to vertically adjacent pixels.
The system of claim 54, wherein the means for detecting pixel copying further comprises: means for calculating a percentage of one or more pixels that match the adjacent pixels; and for determining whether The component with a percentage greater than the threshold.
The system of claim 56, wherein the threshold is programmable.
The system of claim 54, wherein the means for detecting pixel duplication comprises means for comparing surrounding pixels within a radius surrounding the one or more pixels.
The system of claim 58 wherein the radius is programmable.
The system of claim 46, wherein the means for processing the image signal comprises: means for scaling the image to a second resolution, wherein the second resolution is greater than Describe the actual resolution.
The system of claim 60, wherein the second resolution is greater than the first resolution.
The system of claim 46, wherein the means for processing the image signal comprises means for performing a picture rate conversion.
The system of claim 46, further comprising: means for converting the image signal into an image signal having the actual resolution.
The system of claim 63, wherein the means for converting the image signal comprises: means for ignoring pixel copying in the image signal.
A system for processing low-resolution image content to be displayed on an image display, comprising: means for receiving an image signal corresponding to the image content of the first resolution, wherein the image content has less than the first An actual resolution of the resolution; and means for processing the image signal according to the actual resolution, wherein the means for processing the image signal comprises: selecting a plurality of noise reduction according to the actual resolution One of the techniques; a component for reducing artifacts in the image signal; and means for enhancing the image signal.
The system of claim 65, wherein the means for reducing artifacts comprises one or more components for performing three-dimensional image noise reduction and MPEG noise reduction.
The system of claim 65, wherein the means for enhancing the image signal comprises one or more components for performing color remapping, contrast enhancement, and film grain addition.
The system of claim 65, further comprising: means for detecting a quality of the image content; and means for bypassing the noise reduction step if the quality is greater than a threshold.
The system of claim 65, wherein the means for processing the image signal further comprises: means for deinterlacing the image signal according to the actual resolution.
The system of claim 65, wherein the means for detecting the actual resolution comprises: means for detecting pixel copying in the image signal.
The system of claim 65, wherein the means for processing the image signal further comprises: converting the image signal into an image having the actual resolution The components of the signal.
A system for displaying low-resolution image content on an image display, the system comprising: means for receiving a first resolution image signal; means for detecting an actual resolution of the received image signal, wherein The actual resolution is smaller than the first resolution; and the component is used to scale the image signal to a second resolution according to the actual resolution, wherein the second resolution is greater than the first resolution. Degree, wherein the second resolution corresponds to a resolution of the image display; one for selecting one of a complex deinterlacing technique according to the actual resolution; and for displaying the image on the image display The component of the scaled image signal.
The system of claim 72, wherein the means for scaling the image signal comprises: means for converting the received image signal into an image signal having the actual resolution; A component that scales the converted image signal into an image signal having the second resolution.
The system of claim 72, further comprising: means for deinterlacing the image signal.
The system of claim 72, further comprising: means for reducing artifacts in the image signal; and means for enhancing the image signal.
The system of claim 72, wherein the means for detecting the actual resolution comprises: means for detecting pixel duplication in the image signal.
The system of claim 72, wherein the actual resolution is 320x240, the first resolution is 640x480, and the second resolution is one of 1280x720 and 1920x1080.
A system for processing low resolution image content to be displayed on an image display, the system comprising: a means for receiving resolution information indicating a first resolution; a means for receiving an image signal corresponding to the image content of the second resolution, wherein the second resolution is greater than an actual resolution of the image content And means for processing the image signal based on the resolution information, wherein one of the complex deinterlacing techniques is selected based on the resolution information.
The system of claim 78, wherein the first resolution is substantially equal to the actual resolution.
The system of claim 78, wherein the means for receiving the resolution information comprises means for receiving a user selection of the first resolution.
The system of claim 78, wherein the means for processing the image signal comprises: means for reducing artifacts in the image signal; and means for enhancing the image signal .
The system of claim 78, wherein the means for processing the image signal further comprises: means for deinterlacing the image signal based on the resolution information.
The system of claim 78, wherein the means for processing the image signal further comprises: means for converting the image signal into an image signal having the first resolution.
The system of claim 78, wherein the means for processing the image signal comprises: means for scaling the image signal to a third resolution, wherein the third resolution is greater than The actual resolution.
A system for processing low-resolution image content to be displayed on an image display, comprising: means for receiving an image signal corresponding to the image content from a media device, wherein the actual resolution is greater than the image content a first resolution of the degree to receive the image signal; and means for processing the image signal according to a second resolution, wherein the second resolution is associated with the media device, and according to the The second resolution is to select one of the complex deinterlacing techniques.
The system of claim 85, wherein the second resolution is substantially equal to the actual resolution.
The system of claim 85, wherein the means for processing the image signal comprises: means for reducing artifacts in the image signal; and means for enhancing the image signal .
The system of claim 85, wherein the means for processing the image signal further comprises: means for deinterlacing the image signal according to the second resolution.
The system of claim 85, wherein the means for processing the image signal further comprises: means for converting the image signal into an image signal having the second resolution.
The system of claim 85, wherein the means for processing the image signal comprises: means for scaling the image signal to a third resolution, wherein the third resolution is greater than The actual resolution.
An image format converter for processing low-resolution image content to be displayed on an image display, the image format converter comprising: a receiver for receiving an image signal; and a detecting circuit for detecting the received image signal The actual resolution, wherein the actual resolution is less than the first resolution; and the processing circuit is configured to process the image signal according to the actual resolution.
The image format converter of claim 91, wherein the processing circuit comprises: a deinterleaving circuit for deinterlacing the image signal.
The image format converter of claim 92, wherein the deinterleaving circuit is configured to output the deinterleaved video signal using a sequential scan format.
The image format converter of claim 92, wherein the deinterleaving circuit is configured to perform spatial interpolation without combining successive fields.
The image format converter of claim 94, wherein the deinterleaving circuit is further configured to perform a non-combination continuous when the low-resolution image content has an image that does not substantially change for successive instants The spatial interpolation of the field.
The image format converter of claim 94, wherein the deinterleaving circuit configured to perform spatial interpolation comprises a vector interpolator.
The image format converter of claim 96, wherein the deinterleaving circuit is configured to: determine an edge in the low resolution image content; calculate an angle of the edge; Adjacent pixels are interpolated in the direction of the angle.
The image format converter of claim 91, wherein the detection circuit comprises a copy detection circuit for detecting pixel reproduction in the image signal.
The image format converter of claim 98, wherein the copy detection circuit is configured to compare one or more pixels to horizontally adjacent pixels.
The image format converter of claim 98, wherein the copy detection circuit is configured to compare one or more pixels to vertically adjacent pixels.
The image format converter of claim 99, wherein the copy detection circuit is further configured to: calculate a percentage of one or more pixels that match the neighboring pixels; and determine whether the percentage is greater than threshold.
The image format converter of claim 101, wherein the threshold is programmable.
The image format converter of claim 99, wherein the copy detection circuit is further configured to compare surrounding pixels within a radius surrounding the one or more pixels.
The image format converter of claim 103, wherein the radius is programmable.
The image format converter of claim 91, wherein the processing circuit is configured to scale the image to a second resolution, wherein the second resolution is greater than the actual resolution.
The image format converter of claim 105, wherein the second resolution is greater than the first resolution.
The image format converter of claim 91, wherein the processing circuit comprises a rate conversion circuit for performing picture rate conversion.
The image format converter of claim 91, further comprising a converter for converting the image signal into an image signal having the actual resolution.
The image format converter of claim 108, wherein the converter is configured to ignore pixel duplication in the image signal.
A docking station comprising an image format converter as defined in claim 91.
The docking station of claim 110, wherein the interface of the docking station is shaped to receive an image signal from a type of image providing device.
The docking station of claim 110, further comprising a selection circuit for controllably bypassing the included image format converter.
A display comprising an image format converter as defined in claim 91.
A media providing device comprising an image format converter as defined in claim 91 of the application.
An image format converter for processing low-resolution image content to be displayed on an image display, comprising: a receiver for receiving an image signal corresponding to the image content of the first resolution, wherein the image content has An actual resolution that is smaller than the first resolution; and a processing circuit that processes the image signal according to the actual resolution, the processing circuit includes: a reduction circuit, configured to reduce the image signal An artifact; and an enhancement circuit for enhancing the image signal.
The image format converter of claim 115, wherein the reduction circuit comprises one or more circuits for performing three-dimensional image noise reduction and MPEG noise reduction.
The image format converter of claim 115, wherein the enhancement circuit comprises circuitry for performing one or more of color remapping, contrast enhancement, and film grain addition.
The image format converter as described in claim 115, further comprising: a quality detecting circuit for detecting a quality of the image content; and a bypass circuit for bypassing the noise reduction step if the quality is greater than a threshold.
The image format converter of claim 115, wherein the processing circuit further comprises a deinterleaving circuit for deinterlacing the image signal.
The image format converter of claim 115, wherein the detection circuit comprises a copy detection circuit for detecting pixel reproduction in the image signal.
The image format converter of claim 115, further comprising a converter for converting the image signal to an image signal having the actual resolution.
A docking station comprising an image format converter as defined in claim 115 of the application.
The docking station of claim 122, wherein the interface of the docking station is shaped to receive an image signal from a type of image providing device.
The docking station of claim 122, further comprising a selection circuit for controllably bypassing the included image format converter.
A display comprising an image format converter as defined in claim 115 of the application.
A media providing device comprising an image format converter as defined in claim 115 of the application.
A system for displaying a low-resolution image content on an image display, comprising: a receiver for receiving a first resolution image signal; and a detection circuit for detecting an actual resolution of the received image signal, wherein The actual resolution is smaller than the first resolution; the processing circuit is configured to scale the image signal to a second resolution according to the actual resolution, wherein the second resolution is greater than the first resolution Degree, wherein the second resolution corresponds to a resolution of the image display; and a display for displaying the scaled image signal on the image display.
The system of claim 127, wherein the processing circuit comprises: a converter for converting the received image signal into an image signal having the actual resolution; and a scaling circuit for The converted image signal is scaled to an image signal having the second resolution.
The system of claim 127, wherein the processing circuit comprises: a reduction circuit for reducing artifacts in the image signal; and an enhancement circuit for enhancing the image signal.
The system of claim 127, wherein the processing circuit comprises a deinterleaving circuit for deinterlacing the image signal.
The system of claim 127, wherein the detection circuit comprises a copy detection circuit for detecting pixel reproduction in the image signal.
The system of claim 127, wherein the actual resolution is 320x240, the first resolution is 640x480, and the second resolution is one of 1280x720 and 1920x1080.
An image format converter for processing low-resolution image content to be displayed on an image display, comprising: a receiver for receiving: resolution information for indicating a first resolution; and corresponding to the second resolution The image signal of the image content, wherein the second resolution is greater than the actual resolution of the image content; and the processing circuit is configured to process the image signal according to the resolution information.
The image format converter of claim 133, wherein the first resolution is substantially equal to the actual resolution.
The image format converter of claim 133, wherein the resolution information is selected and received from a user.
The image format converter of claim 133, wherein the processing circuit comprises: a reduction circuit for reducing artifacts in the image signal; and an enhancement circuit for enhancing the image signal .
The image format converter of claim 133, wherein the processing circuit comprises a deinterleaving circuit for deinterlacing the image signal according to the resolution information.
The image format converter of claim 133, wherein the processing power The circuit includes a converter for converting the image signal into an image signal having the first resolution.
The image format converter of claim 133, wherein the processing circuit includes a scaling circuit for scaling the image signal to a third resolution, wherein the third resolution is greater than the Actual resolution.
A docking station comprising an image format converter as defined in claim 133.
An image format converter for processing low-resolution image content to be displayed on an image display, comprising: a receiver for receiving an image signal corresponding to the image content from a media device, wherein the image is larger than the image a first resolution of the actual resolution of the content to receive the image signal; and processing circuitry for processing the image signal according to a second resolution, wherein the second resolution is associated with the media device .
The image format converter of claim 141, wherein the second resolution is substantially equal to the actual resolution.
The image format converter of claim 141, wherein the processing circuit comprises: a reduction circuit for reducing artifacts in the image signal; and an enhancement circuit for enhancing the image signal .
The image format converter of claim 141, wherein the processing circuit comprises a deinterleaving circuit for deinterlacing the image signal according to the second resolution.
The image format converter of claim 141, wherein the processing circuit comprises a converter for converting the image signal into an image signal having the second resolution.
The image format converter of claim 141, wherein the processing circuit includes a scaling circuit for scaling the image signal to a third resolution, wherein the third resolution is greater than the Actual resolution.
A docking station comprising an image format converter as defined in claim 141.
TW097100393A 2007-01-05 2008-01-04 Methods and systems for improving low-resolution video TWI466547B (en)
US87896707P true 2007-01-05 2007-01-05
TW200845762A TW200845762A (en) 2008-11-16
TWI466547B true TWI466547B (en) 2014-12-21
ID=39609259
TW097100393A TWI466547B (en) 2007-01-05 2008-01-04 Methods and systems for improving low-resolution video
US (2) US8269886B2 (en)
TW (1) TWI466547B (en)
WO (1) WO2008085874A2 (en)
TWI348821B (en) * 2007-08-08 2011-09-11 Alpha Networks Inc Interface converting circuit
US9836812B2 (en) 2011-10-26 2017-12-05 I-Cubed Research Center Inc. Image processing apparatus, method, and medium to apply a restrictive condition
CN108076351A (en) * 2016-11-16 2018-05-25 杭州海康威视数字技术股份有限公司 A kind of audio, video data coding method, device and electronic equipment
TW591936B (en) * 2002-01-25 2004-06-11 Thomson Licensing Sa Method and system for contouring reduction
US6724433B1 (en) 2000-12-06 2004-04-20 Realnetworks, Inc. Automated inverse telecine conversion
JP2004159191A (en) 2002-11-07 2004-06-03 Seiko Epson Corp Conversion of frame rate in accordance with image data
JP4490914B2 (en) * 2003-03-13 2010-06-30 パナソニック株式会社 Data processing device
KR100510147B1 (en) 2003-08-26 2005-08-25 삼성전자주식회사 Apparatus for Picture In Picture(PIP)
US20060152627A1 (en) 2005-01-13 2006-07-13 Ruggiero Carl J Video processing system and method with dynamic tag architecture
WO2005076595A2 (en) 2004-02-02 2005-08-18 Thomson Licensing S.A. Method and apparatus for providing automatic format switching according to input aspect ratio
WO2005107272A1 (en) 2004-04-14 2005-11-10 Thomson Licensing S.A. A system and a method for sharing video input jacks
KR20060021446A (en) 2004-09-03 2006-03-08 삼성전자주식회사 Method for deinterlacing and apparatus thereof
EP1667442B1 (en) * 2004-12-02 2010-05-19 Harman Becker Automotive Systems GmbH De-interlacing for video reproduction
WO2006113776A2 (en) 2005-04-20 2006-10-26 Jupiter Systems Audiovisual signal routing and distribution system
WO2008100640A1 (en) 2007-02-16 2008-08-21 Marvell World Trade Lte. Methods and systems for improving low resolution and low frame rate video
2008-01-04 US US11/969,705 patent/US8269886B2/en active Active
2008-01-04 TW TW097100393A patent/TWI466547B/en active
2008-01-04 WO PCT/US2008/000100 patent/WO2008085874A2/en active Application Filing
2012-08-30 US US13/599,459 patent/US8819760B2/en active Active
WO2006109863A1 (en) * 2005-04-13 2006-10-19 Matsushita Electric Industrial Co., Ltd. Resampling detection apparatus, resampling detection method, resampling apparatus, and resampling method
US20080211959A1 (en) 2008-09-04
WO2008085874A3 (en) 2009-04-02
US8269886B2 (en) 2012-09-18
US8819760B2 (en) 2014-08-26
WO2008085874A2 (en) 2008-07-17
TW200845762A (en) 2008-11-16
US20120320265A1 (en) 2012-12-20
CN1258910C (en) 2006-06-07 Method and system for transformation of interlaced format into non-interlaced format