Source: http://www.google.com/patents/US7330199?ie=ISO-8859-1
Timestamp: 2014-09-19 19:59:57
Document Index: 298388319

Matched Legal Cases: ['art.\n3', 'art.\n4', 'art.\n16', 'art.\n17', 'art.\n19', 'art.\n20']

Patent US7330199 - Image processing method and apparatus, and image display method and ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign in<nobr>Advanced Patent Search</nobr>PatentsAn image is processed by detecting pixel-to-pixel variations in brightness level, generating high spatial frequency information related to the variations, setting interpolation points with a spacing that varies according to the high spatial frequency information, and generating new pixels by interpolation...http://www.google.com/patents/US7330199?utm_source=gb-gplus-sharePatent US7330199 - Image processing method and apparatus, and image display method and apparatus, with variable interpolation spacingAdvanced Patent SearchPublication numberUS7330199 B2Publication typeGrantApplication numberUS 10/716,634Publication dateFeb 12, 2008Filing dateNov 20, 2003Priority dateJun 20, 2000Fee statusPaidAlso published asUS6724398, US7429994, US20020030690, US20040135798, US20050156944Publication number10716634, 716634, US 7330199 B2, US 7330199B2, US-B2-7330199, US7330199 B2, US7330199B2InventorsJun Someya, Masaki Yamakawa, Yoshiaki Okuno, Hideki YoshiiOriginal AssigneeMitsubishi Denki Kabushiki KaishaExport CitationBiBTeX, EndNote, RefManPatent Citations (9), Referenced by (2), Classifications (18), Legal Events (1) External Links: USPTO, USPTO Assignment, EspacenetImage processing method and apparatus, and image display method and apparatus, with variable interpolation spacingUS 7330199 B2Abstract An image is processed by detecting pixel-to-pixel variations in brightness level, generating high spatial frequency information related to the variations, setting interpolation points with a spacing that varies according to the high spatial frequency information, and generating new pixels by interpolation at the interpolation points. By increasing the zoom ratio in one part and reducing the zoom in another part of each edge in a continuous manner, this method can mitigate edge degradation when an image is enlarged or reduced, without introducing discontinuities or other image artifacts. It also provides a convenient way to adjust edge sharpness in an image.
1. A method of processing an input image to obtain an output image, the input image being formed from input pixels having intensity levels, the method comprising:
(a) detecting pixel-to-pixel variations in the intensity levels in at least one direction in the input image, thereby generating high spatial frequency information: determining a localized zoom ratio based on the high spatial frequency information of local input pixels; (b) setting interpolation points with spacing between the interpolation points varying according to the localized zoom ratio; and (c) generating output pixels from the input pixels by interpolation at the interpolation points. 2. The method of claim 1, wherein said step (b) assigns a basic value to said spacing in parts of the image in which the intensity level of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part and a second part, reduces said spacing to less than the basic value in the first part, and increases said spacing to more than the basic value in the second part.
3. The method of claim 1, wherein said step (b) assigns a basic value to said spacing in parts of the image in which the intensity level of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part, a second part, and a third part, reduces said spacing to less than the basic value in the first part and the third part, and increases said spacing to more than the basic value in the second part.
4. The method of claim 1, wherein said step (a) includes calculating a first derivative of the intensity levels in said one direction.
5. The method of claim 4, wherein said step (a) includes calculating a second derivative of the intensity levels in said one direction.
6. The method of claim 4, wherein said step (a) includes calculating a third derivative of the intensity levels in said one direction.
7. The method of claim 4, wherein said step (a) includes performing a spatial filtering operation to obtain a certain spatial frequency component of the image.
8. The method of claim 1, wherein said step (a) includes detecting patterns of variation in the intensity levels of the input pixels.
9. The method of claim 8, wherein said patterns describe polarities of the pixel-to-pixel variations in the intensity levels of the input pixels.
10. The method of claim 9, wherein said patterns also describe magnitudes of the pixel-to-pixel variations in the intensity levels of the input pixels.
11. The method of claim 8, wherein said patterns describe changes in the intensity levels of three consecutive pixels among the input pixels.
12. The method of claim 8, wherein said patterns describe changes in the intensity levels of five consecutive pixels among the input pixels.
13. A machine-readable storage medium storing a machine-executable program for processing an image by the method of claim 1.
14. An image-processing apparatus for processing an image formed from input pixels having intensity levels to obtain an output image, comprising:
a first processing unit for detecting pixel-to-pixel variations in said intensity levels in at least one direction in the image, thereby generating high spatial frequency information, said first processing unit determining a localized zoom ratio based on the high spatial frequency information of local input pixels; a second processing unit coupled to the first processing unit, for setting interpolation points with spacing between the interpolation points varying according to the localized zoom ratio; and a third processing unit coupled to the second processing unit, for generating output pixels from the input pixels by interpolation at the interpolation points. 15. The image-processing apparatus claim 14, wherein the second processing unit assigns a basic value to said spacing in parts of the image in which the intensity levels of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part and a second part, reduces said spacing to less than the basic value in the first part, and increases said spacing to more than the basic value in the second part.
16. The image-processing apparatus claim 14, wherein the second processing unit assigns a basic value to said spacing in parts of the image in which the intensity levels of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part, a second part, and a third part, reduces said spacing to less than the basic value in the first part and the third part, and increases the spacing to more than the basic value in the second part.
17. An image display apparatus for displaying an image formed from input pixels having intensity levels, comprising:
a memory unit for storing the intensity levels of the input pixels; a first processing unit coupled to the memory unit, for detecting pixel-to-pixel variations in said intensity levels in at least one direction in the image, thereby generating high spatial frequency information, said first processing unit determining a localized zoom ratio based on the high spatial frequency information of local input pixels; a second processing unit coupled to the first processing unit, for calculating interpolation points with spacing between the interpolation points varying according to the localized zoom ratio; a third processing unit coupled to the second processing unit, for generating output pixels from the input pixels by interpolation at the interpolation points; and a display unit coupled to the third processing unit, for displaying the output pixels. 18. The image display apparatus of claim 17, wherein the second processing unit assigns a basic value to said spacing in parts of the image in which the intensity levels of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part and a second part, reduces said spacing to less than the basic value in the first part, and increases said spacing to more than the basic value in the second part.
19. The image display apparatus of claim 17, wherein the second processing unit assigns a basic value to said spacing in parts of the image in which the intensity levels of the input pixels is uniform, divides each portion of the image in which the intensity levels of the input pixels vary into a first part, a second part, and a third part, reduces said spacing to less than the basic value in the first part and the third part, and increases the spacing to more than the basic value in the second part.
20. The method of claim 1, wherein the pixel intensities represent brightness, luminance, or a color component.
21. The image processing apparatus of claim 14, wherein the pixel intensities represent brightness, luminance, or a color component.
22. The image display apparatus of claim 17, wherein the pixel intensities represent brightness, luminance, or a color component.
23. A method for processing an input image having input pixels to generate an output image having output pixels, comprising:
detecting variations of intensity between at least two input pixels of an image to generate localized high spatial frequency information; determining a localized zoom ratio based on the high spatial frequency information of local input pixels; determining localized inter-pixel spacing values between interpolation points based on the localized zoom ratio; and generating the output pixels from the input pixels by interpolation at the interpolation points. 24. The method of claim 23, wherein the pixel intensities represent brightness, luminance, or a color component.
25. A method of processing an input image to obtain an output image, the input image being formed from input pixels having intensity levels, the method comprising:
(a) detecting pixel-to-pixel variations in the intensity levels in at least one direction in the input image, thereby generating local pixel variation patterns; (b) determining a localized zoom ratio based on the local pixel variation patterns; (c) setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio; and (d) generating output pixels from the input pixel by interpolation at the interpolating points. 26. The method of claim 25, said determining step increasing the localized zoom ratio when the local pixel variations correspond to a leading edge segment.
27. The method of claim 25, said determining step decreasing the localized zoom ratio when the local pixel variations correspond to a trailing edge segment.
28. The method of claim 25, said setting step setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio and a basic zoom ratio.
29. The method of claim 28, said determining step setting the localized zoom ratio to zero when the local pixel variations correspond to a same type, increase or decrease, of variation between a first two pixels as between a second two pixels of a local pixel group.
30. The method of claim 28, said determining step setting the localized zoom ratio to zero when the local pixel variations correspond to a different type, increase or decrease, of variation between a first two pixels as between a second two pixels of a local pixel group.
31. The method of claim 28, said detecting step detecting pixel-to-pixel variations in the intensity levels between at least 3 pixels.
32. The method of claim 28, wherein n is the basic zoom ratio and α is the localized zoom ratio which satisfy the following equation 0≦α≦n.
33. A machine-readable storage medium storing a machine-executable program for processing an image by the method of claim 28.
34. A method of processing an input image to obtain an output image, the input image being formed from input pixels having intensity levels, the method comprising:
(a) detecting pixel-to-pixel variations in polarity and magnitude of the intensity levels in at least one direction in the input image, thereby generating local pixel variation patterns; (b) determining a localized zoom ratio α based on the polarity of local pixel variation patterns; (c) determining a further quantity β based on the magnitude of local pixel variation patterns; (d) setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio α and the further quantity β; and (e) generating output pixels from the input pixel by interpolation at the interpolating points. 35. The method of claim 34, said determining steps b) and c) increasing the localized zoom ratio α and setting the further quantity β to zero when the local pixel variations correspond to a gentle leading edge segment.
36. The method of claim 34, said determining steps b) and c) decreasing the localized zoom ratio α and setting the further quantity β to zero when the local pixel variations correspond to a gentle trailing edge segment.
37. The method of claim 34, said determining steps b) and c) increasing the localized zoom ratio α and increasing the further quantity β when the local pixel variations correspond to a sharp leading edge segment.
38. The method of claim 34, said determining steps b) and c) decreasing the localized zoom ratio α and decreasing the further quantity β when the local pixel variations correspond to a sharp trailing edge segment.
39. The method of claim 34, said setting step setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio α, the further quantity β and a basic zoom ratio n.
40. The method of claim 39, said determining steps b) and c) setting the localized zoom ratio α to zero and the further quantity β to zero when the local pixel variations correspond to a same type, increase or decrease, and a substantially same magnitude of variation between a first two pixels as between a second two pixels of a local pixel group.
41. The method of claim 39, said determining steps b) and c) setting the localized zoom ratio α to zero and the further quantity β to zero when the local pixel variations correspond to a different type, increase or decrease, and a substantially same magnitude of variation between a first two pixels as between a second two pixels of a local pixel group.
42. The method of claim 39, said determining steps b) and c) setting the localized zoom ratio α to zero and the further quantity β to zero when the local pixel variations do not exceed a threshold value.
43. The method of claim 34, wherein n, α, and β satisfy the following equation n-α-ABS(β)>0.
44. A machine-readable storage medium storing a machine-executable program for processing an image by the method of claim 34.
45. A method of processing an input image to obtain an output image, the input image being formed from input pixels having intensity levels, the method comprising:
(a) detecting pixel-to-pixel variations in polarity and magnitude of the intensity levels of five contiguous pixels in at least one direction in the input image, thereby generating local pixel variation patterns; (b) determining a localized zoom ratio α based on the polarity of local pixel variation patterns; (c) determining a further quantity γ based on the magnitude of local pixel variation patterns; (d) setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio α and the further quantity γ; and (e) generating output pixels from the input pixel by interpolation at the interpolating points. 46. The method of claim 45,
wherein the five contiguous pixels include a first pixel, a second pixel, a third pixel, a fourth pixel and a fifth pixel, said determining steps b) and c) increasing the localized zoom ratio α and setting the further quantity γ to zero when there is no substantial variation between the second and third pixels, a substantial variation between the third and fourth pixels, an no substantial variation between the fourth and fifth pixels. 47. The method of claim 45,
wherein the five contiguous pixels include a first pixel, a second pixel, a third pixel, a fourth pixel and a fifth pixel, said determining steps b) and c) increasing the localized zoom ratio α and increasing the further quantity γ when there is no substantial variation between the second and third pixels, a substantial variation between the third and fourth pixels of a first polarity, and a substantial variation between the fourth and fifth pixels of the first polarity. 48. The method of claim 45,
wherein the five contiguous pixels include a first pixel, a second pixel, a third pixel, a fourth pixel and a fifth pixel, said determining steps b) and c) decreasing the localized zoom ratio α and setting the further quantity γ to zero when there is no substantial variation between the third and fourth pixels, a substantial variation between the second and third pixels of a first polarity, and either a substantial variation between the first and second pixels having a second polarity or no substantial variation between the first and second pixels. 49. The method of claim 45,
wherein the five contiguous pixels include a first pixel, a second pixel, a third pixel, a fourth pixel and a fifth pixel, said determining steps b) and c) decreasing the localized zoom ratio α and decreasing the further quantity γ when there is a substantial variation between the first and second pixels of a first polarity, a substantial variation between the second and third pixels of the first polarity, and no substantial variation between the third and fourth pixels. 50. The method of claim 45, said setting step setting interpolation points with spacing between the interpolation points varying based on the localized zoom ratio α, the further quantity γ and a basic zoom ratio n.
wherein the five contiguous pixels include a first pixel, a second pixel, a third pixel, a fourth pixel and a fifth pixel, said determining steps b) and c) setting the localized zoom ratio α to zero and setting the further quantity γ to zero when there is a substantial variation between the second and third pixels of a first polarity, and a substantial variation between the third and fourth pixels of either the first or second polarity. 52. The method of claim 50, said determining steps b) and c) setting the localized zoom ratio α to zero and the further quantity γ to zero when the variations between the second and third pixels and the variations between the third and fourth pixels do not exceed a threshold value.
53. The method of claim 45, wherein n, α and γ satisfy the following equation n-α-ABS(γ)>0.
54. A machine-readable storage medium storing a machine-executable program for processing an image by the method of claim 45.
55. The method of claim 28, said determining step setting the localized zoom ratio to zero when the local pixel variations do not exceed a threshold value.
This application is a Continuation of application Ser. No. 09/883,940, filed on Jun. 20, 2001 now U.S. Pat. No. 6,724,398, the entire contents of which are hereby incorporated by reference and for which priority is claimed under 35 U.S.C. � 120; and this application claims priority under 35 U.S.C. � 119 of the following applications:
2000-184816
2001-015002
2001-061436
2000-354226
Dividing an image portion into multiple parts and increasing the interpolation spacing in at least one part while decreasing the interpolation spacing in another part enables the loss-of-sharpness problem to be mitigated in edge expansion, and the drop-out problem to be mitigated in image reduction, without changing the overall expansion or reduction ratio
The horizontal zoom ratio control unit 16 uses the horizontal derivatives hd1, hd2 output by the horizontal high-frequency information detector 15 to determine a horizontal zoom ratio hd1, and supplies this horizontal zoom ratio hd1 to the horizontal interpolator 14.
The horizontal interpolator 14 uses the supplied horizontal zoom ratio hd1 to generate output image data Po from the vertically zoomed image data Pv.
FIG. 10A shows an example of brightness levels in a horizontal line in the image data Pv output by the vertical interpolator 11. FIG. 10B shows the corresponding horizontal first derivative hd1 output by the horizontal high-frequency information detector 15, calculated as, for example, differences in brightness level between mutually adjacent pixels. FIG. 10C shows the corresponding horizontal second derivative hd2 output by the horizontal high-frequency information detector 15. The horizontal zoom ratio control unit 16 calculates the horizontal zoom ratio hd1 by the following equation, in which n is the basic zoom-ratio parameter mentioned earlier, and k is an arbitrary positive constant parameter.
hc 1 =n+(k�hd 1�hd 2)
AVE(hd 1)=n FIG. 10E depicts expanded image data Po obtained by interpolation with this varying horizontal zoom ratio hc1.
FIG. 11 illustrates the generation of output image data at an edge comprising three pixels (p1, p2, p3) in the image data Pv, when the basic zoom ratio (n) applied in uniform segments (a) is three. Output pixels are generated by interpolation at seven points (q11 to q17) using the type of linear filter response characteristic illustrated in FIG. 2. If the distance between p1 and p2 is taken to be unity, then the zoom ratio hd1 is the reciprocal of the spacing between adjacent interpolation points. This spacing can be seen to vary according to the curve in FIG. 10D, becoming shortest between q12 and q13, where the zoom ratio is highest, and longest between q15 and q16, where the zoom ratio is lowest.
Approximately speaking, the distance between points q11 and q12 is the reciprocal of the zoom ratio at q12, the distance between q12 and q13 is the reciprocal of the zoom ratio at q13, and so on. New pixels can thus be generated at points given by the cumulative sum of the reciprocals of the zoom ratios. Specifically, the horizontal zoom ratio control unit 16 calculates the zoom ratio hd1 at the conventional evenly-spaced interpolation points (not visible), and the reciprocals (1/hc1) of the calculated hc1 values are cumulatively summed to set the interpolation points (q11 to q17) at which new pixels are actually generated. This process will be illustrated in the eighth embodiment.
The parameter k employed in calculating the variable zoom ratio hd1 can be used to control edge sharpness in the output image, larger values of k leading to sharper edges. This technique can be used to control edge sharpness even when the basic zoom ratio (n) is unity, so that the image as a whole is not expanded or reduced.
Horizontal zooming in the second embodiment is illustrated in FIGS. 14A to 14D. FIG. 14A shows an example of brightness levels in a horizontal line in the image data Pv output by the vertical interpolator 11. FIG. 14B shows the corresponding horizontal first derivative hd1 output by the horizontal high-frequency information detector 22. FIG. 14C shows the horizontal zoom ratio hc2 calculated by the horizontal zoom ratio control unit 23. At an edge (b, c) the horizontal zoom ratio control unit 23 calculates hc2 by the following equations, in which n is the basic zoom ratio, k is an arbitrary positive constant parameter, abs denotes absolute value, and r is the distance across the edge, normalized so that the width of the edge (b+c) is unity.
hc 2=n+(k�abs(hd 1)) if 0.0≦r<0.5 hc 2=n−(k�abs(hd 1)) if 0.5≦r<1.0
FIG. 15 shows another example, in which the edge comprises only two pixels (p4, p5) in the vertically zoomed image data Pv. The edge is still divided into a leading segment (b) and a trailing segment (b). In this example, the first derivative (hd1 ) is constant over both segments. The zoom ratio (hc2) is greater than n in the leading segment (b), and less than n in the trailing segment (c). The interpolation points of the output pixels (q20 to q25) are spaced more closely in the leading segment (b) than in the trailing segment (c). As in the first embodiment, if the distance between p4 and p5 is taken to be unity, then the spacing between the interpolation points is equal to the reciprocal of the zoom ratio. When displayed, the interpolated pixels (s20 to s25) are evenly spaced.
hc 2=n+((1−i)�k�abs(hd 1)) if 0≦r<i hc 2=n−(i�k�abs(hd 1)) if i≦r<1.0
The vertical high-frequency information detector 46 receives input image data Pi from the memory 5 and detects high spatial frequency information by performing operations that generate the first derivative vd1 and third derivative vd3 of the image data in the vertical direction. The vertical zoom ratio control unit 47 uses these derivatives vd1 , vd3 to determine a vertical zoom ratio vc4. The vertical interpolator 11 uses the vertical zoom ratio vc4 to generate vertically zoomed image data Pv from the received image data Pi.
hc 4=n+(k�hd 1 �hd 3)
AVE(hc 4 )=n FIG. 28F depicts expanded image data Po obtained by interpolation with this varying zoom ratio hc4.
The horizontal zoom ratio control unit 53 has the internal structure shown in FIG. 32, comprising a pair of absolute value calculators 54, 55, a subtractor 56, a multiplier 57, and an adder 58. Absolute value calculator 54 takes the absolute value of the horizontal first derivative hd1 . Absolute value calculator 55 takes the absolute value of the horizontal second derivative hd2. The subtractor 56 subtracts the absolute value of the horizontal first derivative from the absolute value of the second derivative. The multiplier 57 multiplies the resulting difference by a positive constant parameter k. The adder 58 adds the resulting product to the basic zoom ratio n to obtain the horizontal zoom ratio hc5.
The operation of the seventh embodiment is illustrated in FIGS. 33A to 33G. FIG. 33A shows an example of the brightness levels in a horizontal line in the vertically zoomed image data Pv. FIG. 33B shows the corresponding horizontal first derivative hd1 and FIG. 33C shows the corresponding horizontal second derivative hd2 as output by the vertical high-frequency information detector 12. FIG. 33D shows the absolute value of the horizontal first derivative abs(hd1 ) as calculated by absolute value calculator 54. FIG. 33E shows the absolute value of the horizontal second derivative abs(hd2) as calculated by absolute value calculator 55. FIG. 33F shows the horizontal zoom ratio hc5, which is calculated from these absolute values by the following equation.
hc 5=n+(k�((abs(hd 2)−abs(hd 1)))
In a variation of the eighth embodiment, the zoom processor 6 has the structure shown in FIG. 38. The vertical high-frequency information detector 61 comprises the vertical differentiator 63 described above, a vertical low-pass spatial filter 69, and a subtractor 70. The vertical low-pass spatial filter 69 generates vertical low-frequency image data Vs (y). The subtractor 70 takes the difference between the input image data Pi and the vertical low-frequency image data Vs(y), thereby generating vertical high-frequency image data Va(y) for supply to the vertical zoom rate control unit 64. Similarly, the horizontal high-frequency information detector 65 comprises the horizontal differentiator 67 described above, a horizontal low-pass spatial filter 71, and a subtractor 72. The horizontal low-pass spatial filter 71 generates horizontal low-frequency image data Hs(x). The subtractor 72 takes the difference between the vertically zoomed image data Pv and the horizontal low-frequency image data Hs(x), thereby generating horizontal high-frequency image data Ha(x) for supply to the horizontal zoom rate control unit 68. This variation generates the same output data Po as the structure shown in FIG. 35.
po′nm=G(r 11)p 11 +G(r 12)p 12+G(r 21)p 21+G(r 22)p 22 In the tenth embodiment, the accuracy of the interpolation calculation is enhanced because each interpolated value is obtained from the values of at least four of the pixels closest, in a two-dimensional sense, to the interpolation point qnm.
Horizontal high-frequency information is calculated in the next step (S8), which detects pixel level variations in the horizontal direction. Examples of the types of high-frequency information that may be obtained include a first derivative (hd1), second derivative (hd2), third derivative (hd3), horizontal variation pattern information (hp1), high-frequency image data (Ha(x)), and a difference between two low-frequency components (Hs1(x)−Hs2(x)), as described in the preceding embodiments. A horizontal zoom ratio (hd1) is then calculated from the horizontal high-frequency information and the basic horizontal zoom ratio, as described in any of the preceding embodiments (step S9), and horizontal interpolation filtering calculations are performed according to the calculated horizontal zoom ratio to generate new image data Po for output to the image post-processor 7 (step S10). These steps are repeated (step S11) until the end of the current scanning line is reached; then the next scanning line is processed in the same way until the last line has been processed (step S12) and the program ends.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS6002810Apr 15, 1996Dec 14, 1999Hitachi, Ltd.Resolution conversion system and methodUS6724398 *Jun 20, 2001Apr 20, 2004Mitsubishi Denki Kabushiki KaishaImage processing method and apparatus, and image display method and apparatus, with variable interpolation spacingUS20010020950 *Feb 23, 2001Sep 13, 2001International Business Machines CorporationImage conversion method, image processing apparatus, and image display apparatusUS20030053708 *Jul 2, 2001Mar 20, 2003Jasc SoftwareRemoval of block encoding artifactsJP2777202B2 Title not availableJP2000101870A Title not availableJPH0388478A Title not availableJPH09266531A Title not availableJPH11168622A Title not available* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7616838 *Oct 27, 2003Nov 10, 2009Mitsubishi Denki Kabushiki KaishaEdge-directed images sharpening methodUS8189941 *Nov 24, 2006May 29, 2012Nec CorporationImage processing device, display device, image processing method, and program* Cited by examinerClassifications U.S. Classification345/698, 345/690International ClassificationG06T5/20, G06T5/00, G09G3/20, G09G5/00Cooperative ClassificationG06T2207/20192, G06T5/002, G06T5/003, G09G2340/0421, G06T3/4007, G09G2340/0414, G06T5/20, G09G5/005, G09G5/006European ClassificationG06T5/20, G06T5/00D, G09G5/00T2Legal EventsDateCodeEventDescriptionJul 13, 2011FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google