Source: http://www.google.com/patents/US5481479?dq=6,563,928
Timestamp: 2016-10-24 00:03:42
Document Index: 281663969

Matched Legal Cases: ['art[2', 'art[2', 'art[2', 'art[2', 'art[0', 'art[0', 'art[0']

Patent US5481479 - Nonlinear scanning to optimize sector scan electro-optic reconnaissance ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsLong range, non-linear, sector scan panoramic electro-optical reconnaissance of a scene from an airborne craft is performed at increased aircraft velocities with a given detector technology at a desired level of performance. A focal plane array is configured to detect an image of the scene, and to convert...http://www.google.com/patents/US5481479?utm_source=gb-gplus-sharePatent US5481479 - Nonlinear scanning to optimize sector scan electro-optic reconnaissance system performanceAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS5481479 APublication typeGrantApplication numberUS 07/988,837Publication dateJan 2, 1996Filing dateDec 10, 1992Priority dateDec 10, 1992Fee statusPaidAlso published asCA2110962A1, CA2110962C, DE4342216A1, DE4342216B4Publication number07988837, 988837, US 5481479 A, US 5481479A, US-A-5481479, US5481479 A, US5481479AInventorsRalph H. Wight, Gregory J. WolfeOriginal AssigneeLoral Fairchild Corp.Export CitationBiBTeX, EndNote, RefManPatent Citations (10), Referenced by (61), Classifications (10), Legal Events (6) External Links: USPTO, USPTO Assignment, EspacenetNonlinear scanning to optimize sector scan electro-optic reconnaissance system performance
US 5481479 AAbstract
Long range, non-linear, sector scan panoramic electro-optical reconnaissance of a scene from an airborne craft is performed at increased aircraft velocities with a given detector technology at a desired level of performance. A focal plane array is configured to detect an image of the scene, and to convert the image into electronic charge information representing the image. A main electronics unit that converts the electronic charge representation into an electronic signal which is a digital representation of the image. A lens arrangement is used to focus a narrow slit of the scene onto the focal plane array, and a rotating prism scans the slit across the scene at a non-linear scanning velocity as determined according to the present invention. The electronic signal is transmitted to a ground station where it is processed to provide visual image data and that represents the scene, distortion induced into this data as a result of the non-linear scan velocity is removed to provide a distortion free final image.
1. A system for performing long range, sector scan panoramic electro-optical reconnaissance of a scene, the reconnaissance performed at increased scan velocities for a given ground resolved distance and forward overlap, comprising:(1) a focal plane array configured to detect an image of the scene and to convert said image into an electronic charge representation of said image; (2) a main electronics unit, coupled to said focal plane array, configured to convert said electronic charge representation into a digital image data signal, wherein said digital image data signal is a digital representation of said image; (3) focusing means, coupled to said focal plane array, for focusing a portion of the scene onto said focal plane array, wherein said portion of the scene is defined by a projection of said focal plane array; (4) determining means for determining a non-linear scan velocity; (5) scanning means. coupled to said focusing means for scanning said projection of said focal plane array across the scene at said non-linear scan velocity; and (6) processing means, coupled to said main electronics unit, for processing said digital image data signal to provide a visual image signal representing a corrected image, said corrected image having a pixel aspect ratio corrected to remove the effects of said non-linear scan velocity. 2. The system of claim 1, wherein said determining means is configured to determine said non-linear scan velocity using an exact solution, and wherein said exact solution determines said non-linear scan velocity such that a cross-track ground sample distance is kept constant throughout the scan.
The present invention is an apparatus and method for extending the operational velocity of sector-scanning panoramic LOROP without sacrificing system resolution.
The present invention is a system and method for non-linear scanning in electro-optical reconnaissance systems to allow an increased maximum operational aircraft velocity for a specified level of system resolution and forward overlap. The present invention takes advantage of increases in near-field resolution by increasing the scan velocity in the near field while maintaining a given FPA read rate (typically the maximum rate). Thus the overall scan velocity is increased without sacrificing system resolution. Since the overall scan velocity is increased, aircraft velocity V can be increased while maintaining a specified forward overlap.
The present invention was developed for use with the F-979H long-range tactical electro-optical sensor system, developed by Loral Fairchild Systems, Syosset, N.Y. This sensor system can be mounted in a variety of aircraft or in a reconnaissance pod or other such airborne craft. The core of this system is a Systems Imaging Sensor, comprising an imaging LRU (line replaceable unit) and three electronics LRUs. Additional equipment may include a reconnaissance management unit interfacing with the aircraft, a control panel, optical sights, and an in-flight data recorder. A ground data system, referred to as an EO-LOROPS ground station, is used to process the image data in real time, provide visual displays of the image data, record digital data on recorders, and record visual images on film.
LOROP system performance is often specified in terms of an image Interpretability Rating Scale (IIRS) value. The IIRS value is a quantitative, though partly subjective, measure of image quality. It is a function of slant range ρslant, altitude A, system resolution, atmospheric visibility, and solar illumination. A particular IIRS value is typically defined as a range of ground resolved distances (GRD) at a given slant range R anywhere within a given frame. Typical IIRS rating values and their associated GRD are listed in Section 6.0 of this document.
As discussed above, the present invention relies on what would otherwise be increased resolution in the near field to allow the scan velocity of the camera to be increased as the scan moves into the near field. According to the present invention, imagery data collected using an increasing scan velocity (non-linear scanning), is corrected on the ground to remove the geometric effects of such non-linear scanning. FIG. 3 is a flow chart illustrating a preferred process according to the present invention. FIG. 7 is a block diagram illustrating a preferred system according to the present invention. The present invention will now be described with respect to FIG. 3 and FIG. 7.
Certain assumptions can be made to simplify the computations required. Described in this section is a list of the assumptions used in a preferred embodiment of the present invention.
5.2 Determination of Scan Velocity and Line Rate
As outlined above, the desired scan velocity and the non-linear scan velocity are determined in steps 302 and 303, respectively. Steps 302 and 303 will be discussed in this section in more detail with reference to FIG. 5.
This section presents the exact solution for the modes 1, 4, and 5 angular scan velocity.
5.2.2 Polynomial Approximation Scan Equations for Modes 1, 4, and 5.
To find a quadratic polynomial approximation to the exact solution for the angular scan velocity of modes 1, 4, and 5, three equations with three unknowns are set up. The equations are solved for the coefficients. Note, it is desirable to obtain an approximation in which t begins at 0 and increases regardless of whether the scan is a forward (θdmax to θdmin) or reverse (θdmin to θdmax) scan. Therefore, in setting up the equations for a forward scan, time tpoly is used in the approximate equations and texact =tpoly in the exact equations. In setting up the equations for a reverse scan, tpoly is used in the approximate equations and texact =(tsused -tpoly) is used for the exact equations.
5.2.3 Exact Solution Scan Equations for Modes 2 and 3.
This section presents the exact solutions for the modes 2 and 3 angular scan velocity.
To find a quadratic polynomial approximation to the exact solution for the modes 2 and 3 angular scan velocity three equations in three unknowns are set up and solved for the coefficients. If the scan is completely described by either the first set or the second set of mode 2 and 3 equations presented in Section 5.1 then only one set of equations must be solved. If however θdmax >θdcutoff >θdmin then the scan will consist of two parts: the first described by the constant cross-track GSD equations, and the second described by the variable cross-track GSD equations. Thus, two sets of equations will have to be solved to find polynomial approximations for each part of the scan.
5.3 Pixel Aspect Ratio Correction Procedure
As described above, in step 308 the electronic signal representing the imagery data are processed and the pixel aspect ratio corrected. The pixel aspect ratio correction will now be discussed in detail. This subsection presents the correction in 2 steps. The first step is a derivation of the correction and the second step is an implementation of the pixel aspect ratio correction procedure.
The EO-LOROPS GES must produce minified view images via pixel averaging "on-the-fly" (in real time) as data are received or played back from a digital tape recorder. The minified view must fit into a nminif �nminif pixel buffer and the pixels in the minified view must have an angular aspect ratio of 1:1. For an image collected using a constant angular scan velocity the computation of the reduction factor is relatively simple: ##EQU22##
When it is time to compute line number lminif (zero relative) in the minified view image, the function nlg (lminif) is evaluated. Front-end electronics in the GES obtains nlg (lminif) full resolution lines, and averages down by navg in the pixel (in-track) dimension and by nlg (lminif) in the line (cross-track) dimension. Evaluation of nlg (lminif) can be done without any multiplications within a loop as demonstrated by the following pseudo-code:
__________________________________________________________________________/* * Set up 32-bit integer numbers needed for aspect ratio correction. The * only floating point numbers are "theta"s and flttemp. This would be * done by the airborne system and the various 32-bit numbers put intothe * pre-frame file (prf). The prf would contain: * * nlines  2 bytes * navg    1 byte * nminif-- part[2]      4 bytes * nlg-- part[[2]      8 bytes * inc27-- part[2]      8 bytes * inc38-- part[2]      8 bytes * inc38-- 2a-- part[2]      39 bytes#define SH    27#define SH2    11#define MASK    (&#732;(2 SH-1))#define MASK2    (&#732;(2 SH2-1))npart = 1if (one-part scan)nminif-- part[0] = ceil((theta-- d-- max - theta--d-- min) / delta-- theta-- minif)elsenpart = 2if  (forward scan)    nminif-- part[0] = ceil((theta-- d-- max    - theta-- min) / delta-- theta-- minif)elsenminif-- part[0]  =  ceil((theta-- cutoff  -  theta--d-- min)  /delta-- theta-- minif)}nminif-- part[[1] = ceil((theta-- d-- max - theta--d-- min) / delta-- theta-- minif)for ( p - 0; p &lt; npart; p++ ) /* for each part of the scan */{1minif = p * nminif-- part[p]  /* minified view line num at start ofpart */nlg-- part[p] = round(((alg[p ] * 1minif + blg[p]) * lminif +clg[p]) * 2 SH)flttemp = (alg[p] * (2 * lminif + 1) + blg[p]* 2 SHinc27.sub. -- part[p] = truncate(flttemp)inc38-- part[p] = round((flttemp - inc27-- part[p]) * 2 SH2)inc38-- 2a-- part[p] = round(2 * alg[p] * 2 (SH+SH2))}/* * Perform angular pixel aspect ratio correction. Thus is done by theGES * front-end electronics.for ( p - 0, lminif = 0, rem - 0; 1minif &lt; nminif-- part[p]; p++ ){/* get parameters for this part of scan */nminif - nminif-- part[p]nlg - ngl-- part[p]inc27 = inc27-- part[p]inc38 = inc38-- part[p]inc38-- 2a = inc38-- 2a-- part[p]/* create minified view lines */for ( ; lminif &lt; nminif; lminif++ ){nlg-- plus-- rem = nlg + remnlg-- plus-- rem.sub. -- plus-- half = nlg-- plus.sub.-- rem + 2 (SH-1)nlg-- integer = nlg-- plus-- rem-- plus-- half&gt;&gt; SHif ( nlg-- integer &lt; 1 ) nlg-- integer = 1/* at this point use navg, nlg-- integer to do averaging */rem - nlg-- plus-- rem - (nlg-- plus-- rem--plus-- half &amp; MASK)inc27 += inc38 &gt;&gt; SH2nlg += inc27inc38 -= inc38 &amp; MASK2inc38 += inc38-- 2a}}__________________________________________________________________________
6.0 Image Interpretability Rating Scale (IIRS)
RATING CATEGORY 0
Useless for interpretation due to cloud cover, poor resolution, etc.
RATING CATEGORY 1
Ground Resolved Distance: Greater than 9 meters (>29.5 ft.) (>354 inches).
RATING CATEGORY 2
Ground Resolved Distance: 4.5 to 9 meters (14.45 to 29.5 ft.) (177 to 354 inches)
RATING CATEGORY 3
Ground Resolved Distance: 2.5 to 4.45 meters (8.2 to 14.75 ft.) (98 to 177 inches)
RATING CATEGORY 4
Ground Resolved Distance: 1.2 to 2.5 meters (3.94 to 8.2 ft.) (47.25 to 98 inches)
RATING CATEGORY 5
Ground Resolved Distance: 0.75 to 1.2 meters (2.46 to 3.94 ft.). (29.53 to 47.25 inches
RATING CATEGORY 6
Ground Resolved Distance: 40 to 75 centimeters (1.31 to 2.46 ft.) (15.75 to 7.87 inches)
RATING CATEGORY 7
Ground Resolved Distance: 20 to 40 centimeters (0.66 to 1.31 ft.) (7.87 to 15.75 inches)
RATING CATEGORY 8
Ground Resolved Distance: 10 to 20 centimeters (0.33 to 0.66 ft.) (3.94 to 7.87 inches)
RATING CATEGORY 9
Ground Resolved Distance: less than 10 centimeters (<0.33 ft.) (<3.94 inches)
The following terms and definitions are used for the purpose of this Section 6.0.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS3952151 *Aug 13, 1973Apr 20, 1976Trw Inc.Method and apparatus for stabilized reproduction of remotely-sensed imagesUS4152725 *Nov 28, 1977May 1, 1979N.V. Optische Industrie "De Oude Delft"Distortion correcting apparatus for line-scanning systemUS4303945 *Mar 21, 1977Dec 1, 1981Westinghouse Electric Corp.Image motion compensation for a TV sensor systemUS4453087 *Jul 27, 1981Jun 5, 1984James LinickScanning mechanism for FLIR systemsUS4482902 *Aug 30, 1982Nov 13, 1984Harris CorporationResonant galvanometer scanner system employing precision linear pixel generationUS4630111 *Oct 30, 1984Dec 16, 1986Ferranti PlcImage distortion correction system for electro-optic sensorsUS5028998 *Feb 6, 1989Jul 2, 1991Honeywell Regelsysteme GmbhElectronic zoom for wide-angle line scannersUS5043924 *Sep 22, 1988Aug 27, 1991Messerschmitt-Bolkow-Blohm GmbhMethod and apparatus for scanning an objectEP0071531A1 *Jul 27, 1982Feb 9, 1983James LinickScanning mechanism for flir systemsGB2165120A * Title not available* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS5604534 *May 24, 1995Feb 18, 1997Omni Solutions International, Ltd.Direct digital airborne panoramic camera system and methodUS5668593 *Jun 7, 1995Sep 16, 1997Recon/Optical, Inc.Method and camera system for step frame reconnaissance with motion compensationUS6069654 *Feb 15, 1996May 30, 2000Lockheed Martin CorporationSystem and method for far-field determination of store position and attitude for separation and ballisticsUS6166373 *Jul 21, 1998Dec 26, 2000The Institute For Technology DevelopmentFocal plane scanner with reciprocating spatial windowUS6181271 *Aug 27, 1998Jan 30, 2001Kabushiki Kaisha ToshibaTarget locating system and approach guidance systemUS6462769Oct 16, 2000Oct 8, 2002Universal City Studios, Inc.Image correction method to compensate for point of view image distortionUS6618963 *Jun 14, 2002Sep 16, 2003Franz Plasser Bahnbaumaschinen-Industriegesellschaft M.B.H.Track maintenance machine and method for monitoring a track positionUS6687606Feb 21, 2002Feb 3, 2004Lockheed Martin CorporationArchitecture for automatic evaluation of team reconnaissance and surveillance plansUS6718261Feb 21, 2002Apr 6, 2004Lockheed Martin CorporationArchitecture for real-time maintenance of distributed mission plansUS6725152Feb 21, 2002Apr 20, 2004Lockheed Martin CorporationReal-time route and sensor planning system with variable mission objectivesUS6747686Oct 5, 2001Jun 8, 2004Recon/Optical, Inc.High aspect stereoscopic mode camera and methodUS6856380 *Jan 6, 2003Feb 15, 2005Chun-Shan Institute Of Science And TechnologyAerial vehicle speed error correlation method for two-dimensional visual reproduction of laser radar imagingUS6985810Jul 29, 2003Jan 10, 2006Lockheed Martin CorporationReal-time route and sensor planning system with variable mission objectivesUS7006124Sep 16, 2002Feb 28, 2006Yissum Research Development Company Of The Hebrew University Of JerusalemGeneralized panoramic mosaicUS7647232Jan 12, 2010Lockheed Martin CorporationReal-time team coordination system for reconnaissance and surveillance missionsUS7787659Aug 31, 2010Pictometry International Corp.Method and apparatus for capturing, geolocating and measuring oblique imagesUS7805227 *Dec 23, 2005Sep 28, 2010General Electric CompanyApparatus and method for locating assets within a rail yardUS7873238Aug 29, 2007Jan 18, 2011Pictometry International CorporationMosaic oblique images and methods of making and using sameUS7991226Oct 12, 2007Aug 2, 2011Pictometry International CorporationSystem and process for color-balancing a series of oblique imagesUS7995799Aug 9, 2011Pictometry International CorporationMethod and apparatus for capturing geolocating and measuring oblique imagesUS8385672Apr 30, 2008Feb 26, 2013Pictometry International Corp.System for detecting image abnormalitiesUS8401222May 22, 2009Mar 19, 2013Pictometry International Corp.System and process for roof measurement using aerial imageryUS8477190Jul 7, 2010Jul 2, 2013Pictometry International Corp.Real-time moving platform management systemUS8520079Feb 14, 2008Aug 27, 2013Pictometry International Corp.Event multiplexer for managing the capture of imagesUS8531472Dec 3, 2007Sep 10, 2013Pictometry International Corp.Systems and methods for rapid three-dimensional modeling with real fa�ade textureUS8588547Aug 5, 2008Nov 19, 2013Pictometry International Corp.Cut-line steering methods for forming a mosaic image of a geographical areaUS8593518Jan 31, 2008Nov 26, 2013Pictometry International Corp.Computer system for continuous oblique panningUS8610776Apr 7, 2006Dec 17, 2013ThalesSystem for target designation and/or illumination and for air reconnaissanceUS8823732Dec 17, 2010Sep 2, 2014Pictometry International Corp.Systems and methods for processing images with edge detection and snap-to featureUS8848033Jul 2, 2010Sep 30, 2014Puwell Technologies Co., Ltd.Regulating method for panoramic imaging, apparatus for the same, and panoramic imaging apparatusUS8860951 *Aug 12, 2011Oct 14, 2014Jena-Optronik GmbhMethod and apparatus for the radiometric measurement of object points on surfaces of astronomical bodiesUS8886484 *Aug 12, 2011Nov 11, 2014Jena-Optronik GmbhMethod and apparatus for the corrected radiometric measurement of object points on surfaces of astronomical bodiesUS9183538Mar 19, 2012Nov 10, 2015Pictometry International Corp.Method and system for quick square roof reportingUS9262818Jan 17, 2013Feb 16, 2016Pictometry International Corp.System for detecting image abnormalitiesUS9275080Mar 15, 2013Mar 1, 2016Pictometry International Corp.System and method for early access to captured imagesUS9275496Feb 27, 2015Mar 1, 2016Pictometry International Corp.Systems and methods for rapid three-dimensional modeling with real facade textureUS9292913Jan 31, 2014Mar 22, 2016Pictometry International Corp.Augmented three dimensional point collection of vertical structuresUS9330494Oct 26, 2009May 3, 2016Pictometry International Corp.Method for the automatic material classification and texture simulation for 3D modelsUS9437029Jan 10, 2014Sep 6, 2016Pictometry International Corp.Mosaic oblique images and methods of making and using sameUS9443305Mar 11, 2013Sep 13, 2016Pictometry International Corp.Method and apparatus for capturing, geolocating and measuring oblique imagesUS20070150130 *Dec 23, 2005Jun 28, 2007Welles Kenneth BApparatus and method for locating assets within a rail yardUS20080084475 *Apr 7, 2006Apr 10, 2008ThalesSystem for Target Designation and/or Illumination and for Air ReconnaissanceUS20080123994 *Aug 29, 2007May 29, 2008Stephen SchultzMosaic Oblique Images and Methods of Making and Using SameUS20080204570 *Feb 14, 2008Aug 28, 2008Stephen SchultzEvent Multiplexer For Managing The Capture of ImagesUS20080231700 *Jan 31, 2008Sep 25, 2008Stephen SchultzComputer System for Continuous Oblique PanningUS20080273753 *Apr 30, 2008Nov 6, 2008Frank GiuffridaSystem for Detecting Image AbnormalitiesUS20090096884 *Aug 6, 2008Apr 16, 2009Schultz Stephen LMethod and Apparatus for Capturing, Geolocating and Measuring Oblique ImagesUS20090097744 *Oct 12, 2007Apr 16, 2009Stephen SchultzSystem and Process for Color-Balancing a Series of Oblique ImagesUS20090141020 *Dec 3, 2007Jun 4, 2009Freund Joseph GSystems and methods for rapid three-dimensional modeling with real facade textureUS20100296693 *May 22, 2009Nov 25, 2010Thornberry Dale RSystem and process for roof measurement using aerial imageryUS20100302243 *Dec 2, 2010Schultz Stephen LMethod and apparatus for capturing geolocating and measuring oblique imagesUS20110096083 *Apr 28, 2011Stephen SchultzMethod for the automatic material classification and texture simulation for 3d modelsUS20120038933 *Aug 12, 2011Feb 16, 2012Pillukat AlexanderMethod and Apparatus for the Radiometric Measurement of Object Points on Surfaces of Astronomical BodiesUS20120041705 *Aug 12, 2011Feb 16, 2012Pillukat AlexanderMethod and Apparatus for the Corrected Radiometric Measurement of Object Points on Surfaces of Astronomical BodiesUS20140015956 *Aug 26, 2013Jan 16, 2014Omron CorporationImage processing device and image processing programUS20160073048 *Sep 9, 2014Mar 10, 2016The Boeing CompanyCoordinating image sensing with motionCN101930161BAug 28, 2009Jun 18, 2014杭州普维光电技术有限公司Method and device for adjusting panorama imaging as well as panorama imaging deviceWO1996038003A1 *May 13, 1996Nov 28, 1996Omni Solutions Inernational, Ltd.Direct digital airborne panoramic camera system and methodWO2006106150A2 *Apr 7, 2006Oct 12, 2006ThalesSystem for target designation and/or illumination and for air reconnaissanceWO2006106150A3 *Apr 7, 2006Apr 5, 2007Serge LarroqueSystem for target designation and/or illumination and for air reconnaissanceWO2011023038A1 *Jul 2, 2010Mar 3, 2011Puwell Technologies Co., Ltd.Regulating method for panoramic imaging, apparatus for the same, and panoramic imaging apparatus* Cited by examinerClassifications U.S. Classification701/466, 348/147, 348/144, 348/E03.051, 701/514International ClassificationH04N3/30Cooperative ClassificationG03B37/02, H04N3/30European ClassificationH04N3/30, G03B37/02Legal EventsDateCodeEventDescriptionDec 10, 1992ASAssignmentOwner name: LORAL FAIRCHILD CORPORATION, NEW YORKFree format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:WIGHT, RALPH H.;WOLFE, GREGORY J.;REEL/FRAME:006367/0092;SIGNING DATES FROM 19921117 TO 19921204Jun 25, 1996CCCertificate of correctionApr 19, 1999FPAYFee paymentYear of fee payment: 4Feb 25, 2003FPAYFee paymentYear of fee payment: 8May 18, 2005ASAssignmentOwner name: BAE SYSTEMS INFORMATION AND ELECTRONIC SYSTEMS INTFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LOCKHEED MARTIN CORPORATION;REEL/FRAME:016026/0348Effective date: 20001127Owner name: LC ACQUIRING CORP., NEW YORKFree format text: MERGER;ASSIGNOR:LOCKHEED MARTIN FAIRCHILD CORP.;REEL/FRAME:016026/0329Effective date: 19970617Owner name: LOCKHEED MARTIN CORPORATION, MARYLANDFree format text: MERGER;ASSIGNOR:LOCKHEED MARTIN TACTICAL SYSTEMS, INC.;REEL/FRAME:016026/0342Effective date: 19970627Owner name: LOCKHEED MARTIN FAIRCHILD CORP., MARYLANDFree format text: CHANGE OF NAME;ASSIGNOR:LORAL FAIRCHILD CORP.;REEL/FRAME:016026/0339Effective date: 19960429Owner name: LOCKHEED MARTIN TACTICAL SYSTEMS, INC., NEW YORKFree format text: MERGER;ASSIGNOR:LC ACQUIRING CORP.;REEL/FRAME:016026/0334Effective date: 19970627Jul 2, 2007FPAYFee paymentYear of fee payment: 12RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services