# Patent

## Title
Daytime stellar imager

## Abstract

An automatic celestial navigation system for navigating both night and day by observation of K-band or H-band infrared light from multiple stars. In a first set of preferred embodiments three relatively large aperture telescopes are rigidly mounted on a movable platform such as a ship or airplane with each telescope being directed at a substantially different portion of sky. Embodiments in this first set tend to be relatively large and heavy, such as about one cubic meter and about 60 pounds. In a second set of preferred embodiments one or more smaller aperture telescopes are pivotably mounted on a movable platform such as a ship, airplane or missile so that the telescope or telescopes can be pivoted to point toward specific regions of the sky. Embodiments of this second set are mechanically more complicated than those of the first set, but are much smaller and lighter and are especially useful for guidance of aircraft and missiles. Telescope optics focus (on to a pixel array of a sensor) H-band or K-band light from one or more stars in the field of view of each telescope. Each system also includes an inclinometer, an accurate timing device and a computer processor having access to catalogued infrared star charts. The processor for each system is programmed with special algorithms to use image data from the infrared sensors, inclination information from the inclinometer, time information from the timing device and the catalogued star charts information to determine positions of the platform. Direction information from two stars is needed for locating the platform with respect to the celestial sphere. The computer is also preferably programmed to use this celestial position information to calculate latitude and longitude which may be displayed on a display device such as a monitor or used by a guidance control system. These embodiments are jam proof and insensitive to radio frequency interference. These systems provide efficient alternatives to GPS when GPS is unavailable and can be used for periodic augmentation of inertial navigation systems.

## Background
This application claims the benefit of Provisional Application Ser. No. 60/619,858, filed Oct. 18, 2004 and is a Continuation In Part of Utility Application Ser. No. 11/106,744 filed Apr. 15, 2005.


FIELD OF INVENTION
This invention relates to stellar imaging systems and in particular to such systems useful for position location and platform attitude determination.
BACKGROUND OF THE INVENTION
Global positioning systems (GPS) are widely used for navigating ships and aircraft. However, these systems are vulnerable and have other shortcomings. Their space components are subject to hostile attack and the systems may be jammed. The systems also suffer from reliability failures and these GPS systems do not provide absolute azimuth positioning needed for attitude determination. Inertial navigation systems (INS) mitigate GPS deficiencies; however, these inertial navigation systems are not accurate over long time periods. Errors may accumulate at rates of about an arc-seconds per hour to an arc-minutes per hour. Periodic alignment of the inertial navigation systems is required using an external reference system such as a GPS system.
For centuries navigators have used the sky for the most fundamental and accurate inertial system available, in which each star is a benchmark. Cataloged positions and motions of the stars define the celestial reference frame. The problem is stars are hard to see during the daytime. Efforts have been made to navigate by stars during daytime using very sensitive visible light charge couple device (CCD) cameras, but these efforts as far as we know, have been unsuccessful due to the very limited number of stars that can be seen with this sensor.
A need exists for a backup to GPS systems and an absolute azimuth reference for fast alignment of INS systems.
SUMMARY OF THE INVENTION
The present invention provides an automatic celestial navigation system for navigating both night and day by observation of K-band or H-band infrared light from multiple stars. In a first set of preferred embodiments three relatively large aperture telescopes are rigidly mounted on a movable platform such as a ship or aircraft with each telescope being directed at a substantially different portion of sky. Embodiments in this first set tend to be relatively large and heavy, such as about one cubic meter and about 60 pounds. In a second set of preferred embodiments one or more smaller aperture telescopes are pivotably mounted on a movable platform such as a ship, airplane or missile so that the telescope or telescopes can be pivoted to point toward specific regions of the sky. Embodiments of this second set are mechanically more complicated than those of the first set, but are much smaller and lighter and are especially useful for guidance of aircraft and missiles. Telescope optics focus (on to a pixel array of a sensor) H-band or K-band light from one or more stars in the field of view of each telescope. Each system also includes an inclinometer, an accurate timing device and a computer processor having access to cataloged infrared star charts. The processor for each system is programmed with special algorithms to use image data from the infrared sensors, inclination information from the inclinometer, time information from the timing device and the cataloged star charts information to determine position of the platform. Direction information from two stars is needed for locating the platform with respect to the celestial sphere. The computer is also preferably programmed to use this celestial position information to calculate latitude and longitude which may be displayed on a display device such as a monitor. These embodiments are jam proof and insensitive to radio frequency interference. Also these embodiments work in those areas with poor GPS coverage or where GPS is not available at all. These systems provide efficient alternatives to GPS when GPS is unavailable and can be used for periodic augmentation of inertial navigation systems. These systems also provide absolute azimuth measurements for platform attitude determination. The invention is based upon Applicants' discovery that, at infrared wavelengths, a large number of stars (at positions offset by more than about 30 to 80 degrees from the sun) “out-shine” the sky background even at mid-day.
Preferred embodiments of the present invention operate autonomously during daytime and nighttime, utilize observations of stars, and in combination with an inertial navigation system, provide a secondary means, independent of radios and GPS, for navigation of aircrafts and ships. Preferred processor software includes a background subtraction and a special signal to noise enhancement algorithm, star pattern recognition software, software for mapping of star direction, and an algorithm for computation of the lines of positions, celestial fix, and latitude and longitude. Preferred software also includes instrument-control code.
The combination of the present invention with an inertial navigation system is a synergistic match. The accuracy of the inertial navigation system degrades with time from initial alignment, while the celestial fix accuracy is not time dependent. The inertial navigation systems are oblivious to bad weather, whereas a celestial fix is sensitive to cloud conditions. Both the inertial navigation systems and systems of the present invention are passive, jam-proof, and do not depend on shore or space components. If a run of bad weather interferes with star sights, the inertial navigation system serves as a bad-weather “flywheel” that essentially carries the stellar fix forward until new observations can be obtained. Thus, a combination of the inertial navigation system and the present invention will provide an independent alternative to radios and GPS.
Systems designed by Applicants include very efficient optical sensors, which increase the probability of detecting stars during daytime by several orders of magnitude, as compared with a prior art approach based on CCD cameras operating at visible wavelengths. The latter is due to several factors including:

    
    
        a) The number of infrared sources exceeds the number of stars in the visible waveband,
        b) The daytime sky background is by a factor of 6-18 lower in the infrared wavebands than in the visible waveband, and
        c) The full well capacity of selected infrared sensors is more than one order of magnitude higher than that for comparable visible sensors.
    
    


Additional advantages of this design approach are associated with the fact that atmospheric obscurants including haze and smoke affect infrared sensors less than sensors operating in the visible waveband, and the effect of daytime turbulence on the infrared sensor is lower.
In each embodiment of the first set of preferred embodiments each of three telescopes are mounted on a moving ship and views a 0.5×0.4 degree region of the sky for H-band starlight. Located stars, usually those with brightness greater than 6.4 H-band magnitude, are then compared with star positions from the star catalog within a selected 5×5 degree region of the sky. A correlation of the data from at least two of the three telescopic measurements determines the position of the platform to a precision of 30 meters. The computer uses this position and the speed of the ship or aircraft, direction and attitude (pitch and roll) to establish the 5×5 degree region for the next correlation. Applicants have determined that there are an average of about 300 to 400 daytime visible infrared stars in these 5×5 degree regions of the Milky Way portion of the sky and an average of about 30 to 40 visible infrared stars in the 5×5 degree regions in other portions of the sky. Embodiments in this first set of embodiments have no moving parts and use automatic star detection and star pattern recognition algorithms. These preferred embodiments utilize three infrared telescopes imaging simultaneously three small areas of the sky, about 45 degrees in elevation with each telescope separated from the others by 120 degrees in azimuth. System software detects and identifies stars and calculates three crossing lines of position and a latitude/longitude celestial fix. Ship or aircraft positions may be up-dated every 5 to 10 minutes with position errors of less than 30 meters.
Embodiments of the second set of preferred embodiments utilize telescopes with aperture diameter to less than 10 cm to provide much smaller and lighter systems. For example, with an aperture diameter of 5 cm, the dimensions of the system can be reduced to less than 20 cm×15 cm×12 cm. Such a system will fit applications of navigating missiles and aircraft. However, reduction of the telescope aperture diameter will reduce the number of received star photons and the signal-to-noise ratio (SNR). This will reduce the star detection limit, or star-limited magnitude. In addition, in order to avoid star image blur due to aircraft or missile motion and vibration, camera exposures on the order of a few milliseconds should be used. If the camera exposure is reduced to a few milliseconds, then once again the SNR is reduced. Applicants utilize two techniques to compensate for the above SNR losses caused by reduction of the telescope aperture diameter and camera exposure time. The first technique is to increase the star brightness by pointing a telescope to selected bright infrared stars. In preferred embodiments Applicants use a two-axis precision rotary stage to point one or more telescopes at selected bright stars. In these preferred embodiments Applicants limit the size of search windows to be equal, or less, than the 15°×15° square area angular distance over which the selected commercially available rotary stage maintains a one arc-second absolute accuracy or less. This provides an optical scan of up to 30°×30° when used with a reflecting mirror. The second approach is to utilize infrared cameras with reduced readout camera noise. Applicants have determined that for short camera exposures, the SNR is limited by the camera readout noise rather than the sky background noise. In some preferred embodiments an “all sky” CCD camera views the entire sky so that on “partly cloudy days the telescope can be quickly pointed to a cloudless region of the sky.



BRIEF DESCRIPTION OF THE DRAWINGS
FIGS. 1A(1) and 1A(2) show a first preferred embodiment of the present invention.
FIG. 1B shows a second preferred embodiment of the present invention.
FIG. 1C shows a third preferred embodiment of the present invention.
FIG. 2A is a graph showing transmission through the atmosphere of light over a range of wavelengths.
FIGS. 2C(1), 2C(2) and 2C(3) show probabilities of detecting stars.
FIG. 3 shows sky scatter at three wavelength ranges.
FIGS. 4A and 4B describe a telescope.
FIGS. 5A and 5B show a second three-telescope telescope design.
FIG. 6 shows probability of detecting stars as a function of search time.
FIGS. 7A and 7B show correlation of star image data with a star chart.
FIG. 8 is a block diagram showing elements of a preferred embodiment of the present invention.
FIG. 9 describes elements of a preferred algorithm for navigating by starlight.
FIG. 10 is an example of starlight images.
FIG. 11 is a graph indicating the number of stars in the entire sky at star magnitudes between 0 and 7.
FIG. 12 shows a plot of Applicants' measurements of star data as compared to catalog data.
FIG. 13 shows Applicants' measurements of solar background compared to predictions.
FIG. 14 shows SNR data for a 10 cm diameter aperture telescope.
FIGS. 15 and 16 show similar data for 7.5 cm and 5 cm telescopes.
FIG. 17 shows an optical layout for a preferred single telescope embodiment.
FIG. 18 shows an optical layout for a preferred two telescope embodiment.
FIG. 19 shows a layout for an “all sky” embodiment.



DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
Rigidly Mounted Embodiments (No Moving Parts)
A first preferred embodiment of the present invention is shown in FIGS. 1A(1) and 1A(2). This is a stellar imaging system useful for day and night accurate stellar navigation for ships. The system is a “strap down” system (i.e., it is mounted or “strapped down” on a platform, in this case a ship) with no moving parts. Three telescopes, separated by 120 degrees in azimuth and directed at 45 degrees in elevation, provide images of stars on three infrared 256×320 pixel cameras designed for operation in the infrared waveband at about 1.6 micron wavelength. The instantaneous field of view of each camera is 0.4×0.5 degrees, which provides a very high probability of imaging stars that are recognized by a computer system programmed with special algorithms, a star catalog, and star pattern recognition software. The camera is a fast frame rate camera operating at frame rates up to 30 Hz with a full well capacity of 5 million electrons, with thermoelectric cooling.
A second preferred embodiment is shown in FIG. 1B. This embodiment is similar to the ship version but is designed for aircraft day and night navigation. In this embodiment a fewer pixel camera is used providing shorter exposure times to prevent blurring due to faster aircraft motion
The third preferred embodiment is shown in FIG. 1C. This embodiment uses a single telescope to provide accurate azimuth reference for at-sea inertial navigation system calibration for attitude determination.
Many more details on the features of these embodiments are provided in the section below that discusses Applicant's research and these specific features and design choices made by Applicants.
Applicants Spectral Investigations and Selection
Almost all celestial navigation at sea level using starlight has in the past been at night with observations at visible wavelengths. During the day, sunlight scattered in the earth's atmosphere produces background illumination that makes detection of starlight difficult. Also, strong daytime sky background quickly fills small electron collection “wells” of visible sensors, thus limiting the aperture diameter and/or exposure time. As a consequence, visible sensors have small signal to noise ratios and poorer overall sensor performance.
Atmospheric transmittance at wavelengths between about 0.2 microns to about 3.2 microns is shown in FIG. 2A. Applicants have evaluated and compared the performance of three candidate sensor systems: one operating in the red portion of the visible spectrum (I-band, 0.8 micron wavelength, indicated at 2 in FIG. 2A) and two near-infrared spectral bands (H-band, 1.6 microns wavelength, indicated at 4 in FIG. 2A and K-band 2.2 microns wavelength, indicated at 6 in FIG. 2A).
The analysis included several analytic studies:

    
    
        1) Examination of star statistics,
        2) Evaluation of the atmospheric transmittance and daytime sky background in three spectral wavebands;
        3) Evaluation of the effects of atmospheric turbulence, and atmospheric obscurants on three candidate sensor systems;
        4) Development of a novel star detection algorithm,
        5) Testing of the developed algorithm using simulated and field data;
        6) Evaluation of commercially available electronic and optical components and
        7) A trade-off study to select the best design approach.
    
    


Applicants characterized the overall sensor performance by the probability of detection of a given number of stars within the field-of-view of each telescope. They found that the probability of detecting stars at daytime with infrared sensors is much higher than that with a visible sensor. They determined, therefore, the infrared sensors operating at 1.6 microns or 2.2 microns are the best candidate systems for the hardware prototype.
Star Statistics
Applicants evaluated the star statistics in the visible I-band by using the Catalog of Positions for Infrared Stellar Sources and in the H-band and K-band by using the 2-Micron All Sky Survey catalog. Both of these catalogs are well known and are available on the Internet. They found that the number of stars in the infrared wavebands at similar intensity levels is an order of magnitude greater than the number of stars in the visible waveband. As an example, FIGS. 2C(1), (2) and (3) show the probability of detecting at least 1, 2 or 3 stars within a field of view of 1 degree versus star magnitude in the three spectral wavebands. For all star magnitudes the probability of detecting stars in the infrared wavebands is about an order of magnitude higher than in the visible waveband. This defines the first principal advantage of the infrared sensor.
Atmospheric Transmission and Sky Background
Using a MODTRAN3 computer model available from M. E. Thomas & L. D. Duncan, which is described in “Atmospheric Transmission”, in Atmospheric Propagation of Radiation, F. G. Smith, ed, Vol-2 of The Infrared and Electro-Optical Systems Handbook, J. S. Accetta & D. L. Shumaker, eds, ERIM, Ann Arbor, Mich., and SPIE Press, Bellingham, Wash. (1993), and MODTRAN & FASCOD references cited therein,
Applicants evaluated the atmospheric transmission and daylight sky background in three candidate spectral wavebands (1.6 micron-0.25 micron bandwidth, 2.2 micron-0.2 micron bandwidth and 0.8 micron-0.1 micron bandwidth). The total atmospheric transmission in the infrared wavebands is 20 to 30 percent higher than the visible. Sky background radiation based on Applicants' calculations is shown in FIG. 3. The sky background radiation at potential wavelength ranges is plotted versus angular distance between the sun and the detector pointing direction for two atmospheric conditions (23 kilometers visibility and 10 kilometers visibility). They found that the daylight sky radiance in the infrared wavebands is significantly lower than that in the visible waveband. The sky radiance in the H-band and K-band is lower by a factor of 6 and 18, respectively, than that in the I-band. In addition, the average atmospheric transmittance in the infrared wavebands is higher and effects of atmospheric obscurants including haze, smoke, and clouds that can attenuate starlight is also lower in the infrared waveband than that in the visible. Thus, in the IR waveband there is less atmospheric scattering and higher transmission. This provides the second principal advantage of the infrared sensor. Total sea-level transmission through the atmosphere as a function of wavelength is shown in FIG. 2A.
Daytime Sea Level Turbulence
The effect of daytime sea-level turbulence on the infrared sensor is lower than that in the visible waveband. In particular, turbulence-induced scintillation at daytime can cause strong signal fades at the detector and thus degrade the performance of the visible sensor. The scintillation index, or normalized log amplitude variance, that characterizes the effect of turbulence on the star image brightness is reduced by a factor of 2.2 and 3.2 in H-band and K-band, as compared to I-band. Consequently, the effect of scintillation on an infrared sensor is expected to be small. Also the atmospheric coherence diameter, or Fried parameter, that characterizes turbulence-induced image blur, is increased by a factor of 2.3 and 3.4 in H-band and K-band, as compared to I-band. This defines the third advantage of the infrared sensor.
Full Well Camera Capacity
The fourth principal advantage of the infrared sensors is associated with the fact that the infrared cameras typically have a large full well capacity. The full well capacity of the infrared sensors exceeds the value for the CCD visible sensors by more than one order of magnitude (5 to 20 million electrons in the infrared waveband vs 0.1 million electrons in the I-band). A large full well capacity is extremely important for daytime operations. It allows Applicants to increase the signal to noise ratio for the infrared sensors by increasing the aperture diameter (up to 20 cm) and/or integration time to successfully detect stars in the presence of a strong sky background. Conversely, the small full well capacity of the visible sensor limits the aperture diameter and the total exposure and thus limits the signal to noise ratio, star detection limit, and probability of detecting stars. Large full well capacity is the fourth advantage of the infrared sensor.
Camera Frame Rate
The infrared sensors have much higher full frame rate, than visible sensors. Due to large pixel count (4096×4096 pixels) required to image a large field of view, the frame readout period is 3.5 sec in the visible, while it is typically 30 msec in the infrared waveband. This allows Applicants to increase the signal to noise ratio by averaging multiple frames. The accuracy of the image centroid calculations is determined by the image spot diameter Dstar and the signal to noise ratio.




  σ
  =
  
    
      
        3
        ⁢
        π
      
      16
    
    ⁢
    
      
        D
        star
      
      SNR
    
  




The signal to noise ratio is given by




  
    SNR
    =
    
      
        N
        S
      
      
        
          
            N
            S
          
          +
          
            4
            ⁢
            
              (
              
                
                  n
                  B
                
                +
                
                  n
                  D
                
                +
                
                  n
                  e
                  2
                
              
              )
            
          
        
      
    
  
  ,




where Ns is the total number of signal photoelectrons detected in a frame (assuming within an area of 4 pixels and that the spot size full width at half maximum is approximately 1 pixel), nB is the number of sky background photoelectrons detected per pixel, nD is the number of dark current electrons per pixel, and ne is the number of read noise electrons per pixel.

Averaging of multiple data frames by using a shift-and-add technique provided an additional way to increase the signal to noise ratio. The signal to noise increases proportionally to √{square root over (N)}, where N is the number of averaged frames. An implementation of this technique with the infrared sensors is straightforward because the frame rate for the IR cameras is approximately 5 to 30 Hz, depending on the exposure time. This provides the fifth advantage of operating in the infrared spectrum.
H-Band and K-Band are the Spectral Ranges of Choice
The above performance analysis revealed that the infrared sensor, as compared to the visible sensors, have a much higher probability of detecting stars. In particular, in a clear atmosphere for optimal aperture diameter and optimal angular pixel size the star detection limit for the I-band sensor is magnitude 3.3, whereas for the H-band and K-band sensors it is 6.8 and 5.8, respectively. The optimum field of view of the I-band sensor is 7×7 degrees, whereas the optimum field of view of the H-band and K-band sensors is 0.86×0.86 degrees and 1.3×1.3 degrees. For given sensor parameters, Applicants found that the probability of detecting at least 1 star with a 4096×4096 pixel I-band sensor is 0.18, whereas the probability of detecting at least 2 stars is 0.03. Under the same conditions, using a 512×512 pixel H-band sensor, the probability of detecting at least 1 star is 0.86 and probability of detecting at least 2 stars is 0.62. The number of infrared sources (H-band or K-band) of magnitude 7 is about 350, 000 in the entire sky, whereas the number of I-band stars of magnitude 3.3 in the sky is only about 300. Thus, the probability of detecting stars using infrared sensor is higher than using the sensor operating in the visible waveband. Therefore, in sense of performance and utility for the surface fleet and aircraft navigation, the infrared sensors have greater value than the visible sensors.
Each of the three telescopes scan a region of the sky and the region grows with time. (The sky appears to rotate 1.25 degrees each five minutes.) FIG. 6 shows probability of detecting of at least 1, 2 and more stars in a 1×1 degree field of view with an infrared sensor that has star detection limit of 6.4 magnitude. The probability of detecting stars is shown versus observation time. The probability of detecting at least 1 star in the field of view exceeds 90% for the observation time of 5 minutes. For comparison, a strap-down system operating in the visible waveband and having field of view of 7×7 degrees and star detection limit of 3.3 magnitude will require 4-6 hours to detect at least one star.
In summary, Applicants' trade-off study revealed that the infrared sensor has an inherent advantage, based on the laws of physics, over the prior art visible sensor in probability of detecting stars.
Daylight Stellar Imager Sensor Optimization
Applicants' trade-off studies included a comparison of the H-band and K-band sensors in terms of detector format, cost, and cooling requirements. Applicants found that the H-band (InGaAs) sensor from Sensors Unlimited, which operates in the 0.9 -1.7 micron spectral band, has sensor performance somewhat (but not much) better than to the K-band in terms of star detection probabilities, but this H-band sensor has several more important advantages over the K-band sensor. First, it is less expensive ($25K for a 320×256 InGaAs array from Sensors Unlimited versus $120K for a 256×256 HgCdTe sensor from Rockwell). Second, it requires only TE cooling to obtain low dark current levels for low noise performance and does not use liquid nitrogen. Third, its full well capacity of 5 million electrons is greater than the full well capacity of K-band sensors considered. For these reasons, the Sensors Unlimited Minicamera 320×256 pixels camera was selected for the hardware prototype of Applicants' first preferred system.
Applicants also determined the optimal number of fields of view to be simultaneously viewed, optimal sensor pixel size, and the field of view angular size. We found that the optimal pixel size in the H-band is approximately 6 arc-sec. Regarding the number of fields of view, Applicants considered two options:

    
    
        a) using one field of view and taking sequential stellar measurements at different areas of the sky, or
        b) using 3 fields of view and three cameras and doing simultaneous measurements.
    
    


Due to the effects of vibration and ship/aircraft motion on the line-of-sight between sequential stellar measurements, Applicants determined that simultaneous measurements with three fields of view are preferred for a hardware prototype. Each field of view is 0.4×0.5 degree.
Single Aperture Daylight Stellar Imager Opto-Mechanical Design
A single aperture telescope was constructed and star observations were performed at sea level at daytime. Images of known stars were taken and stored for post-processing to determine photon flux levels in the K-band or minimum detectable stellar magnitudes. Multiple data sets were collected for various atmospheric transmittance and angular distance from the sun.
FIG. 10 shows one example of the daytime K-band detection of stars with brightness values ranging from about 6.3 to 1.8 at an angular distance of 100 degrees from the sun. Seven stars are detected in the field of view of 0.4×0.5 degrees. These measurements confirm that minimum detectable stellar magnitude for the K-band sensor at daytime is about 6.4 to 6.9.
Multi-Aperture Daylight Stellar Imager Optical-Mechanical Design
A first preferred embodiment is a device which can autonomously determine its geographical position with a horizontal position error of less than 30 meters both day and night purely from observations of stars and deliver a latitude/longitude fix every 5 minutes. This embodiment is shown in FIGS. 4A and 4B. It is a prototype designed as a multi-aperture, strap down system without moving parts. The multi-aperture optical-mechanical design is a direct extension of the single aperture design. The same 20 cm telescope system and three infrared cameras are used. Each of the three apertures are mounted to a Holtzen parallelpiped, providing a line-of-sight that is at the same zenith angle of 45 degrees (from the horizon) with a 120 degrees offset in azimuth between each of the three apertures. The use of three independent apertures allows for both increased positional accuracy due to the ability to triangulate the measurements and redundancy in case one of the apertures line of sight is close to the sun. The structural support of the optics can be a simple aluminum or fiberglass tube, but carbon fiber composites may be desired for better thermal performance. The tube extensions (beyond the first optical element) act as sun baffles. The performance of the system is maintained so long as direct sunlight does not scatter into the telescope. An even longer baffle would allow operation slightly closer to the sun, but the 30 degree baffle shown is adequate under most circumstances. FIG. 4B shows the optical components of one of the three telescopes. As shown in FIG. 4A the optical axes of three telescopes are intersected to minimize the system foot print and total dimensions. The cameras are fastened to the telescope structure normal to the optical axis as indicated at 10 in FIG. 4B. A triangular frame at the bottom as shown at 12 in FIG. 4A provides structure rigidity. The entire assembly is meant to have the same low expansion coefficient, so if the entire structure is shaded from direct sunlight and if the structure remains isothermal, then the angle between the telescopes should remain fixed. The total weight of this strap down assembly is about 120 to 140 pounds.
Platform Attitude Determination
Star measurements with a single telescope can provide absolute azimuth reference for platform attitude determination. Once a star in the field view is detected and identified, a corresponding line of sight is accurately known. A projection of this line of sight on the horizontal plane defined as cos(star azimuth angle) provides an absolute azimuth reference. A sensor system with three telescopes provides three independent azimuth references that can be averaged together to reduce the measurement noise. Platform attitude determination does not require measurement of a local vertical with an inclinometer.
Analysis and Algorithm Development
To further improve the sensor performance and reduce the star detection limit, Applicants developed a robust image processing algorithm. This algorithm allows Applicants to accurately determine star position in the imagery data recorded in the presence of a strong sky background and having low contrast and low signal to noise ratio. The basic concept is the following. The algorithm uses the fact that the pixels which include the star image are illuminated with spatially correlated light (photons all coming from the same source, a single star), whereas pixels that are illuminated with only sky background are illuminated with spatially uncorrelated light (randomly scattered photons from the sun). Therefore, if the signals in the neighboring pixels are summed up, pixels with the star image and the noisy pixels will have different gain, and thus can be distinguished. If Np pixels are summed up, then the signal level in the super-pixel with the star light will increase proportionally to, Np, whereas the signal level in the super-pixel that include noise increases proportional to √{square root over (Np)}. Thus, the signal to noise ratio increases by a factor of √{square root over (Np)}. Similarly, when N image frames are summed up, the signal to noise ratio increases by a factor of √{square root over (N)}.
The image processing algorithm includes two stages: a) background subtraction and noise reduction stage and b) star detection and centroid determination stage. For Applicants' prototype unit, each data frame is time stamped using a time reference instrument provided by Inter-Range Instrumentation Group (IRIG) and an off-the-shelf personal computer interface card. The IRIG system relies on GPS for time determination but has an AM radio backup in the case GPS is not available. The time is accurate to within 1 microsecond, which is very small compared to preferred timing requirement of 10 milliseconds (corresponding to 5 meters in platform position error). Since it is important for many applications that the system be independent of GPS, Applicants will replace the IRIG time base with an alternate clock source which is independent of GPS. Atomic clocks are standard equipment on many ships could provide the alternate clock with sufficient accuracy. These alternate timing sources can be reset with GPS or radio when the reset sources become available.
The image processing algorithm includes the following steps:

    
    
        1. Median value subtraction. This step reduces the fixed pattern camera noise. Consider the data set that consists of 20 frames. First, using 20 data frames that precede the first frame in the data set, the median data is calculated to for each pixel. Then, the median frame of pixels is subtracted from each frame in the data set, pixel by pixel.
        2. Next, to reduce noise, five sequential data frames in the data set are blindly summed up. This typically spreads star illumination over a few pixels.
        3. Then a “super pixeled” image is created by down sampling the image generated in step 2 at the rate of 1:4 (i.e., four adjacent pixels are summed across the pixel array)
        4. Determine the brightest super pixel in the first frame from step 1 and create a small (9×9 regular pixel size) window about the brightest super-pixel location (81 pixels with the brightest 4×4 in the middle).
        5. To increase the centroid accuracy, up sample the image within the window at the rate 10:1 using cubic spline fit algorithm. (The computer produces a digital array of 90×90 [8100] virtual pixels and fits them with the cubic spline fit algorithm into a Gaussian-like shape.)
        6. Calculate the intensity weighted centroid. Under this step an expected star location in the first data frame is determined.
        7. Repeat steps 5-6 for each subsequent data frame in the data set.
        8. Once an expected star location in all subsequent data frames are determined, shift all 20 frames to the star position in the first frame, and sum up all frames. This step produces the final image for star detection within the 9×9 pixels window. The extent of the shift is based on the location of the centroid.
        9. Once an expected star location in all subsequent data frames are determined, shift all 20 frames to the star position in the first frame, and sum up all frames, The final image for the entire frame is based on the shifts obtained from the 9×9 pixel centroiding window. The extent of the shift is based on the location of the centroid.
        10. Create a “super pixel” representation of the shifted and added frame obtained from step 8 by down sampling at the rate of 1:4 (i.e., four adjacent pixels are summed across the pixel array). Determine brightest super pixel and create a small (9×9 regular pixel size) window about that location.
        11. Up sample the image within the small 9×9 pixel window with a ratio of 10:1 by using cubic spline fit algorithm. Remove background by chopping at noise ceiling, calculate intensity weighted centroid position as well as total intensity in the image. Make an estimation of the rms noise by taking the standard deviation σ of all pixels [other than pixels illuminated by bright stellar objects] in the entire image frame. Remove the data within the small window in order to search for the next dimmest star. Repeat steps 9 and 10 until all potential stellar objects within the frame are found.
        12. For each potential star location, the pixel SNR is calculated:
    
    






  
    SNR
    =
    
      
        
          I
          S
        
        -
        
          〈
          I
          〉
        
      
      σ
    
  
  ,




    
    
        
        
            where Is is the total signal intensity divided by number of pixels in the image, <I> is the mean intensity in the image, and σ is the rms noise. If the SNR≧10, then the star is detected. The star coordinates are determined by intensity weighted centroid calculated in step 11. If SNR<10, then this potential star location is rejected and treated as a noise.
        
        
        13. The star coordinates alone with the star intensity calculated in step 11 are used further by automated star pattern recognition algorithm. Also the coordinates of the brightest star in the field of view are used in calculations of the latitude/longitude celestial fix and absolute azimuth determination.
    
    


The above algorithm was tested on both simulated data and field data. Applicants found that the algorithm allows us to detect 6.4 magnitude stars in the imagery data recorded at sea level at daytime. They also found that the measured distances between stars agree with their catalog values to the accuracy of 0.5 arc-seconds.
Star Catalog Development
Stellar identification and celestial latitude/longitude fix calculations require the infrared star catalog that includes accurate star positions, motions, and magnitudes (apparent brightness). Researchers from US Naval Observatory based on the 2MASS catalog and other sources available provided the IR star catalog that includes about 350,000 stars down to 7th magnitude. The H band magnitude corresponds to the 1.6 μm waveband where the camera is sensitive. Only objects brighter than or equal to the 7th magnitude were included in order to limit the disk space required to store the data.
Automated Star Pattern Recognition Algorithm
Using star positions and star relative brightness alone with the triangle patterns, the stars in each field-of-view are identified using reference catalog of positions and relative brightnesses, which is a subset of the infrared catalog. The reference star catalog currently covers the entire sky with 350,000 stars visible in the infrared. The field of view of each of the three telescopes is an area of the sky of 5×5 degrees centered about the pointing direction for each telescope determined based on the inclinometer measurements of the local horizon, and the angular separation of the three fields. When looking at the Milky Way the number of stars in the 5×5 field is about 300 to 400 and in regions of the sky other than the Milky Way the number of stars is about 30 to 40. In another embodiment the fields of view are increased to 10×10 degrees. All star catalog positions are corrected to the current epoch and corrected for proper motion. The distances between all star pairs in the reference catalog are calculated.
After that the measured distances between all star pairs detected in the field of view are calculated. The stars detected within the field of view are listed in descending order, where the brightest stars are listed first. The first star pair would represent the brightest two stars. Position of each star is corrected for atmospheric effects and stellar aberration. Then the distances between all star pairs are calculated. Next the measured distances between stars are compared with the distances from the reference catalog. In order to accommodate the centroid measurement errors and effects of turbulence of a star image, a 5 arc-seconds error is allowed.
In addition to the distances, each observed pair of stars also include a ratio of the relative intensities. The measurements performed by the Applicants revealed that individual star measurements fit the curve




  
    
      
        
          
            M
            2
          
          -
          
            M
            1
          
        
        =
        
          0.4
          *
          
            
              log
              10
            
            ⁡
            
              (
              
                
                  I
                  1
                
                
                  I
                  2
                
              
              )
            
          
        
      
    
    
      
        (
        1
        )
      
    
  




with an error of 0.5 star magnitude. Here M1 and M2 are the star magnitudes from infrared catalog, and I1 and I2 are the measured star intensities.

By using these two criteria, only the star pair, which matches the catalog distance within the accuracy of 5 arc-sec, and also their measured relative intensities match the ratio of the catalog intensities within the error of 0.5 star magnitude are accepted. If there are more than two stars in the field of view, then once the pair 1-2 is correctly identified, the search for each subsequent star's distance as related to star one and two, i.e. 1-3, 2-3, 1-4, 2-4, etc, is performed. The major change in the identification of these stars is the use of an additional conditional statement that includes a triangle pattern.
Each subsequent pair must include either star one or star two, otherwise this star is rejected. This creates a form of a triangle pattern, where stars one and two present two of the three points. The third point in each triangle is the next star in question. This algorithm was successfully tested on the field data recorded at both day and night. FIGS. 7A and 7B show one example of the stars identified from the field data recorded at daytime (FIG. 7B) and compared with the star map (FIG. 7A) from the infrared catalog. Six stars having brightnesses varying from 3.4 to 6.6 magnitude are detected and identified. The 7th star in the field of view that has a brightness of 7th magnitude was not easily detected. Finally, if a single star is detected in the field of view, then the algorithm will use the relative magnitudes and positions of stars in all three fields for star identification.
Sensor Software and Electronics
A simple block diagram of the electronics is shown in FIG. 8. All of the components are controlled by software written on a standard personal computer 40. The interface to the camera 41 is achieved using a frame grabber board (not shown) on the personnal computer interface bus with off-the-shelf software drivers provided by Sensors Unlimited. Each frame is time stamped. A commercial inclinometer 46, currently base lined as a unit from Jewel Instruments, is used to provide the local horizon measurement necessary to determine the elevation angle of the detected stars. The inclinometer provides a pair of analog voltages proportional to the tilt in each of two axes. The tilt meter output is digitized by an off the shelf analog to digital converter 48 synchronized to the camera frame acquisition. The analog to digital converter is also used to digitize the output of an off-the-shelf Meteorological Station system. The temperature and pressure are preferably used to correct the stellar position measurements for atmospheric refraction. For elevation angles (greater than 10 degrees), the atmospheric refraction is a function only of the local index of refraction which can be predicted accurately knowing only the wavelength of light, and the temperature and pressure.
All software runs on standard personal computer 40. As a baseline the software is written in C++. A flow chart of the software to operate the camera, to process the frames, and to determine the longitude/latitude celestial fix is shown in FIG. 9. A single exposure from the camera is transferred from the frame grabber board to the personal computer using software drivers, and is time stamped from the IRIG time base. Using the image processing algorithm described above, the stars in each field of view are detected. The stellar positions within each field are then corrected for atmospheric refraction. Then using the stellar positions and relative brightness along with the triangular patterns the stars are identified.
After that longitude and latitude celestial fix is determined using the measured stars elevations from at least two of the three fields. Applicants use all three when they are available. When several stars are detected within the field of view, the elevation of the brightest star is used in position fix calculations. The fix calculations are performed using the engine from the STELLA software developed at the US Naval Observatory. (J. A. Bangert, “Set Your Sights on STELLA: New Celestial Navigation Software from US Naval Observatory, Chips, Vol. 14, No. 5, pp 5-7 (1996). This software calculates both celestial positions and latitude and longitude for the platform, as well as the platform speed and direction.
The Use of the Stellar Measurements
The obtained celestial position fix provides a back up for GPS, when the GPS is not available. In addition, it will provide periodic alignments for the inertial navigation system to correct for the drifts and latitude bias. In preferred applications the present invention is integrated with the inertial navigation system. This helps to mitigate an impact of a cloud cover on the performance of the present invention. If bad weather separates star sights, the inertial navigation system will carry the stellar fix forward until new observations can be obtained. Finally, each star measurement provides an absolute azimuth needed for platform attitude determination.
Kalman Filter
Kalman filtering is a preferred method for estimating, or updating the previous estimate of a system's state by: (1) using indirect measurements of the state variables, and (2) using the covariance information of both the state variables and the indirect measurements. The basic idea is to use information about how measurements of a particular aspect of a system are correlated to the actual state of the system. The Kalman filter estimates a process by using feedback control: the filter estimates the process state at some time and then obtains feedback in the form of (noisy) measurements. Accordingly, the equations for the Kalman filter fall into two groups: time update equations and measurement update equations. The time update equations are responsible for projecting forward (in time) the current state and error covariance estimates to obtain the a priori estimates for the next time step. The measurement update equations are responsible for the feedback, i.e., for incorporating a new measurement into the a priori estimate to obtain an improved a posteriori estimate.
Kalman filtering is an important tool in many navigation systems. Indeed, the Kalman filter can be used to integrate the present invention with an inertial navigation system (INS). The INS is considered to be the system model and its outputs are regarded as the referenced trajectory. Measurement aids, including data from the present invention, are used to compute errors and they are applied to the reference to generate the combined output. The filter can accept as data the estimates and covariance matrices for vessel coordinates and source positions generated from the analysis of the primary observations. Similarly, it can be used as an observer in a feedback system for disturbance rejection (and hence smoothing a vessel's motion) using estimates of the vessel coordinates, since tracking and output disturbance attenuation are essentially equivalent problems (at least for linear models).
Alternate Telescope Designs
An alternative design approach for the multi-aperture unit uses a single infrared camera with large pixel count and is required to combine the light from each of the three independent apertures on a single detector array. The preferred technique uses a small turning mirror and 3-sided pyramid mirror to combine the light from the different apertures. FIGS. 5A and 5B show the design of a pyramid mirror combining system for combining three celestial beams onto a single infrared sensor 40 located at the focal plane of each telescope. The light from each lens assembly is first reflected off a small turning mirror and then a three-sided pyramid shaped mirror placed directly in front of the camera array. These pyramid assemblies are typically polished from a solid glass substrate and are generally used in the opposite direction as solid retro-reflectors. In this design, the outer glass surfaces will be coated with an enhanced aluminum coating for high reflectivity in the H-band. FIG. 5B also indicates how a larger 640×512 array is separated into the three distinct regions for the different apertures with the pyramid mirror. Only two regions 40A and 40B are shown. Each individual aperture uses approximately 1⁄3 the entire array area with an effective field of view of a 0.55 degree square (or 0.62 degree circular).
Another aperture combining technique investigated by Applicants involves the use of bent fiber image conduit. This requires the infrared camera to be modified so that the thermoelectric cooler package (that normally has a window in front of the array) would be replaced with a fiber window bonded directly to the array. Due to this additional expense, the pyramid mirror technique was selected as the preferred aperture combiner for the alternative preferred embodiment.
Compact Daytime Stellar Imaging Embodiments (with Pointing Telescopes)
Embodiments of the present invention described above tend to be relatively large and heavy, such as about one cubic meter and about 60 pounds. A need exists for embodiments of the present invention that are small enough to fit easily in an aircraft or missile. Described in detail below are a second set of preferred embodiments utilizing one or more smaller aperture telescopes that are pivotably mounted on a movable. platform such as a ship, airplane or missile so that the telescope or telescopes can be pivoted to point toward specific regions of the sky. Embodiments of this second set are mechanically more complicated than those of the first set, but are much smaller and lighter and are especially useful for guidance of aircraft and missiles. In addition, these embodiments have high update rates.
This second set of embodiment like the first set is based upon Applicants' discovery that, at infrared wavelengths, a large number of stars (at positions offset by more than about 30° from the sun) “out-shine” the sky background at sea level even at mid-day. The midwave infrared cameras provide several principal advantages compared to the visible waveband sensors. This includes:

    
    
        The number of bright infrared stars exceeds the number of stars in the visible waveband by about one order of magnitude
        There is less atmospheric scatter and higher transmission at longer wavelengths.
    
    


The daytime sky background at 1.6 μm and 2.2 μm is lower by a factor of 8 and 16, respectively, compared to the visible waveband

    
    
        The effects of atmospheric obscurants and daytime turbulence are lower at longer wavelengths compared to the visible
        The full well capacity of infrared cameras is about one order of magnitude greater than for visible waveband sensors (CCDs). This allows us to increase the aperture diameter and/or the exposure time, thus increasing the signal to noise ratio.
    
    


However, a large (20 cm) diameter aperture leads to large sensor dimensions and large weight because size of the stellar imager, as well as its weight, depends on the telescope aperture diameter. In order to provide a compact and light-weight optical sensor, Applicants reduce the telescope aperture diameter to less than 10 cm. For example, if the aperture diameter is 5 cm, then the sensor dimension can be reduced to less than 20 cm×15 cm×12 cm. Such a sensor will fit applications of navigating missiles and aircraft.
However, reduction of the telescope aperture diameter will reduce the number of received star photons and the (SNR). This will reduce the star detection limit, or star-limited magnitude. In addition, in order to avoid star image blur due to aircraft or missile motion and vibration, camera exposures on the order of a few milliseconds should be used. If the camera exposure is reduced to a few milliseconds, then once again the SNR is reduced. The implication is that a reduction of a telescope aperture diameter and camera exposure time will reduce the SNR and thus will limit our ability to detect stars in the presence of strong sky background.
One can compensate for the above SNR losses caused by reduction of the telescope aperture diameter and camera exposure time by using two approaches. The first approach is to increase the star brightness by pointing a telescope to selected bright IR stars within a search window. The second approach is to reduce the readout camera noise because for short camera exposures, the SNR is limited by the camera readout noise rather than the sky background noise. Both techniques are discussed below.
In order to detect stars at sea level in the presence of strong daytime sky background with a small-aperture telescope and short camera exposures, Applicants use a strap-down optical system with a limited degree of freedom, which includes a two-axis precision rotary stage and allows us to point the FOV of a telescope at selected bright stars within a search window. Applicants limit the size of a search window to be equal, or less, than the angular distance over which the selected rotary stage maintains a one arc-second absolute accuracy or less. Commercially available single axis rotary stages (from Aerotech, Inc., for example) provide a 1 arc-second absolute accuracy over a mechanical angle of 15°×15° square area, providing an optical scan of up to 30°×30° when used with a reflecting mirror. By combining two stages with a right angle bracket and performing a calibration, we can provide biaxial performance with 1 arc-second accuracy. Applicants use these rotary stages, or similar devices, in their compact stellar trackers. Also, Applicants limit the size of a search window to 15°×15° to minimize possible calibration errors.
Performance Analysis
Because precision rotary stages have very high absolute accuracy (1 arc-second) over a limited optical angle of 15°, the search window is limited to a 15°×15° square area. In order to evaluate the sensor performance, Applicants determined the average number of bright infrared stars within a 15°×15° area of the sky. FIG. 11 depicts the number of H-magnitude stars vs. star magnitude over the entire sky. Using the data from FIG. 11, one can calculate the average number of stars of a given magnitude in the area of the sky of any size.
If N is the number of stars in the sky, and A is the area of the sky in square degrees that corresponds to the search window, then the average number of stars in this area is

n=N×A/41253

since there are 41253 square degrees on the sky. Here A=V2, where V is the width of the search window in degrees. The average number of stars of different H-band magnitude in a 15°15° window is shown in Table 1.








TABLE 1







Average Number of Stars of Different H-magnitude


in a 15° × 15° window










Star Magnitude













1
2
3
4

















Average Number of Stars
3
11
30
98










As indicated in Table 1, there are on average 3 to 30 stars of first to third H-band magnitude in the 15°×150 square window. Since only a few stars are required to determine a celestial fix, this means that there are enough bright infrared stars in the 15°×15° search window for navigating missiles and aircraft using a proposed compact optical GPS unit.
Next, Applicants determined the star detection limit for the proposed stellar tracker, or H-band star magnitude that the proposed stellar tracker can detect at daytime at sea level. Applicants performed SNR calculations using field data acquired with an H-band sensor with an equatorial mount that can be pointed at any direction on the sky. The number of star photoelectrons versus H-band star magnitude measured at sea level at daytime at 80° angular distance from the sun is shown in FIG. 12. The measurements were performed at daytime at sea level at angular distance from the sun of 80° using a 20 cm aperture telescope and an infrared camera, which is sensitive in the spectral waveband from 1400 nm to 1700 nm. The measured signal intensities in FIG. 12 in photoelectrons/millisecond are compared with the corresponding values from an infrared catalog. The measured signal intensities agree with a catalog values with an accuracy of 0.5 magnitude.
FIG. 13 compares the measured daytime sky background with the theoretical prediction using MODTRAN3 code for 23 km visibility. The measurements were performed using the same infrared camera and a 20 cm aperture telescope at sea level. The number of measured background photoelectrons in photoelectrons/pixel/millisecond is shown versus angular distance from the sun. The measurements and theoretical predictions are consistent with each other.
By using the measured data shown in FIGS. 12 and 13, SNR calculations were performed. The signal to noise ratio was calculated using the equation:




  
    SNR
    =
    
      
        N
        S
      
      
        
          
            N
            S
          
          +
          
            4
            ⁢
            
              (
              
                
                  n
                  B
                
                +
                
                  n
                  D
                
                +
                
                  n
                  e
                  2
                
              
              )
            
          
        
      
    
  
  ,




where NS is the total number of signal photoelectrons detected in a frame (assuming an area of 4 pixels and that the spot size full width at half maximum is approximately 1 pixel), nB is the number of sky background photoelectrons detected per pixel, nD is the number of dark current electrons per pixel, and ne is the number of read noise electrons per pixel. The measured signal intensities and solar background was re-scaled to smaller aperture diameters (5 cm to 10 cm) and an exposure time of 5 milliseconds. The calculated values of the SNR for three aperture diameters (D=10 cm, 7.5 cm, and 5 cm) and two cameras (with readout noise of 150 photoelectrons/pixel and 13 photoelectrons/pixel) at sea level and 20,000 ft altitude are shown in FIGS. 14, 15, and 16 versus H-band star magnitude. For the 10 cm aperture diameter telescope, the exposure time is 5 msec, the pixel field of view is 16 microradians, and the angular distance from the sun is 80°. For the 7.5 cm aperture diameter telescope, the exposure time is 5 msec, the pixel field of view is 21 microradians, and angular distance from the sun is 80°. For the 5 cm diameter telescope, the exposure time is 5 msec, the pixel field of view is 27 microradians, and angular distance from the sun is 80°.

Using a commercial infrared camera from CEDIP Infrared Systems (JADE SWIR HgCdTe focal plane array, 320×2450 pixels, 1.2 million electrons full well capacity, 150 electrons read out noise, thermoelectric cooler) and a 10 cm telescope at sea level, the sensor can detect (with SNR greater than 10) stars equal or brighter than 2.3 magnitude during the day. At night, much dimmer stars are visible. Using a 5 cm aperture telescope, the daytime star detection limit at sea level is the first H-band star magnitude. According to Table 1, on average there are three first H-band magnitude stars in the 15°×15° search window. Using a low noise infrared camera (13 photoelectrons/pixel), the daytime star detection limit reduces to the second H-band magnitude. This shows that a small aperture (D=5 cm) optical GPS unit can operate at sea level during both daytime and night time.
First Compact Embodiment
The first compact embodiment of the present invention uses a single telescope equipped with a two-axis high precision rotary stage to point the field of view at a selected bright infrared star within a search window. It also includes a temporary mirror which turns the telescope field of view by 90°. The latter is necessary because a geographical position determination requires that the star measurements be separated by an angular distance of between 90° and 120° in azimuth.
This design concept is shown in FIG. 17. When a temporary mirror 50 is inserted into the optical train, the field of view is deflected by 90°. A small telescope 52, nominally 5 cm aperture, points toward a mirror 54 mounted onto a precision stage 56 that has a 7.5° rotation capability, for example, the ARA125 from Aerotech, Inc. This rotary stage has an absolute accuracy of 1 arc-second. The telescope is fitted with an infrared camera to view stars within a field of view of nominally 0.44°×0.4°. The telescope uses a negative Barlow lens to increase the effective focal length while keeping the total length as short as 15 cm. The field of view of the telescope is changed in one direction by 15° by rotating the stage by 7.5°. The stage and mirror are connected to a second precision rotary stage mounted at a right angle, allowing the telescope to point directly to any particular stellar field within a 15° field in both directions.
After the stage-mounted mirror is the temporary mirror 50 mounted at a fixed angle. This mirror can be quickly inserted into the optical path. The field of view of the telescope is then deflected by a fixed amount (nominally 90°), but is still able to point over a 15° field of view. The temporary mirror is inserted into a precise location to maintain the angular precision. This allows a single telescope and camera to sequentially view two fields of view. Alternatively, this temporary mirror may have two or more fixed orientations, including an angle 90° orthogonal to that shown. This provides even more sky coverage, which is especially useful in the case of partly cloudy skies or when the solar angle is not far enough from the original directions. An advantage of this approach is that it has few components (a single telescope and one two-axis rotating stage). A possible disadvantage is that sequential (time separated) star measurements may be affected by the platform motion and vibration more than the simultaneous measurements.
Second Compact Embodiment
The second compact embodiment of the present invention uses two identical telescopes mounted to a dual-axis precision rotary stage. In the design shown in FIG. 18, the two telescopes 60 and 62 are pointed at 90° with respect to each other, sharing a common focal plane. Small fold mirrors near the focal plane, not shown, are used to combine the fields of view onto one infrared camera. An alternate design would add a 45° fold mirror at the output of one of the telescopes, so that the two telescope bodies are essentially parallel, and the different fields of view are provided by the 45° fold mirror. A single infrared camera is used for both telescopes. Two approaches for combining two images in a single focal plane array have been described above and shown in FIG. 5B. This design also includes two temporary fold mirrors that can be inserted at a precise angle. These temporary mirrors increase the sky coverage for the cases where the solar angle is too close to the original direction, or in the case of partly cloudy skies, where there is an advantage to pointing toward holes in the clouds.
Benefits
The key benefits of the proposed strap-down stellar imaging system with limited degree of freedom are:

    
    
        compact sensor design (5 cm aperture, 20 cm×15 cm×12 cm dimensions). Such a sensor with small dimensions is well suited for navigating flying platforms such as unmanned arial vehicles, aircrafts, and missiles,
        light weight,
        high probability of detecting stars because the telescope is pointed at selected stars,
        high update rate of the celestial fix (a few to several tens of seconds), and
        increased accuracy and reliability of the estimates for a celestial fix.
    
    


This last advantage is due to two factors: a) increased signal to noise ratio of the stellar imagery data and b) elimination of the need for star identification using star pattern recognition (there is no need to identify a star because a telescope will be pointed at the selected star using a two-axis rotating stage).
Compact Sensor Operation
The sensor operates as follows. First, by using an infrared star catalog, first H-band magnitude stars are selected within two search windows separated at 90° in azimuth. Second, using the local vertical measured with an on-board inclinometer as a reference (for example, the LCF 2000 series from Jewel Instruments), the sensor software generates control commands for the two-axis rotary stage and points the telescopes at the selected stars. (Since the instantaneous field of view of the telescope is 153 arc-seconds×192 arc-seconds, at this stage the star position is known within about the same accuracy, i.e. 153 arc-seconds×192 arc-seconds). Third, the sensor acquires the star images and processes the imagery data. Fourth, the sensor software calculates the image centroid with sub-arc-second accuracy. Then, the on-board software calculates the star height with respect to local horizon and a line of position (LOP). At the same time, the second telescope acquires star imagery within the second 15°×15° search window separated from the first search window at about 90° in azimuth, processes the imagery data, and calculates the second line of position. The intersection of the two lines of position defines a celestial fix (latitude and longitude).
The accuracy of the centroid measurements with an infrared sensor, as well as the accuracy of the longitude and latitude calculations using site reduction software is a fraction of an arc-second. Thus, the accuracy of the proposed stellar tracker is limited by the absolute accuracy of the rotary stage, which is one arc-second. Applicants expect that an update rate for a celestial fix will be on the order of a few seconds
In order to convert the measured angular positions of the stars into a geo position, accurate measurements of the local vertical are required. Applicants will use a commercial Jewel LCF-196 inclinometer. This sensor is designed for applications with high level of shock and vibration. Its resolution is 3 micro-radian and the bandwidth is 30 Hz. With a lower band width of 1 Hz, an accuracy of about 1 micro radian is estimated.
Advanced Sensor Design with an “All Sky” Camera
The first preferred embodiment shown in FIG. 4A includes three telescopes mounted to have their optical axes separated at 120 degrees. The use of three telescopes allows for both increased position accuracy due to the ability to triangulate the measurements and redundancy in case one of the telescope optical axes is close to the sun. A similar approach may be used in a compact unit. Two telescopes (four field-of-views using temporary mirrors) will share a single infrared focal plane array. Two techniques may be used to combine the light from each of the two telescopes onto a single focal plane array. A preferred technique uses a small turning mirror and two-sided pyramid mirror to combine the light from three telescopes. Another aperture combining technique involves the use of a fiber image conduit.
Avoiding the Sun
In order to increase the operational utility of the above compact systems, a visible-band “all sky” CCD camera may be included. This visible camera would optimize the sensor performance. It would image the sky over an area of 180°×180° to determine the approximate sun position with respect to the optical axes of the one or more infrared telescopes as well as positions of clouds. Then, the sensor software will select those telescopes (one, two or three) whose optical axes are separated at angular distances from the sun greater than 80° and have a clear line of sight. Thus, an “all sky” camera will allow users to minimize the effects of clouds on the star imaging system. An Optical GPS unit will be integrated with the on-board inertial navigation unit. As in the earlier described embodiments, if bad weather separates star sightings, the inertial navigation unit will carry the stellar fix forward until new star observations can be obtained.
Alternatives, Modifications and Variations
Marine Environment
A marine environment provides the challenge of the sensor operating autonomously over large variations in humidity and temperature, along with requiring additional protection from condensation and corrosion due to fog and saline conditions. Some of the modifications that could be required would be to change the lens housing or mechanical structure material to lower the coefficient of thermal expansion in order to maintain the system focus while operating over an increased temperature range. Additionally, the sensor covering will be reviewed to provide for increased weatherproofing protection for the optical system. The lens assembly is preferably designed so that the system can be nitrogen purged which will prevent condensation on the internal surfaces of the optics. Similarly, the entire sensor head could also be nitrogen purged or a desiccant material placed internally to reduce condensation. A large mechanical shutter assembly is preferably placed on each of the three lens apertures to provide protection of the optics during periods of rain, ice, or snow, fog when the system would be prevented from operating due to poor atmospheric transmission.
To increase the reliability and maintainability of the unit while deployed at sea, several other designs should be considered. The wire cabling connection between the sensor head and electronics can be redesigned to use a single fiber optic cable. This could be an important upgrade for the sensor head to improve reliability and ruggedness while reducing the possible electromagnetic interference from external shipboard hardware such as radars. To improve the maintainability of the sensor, an increased set of built-in diagnostic capabilities could be implemented for a deployed system. This would also include an autonomous calibration diagnostic that can be run during favorable atmospheric conditions (clear night time) when the probability of observing several stars in each aperture is high. This diagnostic would recalibrate the line of sight of each of the apertures with respect to each other and the inclinometer by knowing the ship location via GPS. In this way, the system could autonomously calibrate out small thermal and/or mechanical drifts during periods of opportunity to increase the system reliability, maintainability and accuracy. The accuracy of the local horizon measurements using the inclinometer will require review. Specifically, the update rate requirement along with the suppression of angular acceleration effects should be reviewed. The addition of angular rate sensors may be required to permit removal of platform motion effects in multiple frame averages.
Aircraft Issues
Peculiarities of the present invention for the aircraft include:

    
    
        a) Effect of atmospheric obscurants including clouds is reduced (50% probability of clear line of site at sea level, and 90% probability at 30,000 ft). The use of multiple measurement channels increases the probability of clear line of sight;
        b) Daytime sky background is reduced by a factor of 10 for every 20,000 ft;
        c) Simultaneous measurements with four optical channels may be preferred to reduce the effect of aircraft vibration and motion;
        d) Short exposure time (1 msec or lower) may be required to prevent star blurring due to aircraft vibration; and
        e) A multiple-frame averaging technique should be used to reduce noise and increase the signal to noise ratio in the imagery data.
    
    


For the aircraft application, it is likely important to reduce the size and weight of the unit while also having an increased vibrational operating specification for the sensor. Due to reduced sky background at altitude, the sensor apertures could be designed for a smaller diameter with a shorter focal length to maintain the same f-number. Similarly, the mechanical structure could be designed with composite materials to increase stiffness and reduce susceptibility in a harsh vibrational environment, lower sensor head weight, and reduce the system thermal susceptibility.
Although the present invention has been described above in terms of specific preferred embodiments persons skilled in this art will recognize that many changes and variations are possible without deviation from the basic invention. For example, platform position can be determined with only two telescopes. With three telescopes at least two will always be pointed more than 30 degrees away from the sun. If only two telescopes are used, preferably they would be mounted with a 90 degree azimuthal separation at an elevation of 45 degrees to the horizon. There could also be situations where four telescopes would be preferred. Many infrared sensors other than the ones specifically referred to are available for operation in the transmission windows shown as 4 and 6 in FIG. 2A. The systems could have applications other than ship or airplane navigation. Various additional components could be added to provide additional automation to the system and to display position information. Star catalogs may include celestial objects other than stars such as planets and asteroids. Otherwise, if one of these objects shows up in an image, it could confuse the system. The CCD camera discussed above for looking for cloudless regions of the sky (or another visible light camera) can be very useful for both the strap-down embodiments as well as the embodiments with the pointing telescopes. To take advantage of clear regions of the sky for the strap-down embodiments three temporary fold mirrors such as the ones described for the pointing telescopes may be provided for temporary insertion in each of the three strap-down telescopes to change each field of view by fixed angles. The computer processor will be programmed to cause the insertion of the temporary fold mirrors if the CCD camera data shown that the insertion will provide a clearer line of sight to infrared stars. Accordingly, the scope of the invention should be determined by the appended claims and their legal equivalents.

## Claims

1. An automatic celestial navigation system for navigating both night and day by observation of K-band or H-band infrared light from multiple stars, said system comprising:
A) at least one telescope on a movable platform for viewing at least two substantially different portions of sky with each of said at least one telescope defining a field of view and comprising:
1) telescope optics for focusing H-band or K-band light from stars in said field of view onto a focal plane,
2) a sensor located at said focal plane for detecting H-band or K-band light,

B) an accurate timing device,
C) an accurate inclination sensor, and
D) a computer processor having access to infrared star chart information, programmed to compare image data from said infrared sensors, time information from said timing device, inclination information from said inclination sensor and said star chart information to determine positions of said platform.

2. The system as in claim 1 wherein said at least one telescope is two telescopes.

3. The system as in claim 1 wherein said system is a compact system suitable for use on a missile, an unmanned aerial vehicle or other aircraft and having a volume of substantially less than one cubic meter.

4. The system as in claim 3 wherein said system further comprises a rotary means for pointing the field of view of said at least one telescope with an accuracy of less than 3 arc-seconds.

5. The system as in claim 3 wherein said system further comprises a rotary means for pointing the field of view of said at least one telescope with an accuracy of about 1 arc-second or better.

6. The system as in claim 3 wherein said system further comprises two rotary stages for pointing the field of view of said at least one telescope.

7. The system as in claim 6 wherein said at least one telescope is two telescopes.

8. The system as in claim 6 wherein said at least one telescope is three telescopes.

9. The system as in claim 1 wherein said at least one telescope is three telescopes and each of said three telescopes are rigidly mounted with respect to the platform and each other.

10. The system as in claim 1 and further comprising temperature and pressure sensors wherein said processor is also programmed to utilize information from said temperature and pressure sensors to correct for variations caused by changing temperature and pressure.

11. The system as in claim 9 wherein each of said three telescopes are pointed in azimuthal directions spaced at about 120 degrees relative to each other and at about 45 degrees relative to horizontal.

12. The system as in claim 1 wherein said system is integrated with an inertial guidance system.

13. The system as in claim 9 wherein said platform is a ship or a portion of a ship.

14. The system as in claim 3 wherein said platform is a ship or a portion of an airplane.

15. The system as in claim 3 wherein said platform is a ship or a portion of a missile.

16. The system as in claim 3 wherein said platform is a ship or a portion of an unmanned aerial vehicle.

17. The system as in claim 1 wherein each of said sensors have full well capacities in excess of 5 million electrons.

18. The system as in claim 1 wherein each of said sensors have a frame readout period of less than 30 milliseconds.

19. The system as in claim 9 wherein each of said telescopes have a pixel size of about 6 arc-seconds.

20. The system as in claim 3 wherein each of said telescopes have a pixel size of about 16 to 27 microradians.

21. The system as in claim 1 wherein said processor is programmed to detect stars in the presence of strong background noise and to reduce noise, by utilizing multiple individual frames that are aligned to a star image in a single frame and summed up.

22. The system as in claim 1 wherein sizes of search windows are determined by the root mean square error of measurements of local verticals with an inclinometer.

23. The system as in claim 1 wherein stars are identified using angular distances between stars, star relative brightness and triangle patterns.

24. The system as in claim 9 wherein each of said three telescopes have an instantaneous field of view of about 0.4×0.5 degrees.

25. The system as in claim 9 wherein said computer processor is programmed to determine position utilizing the following steps:
A) to reduces the fixed pattern camera noise, considering the data set that consists of 20 frames and first, using 20 data frames that precede the first frame in the data set, the median data frame is calculated to determine a background threshold for each pixel, then, the median frame of pixels is subtracted from each frame in the data set, pixel by pixel;
B) next, to reduce noise, five sequential data frames in the data set are blindly summed up to spreads star illumination over a few pixels;
C) then a “super pixeled” image is created by down sampling the image generated in step B at the rate of 1:4 (four adjacent pixels are summed across the pixel array);
D) determine the brightest super pixel in the frame where the star can be located and create a small (9×9 regular pixel size) window about the brightest super-pixel location (81 pixels with the brightest 4×4 in the middle);
E) to increase the centroid accuracy, up sample the image within the window at the rate 10:1 using cubic spline fit algorithm image at the noise ceiling (the computer produces a digital array of 90×90 virtual pixels and fits them with the cubic spline fit algorithm into a Gaussian-like shape);
F) calculate the intensity weighted centroid to determine an expected star location in the first data frame;
G) repeat steps B)-F) for each subsequent data frames in the data set;
H) once an expected star location in all subsequent data frames are determined, shift all 20 frames to the star position in the first frame, and sum up all frames to create a final image for the entire frame, based on the shifts obtained from the 9×9 pixel centroiding window, the extent of the shift is being based on the location of the centroid;
I) create a “super pixel” representation of the shifted and added frame obtained from step 8 by down sampling at the rate of 1:4 (four adjacent pixels are summed across the pixel array), determine brightest super pixel and create a small (9×9 regular pixel size) window about that location;
J) up sample the image within the small 9×9 pixel window with a ratio of 10:1 by using cubic spline fit algorithm, remove background by chopping at noise ceiling, calculate intensity weighted centroid position as well as total intensity in the image, make an estimation of the rms noise by taking the standard deviation σ of all pixels in the entire image frame, remove the data within the small window in order to search for the next dimmest star, repeat steps I and J until all potential stellar objects within the frame are found;
K) for each potential star location, the pixel SNR is calculated:





  
    SNR
    =
    
      
        
          I
          S
        
        -
        
          〈
          I
          〉
        
      
      σ
    
  
  ,




where Is is the total signal intensity divided by number of pixels in the image, <I> is the mean intensity in the image, and σ is the rms noise and if the SNR≧10, then the star is detected and the star coordinates are determined by intensity weighted centroid calculated in step J) but if SNR<10, then this potential star location is rejected and treated as a noise; and
L) star coordinates along with the star intensity are used further by automated star pattern recognition algorithm and coordinates of the brightest star in the field of view are used in calculations of latitude, longitude and absolute azimuth.

26. The system as in claim 3 wherein the system is integrated with an inertial navigation system using a Kalman filter.

27. The system as in claim 1 wherein said computer processor is programmed to determine a absolute azimuth reference utilizing at least one star position.

28. The system as in claim 27 wherein said absolute azimuth reference is utilized to determine attitude of said platform.

29. The system as in claim 28 wherein the platform is an artillery gun.

30. The system as in claim 1 and further comprising a visible light camera especially for use on partly cloudy days for determing directions to cloudless regions of the sky.

31. The system as in claim 30 wherein the visible light camera is a CCD camera.

32. The system as in claim 9 wherein said three rigidly mounted telescopes each comprise a temporary fold mirror for changing the fields of view of each telescope by fixed angles.