Passive altimeter

A passive altimeter includes an imaging device, a groundspeed system, an image processing device operatively connected to receive an indication of groundspeed from the groundspeed system and to receive at least a first image from the imaging device taken at a first position and a second image from the imaging device taken at a second position spaced apart from the first position. The image processing device is configured to compare the first image and the second image to determine an altitude above ground using the indication of groundspeed from the groundspeed system.

BACKGROUND

The present disclosure relates to altimeters, and more particularly to altimeter systems for determining altitude above the ground level.

2. Description of Related Art

Altitude above ground level (AGL) is an important consideration for all aspects of flight. For example, during critical phases of flight, many systems may need an indication of AGL altitude to perform properly. One way to determine altitude AGL is to use active radar altimeters which send a radar signal to the ground. Such conventional methods and systems have generally been considered satisfactory for their intended purpose. However, conventional AGL signals can potentially be distorted, intercepted, or the like, and may be inaccurate. As a result, there is still a need in the art for improved AGL altimeters. The present disclosure provides a solution for this need.

SUMMARY

In at least one aspect of this disclosure, a passive altimeter includes an imaging device, a groundspeed system, an image processing device operatively connected to receive an indication of groundspeed from the groundspeed system and to receive at least a first image from the imaging device taken at a first position and a second image from the imaging device taken at a second position spaced apart from the first position. The image processing device is configured to compare the first image and the second image to determine an altitude above ground using the indication of groundspeed from the groundspeed system.

The image processing device can be further configured to determine a location of at least one common pixel on the first image and the second image. In some embodiments, the image processing device can be configured to compare a relative change in position of the at least one common pixel between the first image and the second image.

The image processing device can be configured to determine a Nadir angle of the imaging device relative to ground. The imaging device can also be gyroscopically stable to maintain a predetermined minimum Nadir angle relative to ground. The image processing device can also be configured to determine altitude based on a Nadir angle of zero for the imaging device. In some embodiments, the imaging device can include at least one of a visual camera and/or an infrared camera.

The groundspeed indicator can include a global position sensor (GPS) and an aircraft inertial measurement unit. The GPS and the aircraft inertial measurement unit can be operatively connected to the image processing device to provide data thereto.

In at least one aspect of this disclosure, a method for passively determining altitude includes receiving, at an image processing device, a first image from an imaging device, the imaging device having a known instantaneous field of view (IFOV), receiving, at the image processing device, a second image from the imaging device, receiving a groundspeed indication from a groundspeed system that is configured to determine a groundspeed (GS) of an aircraft, determining a Δt as a difference in time between the first image and the second image, selecting at least one common pixel of the first image and the second image, determining a relative change in position of the at least one common pixel between the first image and the second image to determine an image distance (ID), and calculating altitude above ground level (AGL) above a portion of a surface depicted by the at least one common pixel using the following relationship: AGL=[(GS*Δt)/(IFOV*ID)]*cos(θ), where θ is Nadir angle.

Calculating altitude AGL can include determining the Nadir angle with the image processing device. In some embodiments, calculating altitude AGL can include assuming the Nadir angle is zero. Determining the Δt can include receiving the Δt as predetermined value selected by a user.

The at least one common pixel can further include a first common pixel depicting a portion of a structure and a second common pixel depicting a portion of ground, and the method can further include determining the altitude of a structure relative to ground that is depicted in the first and second images by determining a difference in altitude of the first common pixel and the second common pixel. Selecting the at least one common pixel can include automatically selecting the at least one common pixel such that the image processing device makes a selection using an image processing algorithm.

DETAILED DESCRIPTION

Reference will now be made to the drawings wherein like reference numerals identify similar structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a systematic view of an embodiment of the passive altimeter in accordance with the disclosure is shown inFIG. 1and is designated generally by reference numeral300. Other aspects or embodiments of passive altimeters in accordance with this disclosure are shown inFIGS. 2A-3B. The systems and methods described herein can be used to determine altitude above an object and/or ground, or the height of an object and/or portion of terrain without the use of active altimeters.

Referring toFIG. 1, in conjunction withFIGS. 2A-3B, in at least one aspect of this disclosure, a passive altimeter300includes an imaging device101, a groundspeed system303, and an image processing device301configured to receive at least a first image150taken at a first position (e.g.,FIGS. 2A and 2B) and a second image250taken at a second position (e.g.,FIGS. 3A and 3B) from the imaging device101. In some embodiments, the imaging device101can include a visual camera and/or an infrared camera, but any suitable imaging apparatus is contemplated. The imaging device101can have a known or determinable instantaneous field of view (IFOV) and/or a frame rate. Instantaneous field of view can be different for different axes (e.g., x, y) or directions of view for the imaging device101, in which case each instantaneous field of view of each axis and direction can be known.

Frame rate, as referred to herein, is the difference in time (Δt) between the first time of the first image150being taken or collected and the second time of the second image250being taken or collected. In some embodiments, the imaging device101and/or the image processing device301are configured to have a preset or selected Δt such that images are taken and/or selected at known intervals of time (e.g., every tenth frame recorded by the imaging device101). The Δt can be fast enough to create a significant amount of overlapping area in the first and second images over the desired operational envelope of speed and altitude. A Δt compensator can be included that modifies the rate between the first, second image, intervening, and subsequent images such that if the image processing device is not capable of locating a common pixel between the images, the frame rate can change until a common pixel can be found (e.g., at low altitudes, frames closer in time will be used whereas at higher altitudes the frames will have higher overlap. As may be appreciated, images can be taken and analyzed up to the maximum frame rate of the camera. Also, shutter speed and/or exposure time can be reduced to increase the quality of the image if desired.

In some embodiments, the image processing device301can include a suitable display configured to display images thereon, but such a display is not necessarily required. The image processing device301can include any suitable circuit, processor, computer, and/or other suitable machine configured to receive and process image data from the imaging device101. The image processing device can also include any suitable data storage disposed therein and/or connected thereto, and can also include any suitable software configured to be used in conjunction with the image processing device.

The image processing device301can be configured to compare the first image150and the second image250to determine an altitude above at least a portion of the terrain depicted in the first image150and the second image250using an indication of groundspeed (GS) from the groundspeed system303. To this end, image processing device301may be configured to determine an image distance (ID) that the imaging device101has traveled between taking the first image and the second image. The image distance between the first image shown inFIG. 2Band the second image shown inFIG. 3Bis the horizontal distance the aircraft100moved relative to the depicted terrain which can be calculated as a pixel distance.

As an example, three points (points A, B, and C) are shown inFIGS. 2A and 3Aas points that can be selected for altitude determination (altitude over these points is shown as AA, AB, and AC, respectively). The image processing device301can be further configured to determine a location of at least one common pixel (e.g. pixels A, B, and C inFIGS. 2B and 3Bwhich correspond to points A, B, and C) on the first image150and the second image250. For example, the image processing device301can be configured to compare a relative change in position of the at least one common pixel between the first image150and the second image250. As an example, in the first image105, pixel A (corresponding to point A) has a position of (X1A, Y1A) and a position of (X2A, Y2A) in the second image250. The difference in position of pixel A on the image can be expressed as ΔA=(X2A−X1A), (Y2A−Y1A). This difference can be manually or automatically determined by any suitable means (e.g., using the image receiving system301). For example, the image processing device301may include a suitable configuration (e.g. physical circuitry, software, and/or the like) to determine coordinates of certain pixels or groups of pixels to determine the relative change or image distance between one or more images. A magnitude of distance can be determined via known means as well.

In another embodiment, a first row position (e.g. R1A, R1B, R1C) and/or a first column position (e.g. C1A, C1B, C1C) can be compared to a second row position (e.g. R2A, R2A, R2A) and/or second column position (e.g. C2A, C2B, C2C) by the image processing device301to determine relative change in a similar matter to the point location approach above. In some embodiments, the track of the aircraft100is substantially aligned with the columns of the images (e.g. C1A, C1B, C1C), in which case only the rows need to be compared (e.g., comparing R1Ato R2A) to determine the relative change or image distance.

In some embodiments, the imaging device101can be configured to align itself with the groundspeed track such that the columns of the images (e.g. images150,250) are always aligned with the direction of travel relative to the ground, thus allowing simpler row based computation of image distance. In some embodiments, rows are essentially in the direction of the roll axis of the aircraft and the imaging device can be configured to compensate for the image motion in the column direction caused by forward motion of the aircraft. This can essentially eliminate a change in column location of objects. To calculate the transformation from the vehicle forward motion to GS, the crab angle between the row axis of the image plane and the direction of flight could be determined. With the row axis of the image plane initially aligned to the aircraft roll axis this crab angle is the crab angle of the aircraft which can be determined from an onboard navigation system or other avionics equipment. This allows for a simpler row bases computation of image distance. The crab angle affect does not need to be included for small crab angles and does not require a highly accurate value.

In some embodiments, the at least one common pixel (e.g. pixel A, B, and/or C) can be tracked manually or automatically by the image processing device301or any other suitable system. For example, the image processing device301can be configured to read red-green-blue (RGB) values, intensity, and/or similar values of the common pixel (e.g. pixel A, B, and/or C) and/or one or more surrounding pixels of the first image105and search for a similar values in a similar pattern in the second image250. After the image processing device301locates the common pixel (e.g. pixel A, B, and/or C) in the second image250, the image processing device301can note the position of the common pixel (e.g. pixel A, B, and/or C) in the second image250and subtract this from the position of the common pixel (e.g. pixel A, B, and/or C) in the first image150.

In some embodiments, the image processing device301can be configured to determine or estimate a Nadir angle θ of the focal plane (FP) of the imaging device101relative to a ground plane (S-Tilt) and/or an average of Nadir angle of each pixel of the imaging device101(P-Tilt). To clarify, S-Tilt is the angle between the focal plane of the imaging device101relative to the ground whereas P-Tilt is the angle of the focal plane of one or more pixels of the imaging device101relative to a ground plane. The image processing device301can be configured to account for a preset Nadir angle (e.g., P-Tilt and/or S-Tilt) of the imaging device101based on characteristics of the imaging device101and/or how it is mounted (e.g. a FLIR system). In some embodiments, the image processing device301can be configured to account for Nadir angles at different flight regimes (e.g. pitch angles) by communicating with one or more aircraft instruments (e.g., an attitude indicator) and/or an aircraft inertial measurement unit. The imaging device101can also be gyroscopically or otherwise stabilized to maintain a minimized Nadir angle θ relative to the ground or a fixed point. For example, the imaging device101can be configured to account for movement of aircraft100or for misalignment with the fuselage relative to the ground.

While S-Tilt can be accounted for quite easily by determining the tilt angle of the entire imaging device101, P-Tilt can be accounted for by calculating the average pixel location angle relative to the center of the image plane by determining the average pixel location using the relationship APL=((X1A+X2A)/2, (Y1A+Y2A)/2).

In some embodiments, the image processing device301can be configured to assume a Nadir angle θ of zero when determining the altitude. For example, in certain flight regimes and circumstances, the Nadir angle θ (e.g., including P-Tilt and/or S-Tilt) is sufficiently small that it has limited effect on calculation of altitude (e.g. straight and level flight, images taken in short intervals, and the like). Also, the image processing device301can be configured to average Nadir angles of separate images to create a single Nadir angle for ease of calculation.

The groundspeed indicator system303can include a global positioning system (GPS) and/or an aircraft inertial measurement unit configured to provide the image processing device301with a groundspeed. For example, a GPS can be used for substantially constant speed travel, and the inertial measurement unit can provide real time speed change data using one or more accelerometers and/or other aircraft instrumentation (e.g., barometric altimeter, heading indicator, attitude indicator, or the like) to create an accurate quantification of groundspeed even in variable speed and/or orientation scenarios where GPS cannot provide accurate speed change information fast enough, for example.

The image processing device301is configured to utilize the information provided by multiple images (e.g. images150,250) and the groundspeed indicator to determine altitude over a desired point. The image processing device301can be configured to calculate altitude above ground or an object on the ground (AGL) based on the following relationship:
AGL=[(GS*Δt)/(IFOV*ID)]*cos(θ),
where θ is Nadir angle (e.g., P-Tilt and/or S-Tilt), IFOV*ID=[(IFOVX*IDX)2+(IFOVy*IDY)2]1/2, where IDX=|X1A−X2A| and IDY=|Y1A−Y2A|. If θ includes P-Tilt, P-Tilt can be calculated as off axis angle of pixel (XavgA, YavgA), where XavgA=(X1A+X2A)/2 and YavgA=(Y1A+Y2A)/2.

In at least one aspect of this disclosure, a method for passively determining altitude can include providing an imaging device101having a known instantaneous field of view as disclosed herein, a groundspeed indicator303configured to determine a groundspeed of an aircraft, and an image processing device301configured to receive at least a first image (e.g., image150) at a first position and a second image (e.g., image250) at a second position from the imaging device101.

The method can further include receiving, at the image processing device301, the first image150from the imaging device101and receiving, at the image processing device301, the second image250from the imaging device101.

The method can also include determining a Δt as the difference in time between taking and/or collecting the first image and the second image. The method can also include setting the Δt to a predetermined time difference or otherwise as disclosed herein.

In some embodiments, the method further includes selecting at least one common pixel (e.g. pixel A, B, and/or C) between the first image150and the second image250either manually or automatically as described herein. For example, the selecting step can be performed automatically by the image processing device301. The method can also further include determining a relative change in position of the at least one common pixel between the first image and the second image to determine an image distance as disclosed herein and calculating altitude above a portion of a surface depicted by the at least one common pixel using the relationships disclosed herein. The method can further include determining the Nadir angle θ, or assuming it to be zero.

In some embodiments, the method can further include determining the altitude of a structure relative to ground that is depicted in the first image150and the second image250by determining a difference in altitude of the point (e.g. point B) depicted in the first common pixel (e.g. pixel B) and the point (e.g. point C) depicted in the second common pixel (e.g. pixel C).

The method can further include creating an altitude map of an area using the systems and methods above to determine altitude of a suitable plurality of points on a series of images. This can allow a passive altimeter to be used to map an area of unknown altitudes and/or to allow surveillance of an area for change of altitude (e.g. construction, destruction, terrain changes). The methods disclosed herein can be implemented into any suitable software or hardware and performed by a computer or other suitable machine such that the methods may be automated and the calculations of altitude can be automatic and/or quick for real time altitude analysis.

The methods and systems of the present disclosure as disclosed herein provide for a passive altimeter. While the apparatus and methods of the subject disclosure have been shown and described with reference to embodiments, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the spirit and scope of the subject disclosure.