# Patent

## Title
Method and apparatus to extend ADS performance metrics

## Abstract

A method and system are provided for measuring and monitoring performance metrics of a non-ADS-B tracking system and generating performance metrics for the non-ADS-B tracking system in terms of ADS-B equivalent performance metrics. An aircraft transmits various transponder-based or other signals which are received at multiple ground stations, some of which may be ADS-B stations or both ADS-B and multilateration stations. ADS-B signals may contain performance metrics which are passed on from ADS-B station to an ADS-B processor, which outputs aircraft-derived metrics. ADS-B signals and all other transponder signals are also received at all ground stations, time-stamped, and sent to a multilateration processor, which generates multilateration metrics. Therefore two streams of information are passed onto ATC system processor containing the ADS-B aircraft-derived metrics and multilateration-derived metrics. The ATC system processor may then be configured to pass along both sets of messages to the ATC system, or to select a combination or fusion of the best metrics and tracking information for an aircraft.

## Background
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a Continuation-In-Part of U.S. patent application Ser. No. 11/343,079, Filed Jan. 30, 2006 and incorporated herein by reference; This application is also a Continuation-In-Part of U.S. patent application Ser. No. 11/342,289 filed Jan. 28, 2006 and incorporated herein by reference; This application is a Continuation-In-Part of U.S. patent application Ser. No. 11/203,823 filed Aug. 15, 2005 and incorporated herein by reference; This application is a Continuation-In-Part of U.S. patent application Ser. No. 11/145,170 filed on Jun. 6, 2005 and incorporated herein by reference; This application is a Continuation-In-Part of U.S. patent application Ser. No. 10/743,042 filed Dec. 23, 2003 now U.S. Pat. No. 7,132,982 and incorporated herein by reference; application Ser. No. 10/743,042 is a Continuation-In-Part of U.S. patent application Ser. No. 10/638,524 filed Aug. 12, 2003 now U.S. Pat. No. 6,806,829 and incorporated herein by reference; application Ser. No. 10/638,524 is a Continuation of U.S. patent application Ser. No. 09/516,215 filed Feb. 29, 2000 now U.S. Pat. No. 6,633,259 and incorporated herein by reference; application Ser. No. 09/516,215 claims is a Non Prov. of Provisional U.S. Patent Application Ser. No. 60/123,170 filed Mar. 5, 1999 and incorporated herein by reference; application Ser. No. 10/743,042 is a Continuation-In-Part of U.S. patent application Ser. No. 10/319,725 filed Dec. 16, 2002 now U.S. Pat. No. 6,812,890 and incorporated herein by reference. Application Ser. No. 10/743,042 is a Non Prov. of Provisional U.S. Patent Application Ser. No. 60/440,618 filed Jan. 17, 2003 and incorporated herein by reference.


FIELD OF THE INVENTION
The invention relates to the field of aircraft and ground vehicle tracking and surveillance. In particular, the present invention is related to techniques for quantifying the accuracy and backing up Automatic Dependent Surveillance (ADS) using multilateration techniques.
BACKGROUND OF THF INVENTION
Global implementation of Automatic Dependent Surveillance (ADS) is underway and promises to replace conventional radar surveillance (e.g., Secondary Surveillance Radar, or SSR) within the next 10 to 20 years. Switching to ADS from radar techniques represents a fundamental shift in the techniques and philosophy of aircraft tracking.
In support of this transition, many aviation organizations are developing standards to ensure a proper and well-engineered transition from present radar-based systems to an ADS environment. An important part of this is the use of “Figures of Merit” or quality indicators associated with ADS solutions. ADS cannot supplant conventional radar techniques unless it can be demonstrated to be at least as accurate as prior art radar surveillance techniques. Techniques for quantifying the accuracy of ADS are thus important to the implementation of ADS to supplant radar. Techniques for measuring the accuracy of prior art radar tracking systems might not lend themselves to quantifying the accuracy of ADS.
Working groups within RTCA (Radio Technical Commission for Aeronautics, RTCA, Inc., 1828 L Street, NW, Suite 805, Washington, D.C. 20036), EUROCAE (The European Organisation for Civil Aviation Equipment, EUROCAE, 17, rue Hamelin, 75116 Paris, FRANCE), and ICAO (International Civil Aviation Organization, ICAO, 999 University Street, Montreal, Quebec H3C 5H7, Canada) have developed performance metrics for ADS, and some standards and guidelines already exist. These developed and existing standards and guidelines include: Minimum Aviation System Performance Standards for Automatic Dependent Surveillance, RTCA 242A, dated Jun. 25, 2002, Minimum Operational Performance Standards for 1090 MHz Extended Squitter Automatic Dependent Surveillance Broadcast (ADS-B) and Traffic Information Services Broadcast (TIS-B), RTCA 260A, 2003, which supersedes the earlier RTCA DO 260, and Safety, Performance, and Interoperability Requirements Document for ADS-B-NRA Application, ED-126 V1.0, December 2005, The European Organization for Civil Aviation Equipment, all of which are expressly incorporated herein by reference in their entirety.
RTCA standards define the “Figures of Merit” or quality indicators for the system. Positional data delivered by ADS-B typically depends on Global Navigation Satellite System (GNSS) receiver data. The RTCA DO260 standards require the generation and transmission of a value called “Navigational uncertainty Category” (NUC) to all ADS-B receivers, so that receivers can determine if the data is “good enough” to use.
GNSS uses satellite-positioning techniques to provide users with accurate and timely navigation information. A Global Positioning System (GPS) is a subset of a global navigation satellite system because a GPS system needs only to provide the ability to determine position information. GNSS also provides real time navigation information. In order to use GNSS for navigation, it must be possible to generate real-time navigation information fast enough for safe navigation.
When DO 260 was revised as 260A, NUC was specified in terms of NIC, NAC and SIL, defined as follows. Navigation Accuracy Category (NAC) is reported so that the surveillance application may determine whether the reported position has an acceptable level of accuracy for the intended application. Navigation Integrity Category (NIC) is reported so that the surveillance application may determine whether the reported position has an acceptable level of integrity for the intended application. Surveillance Integrity Level (SIL) is the probability that the integrity containment radius used in the NIC parameter will be exceeded.
Each of the parameters can be further subdivided for position and velocity (e.g., NUCp and NUCv). For a complete definition of each of these parameters please refer to RTCA DO 240A, incorporated herein by reference. From DO 240A, NIC, NAC, and SIL values are as presented in Tables 1-5 below.
Table 1 lists NIC values from 0 to 11 for a broad range of applications, ranging from lowest integrity (0) to highest integrity (11). Table 2 lists NAC values from lowest accuracy applications to highest application applications (i.e., LAAS or precision landing). Table 2 and Table 3 list separately the requirements for accuracy in position or velocity. Accuracy requirements are specified as 2 sigma, or 95%, meaning that 95% of the time the accuracy shall be better than that specified for each NAC value in the tables. Table 4 contains the integrity requirement, which is the probability that the target will exceed a predetermined containment radius. Table 5 contains a quality indicator that relates to aircraft barometric altimetry system performance.
A good discussion and definition of Required Navigation Performance (RNP) procedures may be found in the following documents, all of which are incorporated herein by reference
http://www.aviationmanuals.com/articles/article3.html
www.boeing.com/commercial/caft/reference/documents/RNP082400S.pdf
www.icao.int/anb/panels/acp/WG/M/M8wp/WP/WP806-ATT4.doc
http://adsb.tc.faa.gov/RFG/ADS-B-NRA%20SPR-INTEROP%20_ED-126—%20v1.0.pdf
ED-126 contains an assessment of ADS-B to Secondary Surveillance Radar (SSR) target separation requirements, and results of risk evaluations are shown in Table 6 and Table 7 from the EUROCAE document. As in the case of long range SSR to SSR separation, the relatively wide cross-range radar error distribution limits ADS-B effectiveness in supporting the above minimum required separation values of 2.9 NM or 4.2 NM.
Assurance that ADS-B based surveillance risk is at least as good as that of radar when separating ADS-B targets from radar targets requires defining ADS-B requirements so they are at least the Close Approach Probability (CAP) level obtained for radar to radar 5 NM separation. Using conservative values of NACp=6 and NIC=4 for ADS-B performance, and defining the radar cross-range error distribution, we get the results (Ccax where “x” is “s” or “w” depending on the Gaussian or wide angle error model) plotted in FIG. 1 in comparison to the reference values (Pcax) for SSR to SSR separation. Although ADS-B provides improved capability over the SSR baseline for the Gaussian SSR case, the SSR wide-angle errors at long ranges for the alternate assumption limit the incremental effectiveness of ADS-B in this case.
As defined by ED 126, the Close Approach Probability (CAP) is the probability that, when the surveillance positions of two aircraft appear to be separated by a distance S, their true separation is actually within a distance A (the size of an aircraft and typically 200 ft is used). The CAP is calculated from the assumed surveillance error distribution function (i.e. from the probability density function of the errors). In the case of radar, the position error distribution is taken for azimuth errors (cross-range errors) projected at the limit of the range of applicability of the separation minima (S). Ideally, the error distribution is determined from the analysis of real radar measurements. Note that this error distribution is for the normal operation of the radar in its particular environment with no radar equipment fault conditions (but including the tail errors caused by environmental effects). It is assumed that all the radar errors in the distribution are undetected by the radar.
If the position error distribution of a new surveillance system is known (from measurements and/or analytical predictions) then the surveillance risk can be calculated and compared to the reference radar system. Also, the surveillance risk between an aircraft position measured by existing radar and another measured by the new source of surveillance can be calculated.
In the case of (Automatic Dependent Surveillance, Broadcast) ADS-B, a quality indicator will qualify the expected accuracy of the ADS-B reported position and some integrity checking of the position is expected in conjunction. However, there may be some probability of not detecting position errors outside certain bounds and these errors will contribute to the overall undetected ADS-B position error distribution.
The above analyses show differences in SSR and ADS-B performance and essentially compare the performance metrics from both systems, which have quite different error mechanisms. The same type of analysis could be applied to multilateration and scenarios could be presented for comparing multilateration to SSR and ADS-B, as well as other technologies.
If ADS-B is to supplant SSR as a primary source of aircraft surveillance, some sort of a back-up and/or validation may be required. Many air traffic authorities recognize the need for a back-up to ADS-B and it is becoming a more common theme in aviation conferences worldwide, for example at ATCA conferences (www.ATCA.org), Maastricht ATC conferences (www.atcmaastricht.com), and Helios conferences and seminars (www.helios-is.com), all of which are incorporated herein by reference.
Surveillance alternatives generally considered for application as a back-up to ADS-B include:

    
    
        Multilateration
        Primary radar
        Secondary Surveillance Radar (SSR)
        Passive SSR
        Passive Primary Radar
        Other techniques including ADS-B angle of arrival from phase measurements (e.g., multi-sector antennas).
    
    


While aviation authorities worldwide discuss the idea of a back-up as redundant forms of surveillance, or as interoperable forms of surveillance, there is no existing methodology to combine the different sources of surveillance into an overall surveillance service with a common set of performance metrics. For example, in the United States, the Federal Aviation Administration (FAA) has revealed ambitious plans to commence with a national ADS-B program (www.faa.gov). The FAA is interested in back-up surveillance, and will currently consider performance-based approaches, which are not technology specific. However, in the Prior Art, there exists no methodology to combine data from different surveillance sources, based on the categorized quality of data
SSR and ADS-B have different methodologies for tracking aircraft. However, as noted above, performance metrics for ADS-B have been established such that the accuracy and integrity of an ADS-B system can be readily determined. Back-up methodologies may require similar accuracy and integrity standards. However, again, since the methodologies differ in their underlying technology, creating equivalent metrics for monitoring such back-up systems may be difficult. Thus, it remains a requirement in the art to provide a system and method for monitoring and measuring metrics of a back-up methodology such as multilateration and presenting such metrics in the same or similar terms as ADS-B metrics.
SUMMARY OF THE INVENTION
In the present invention, ADS-B is used as the preferred primary means of surveillance with multilateration as the secondary, or a back-up means of surveillance. An aircraft transmits various transponder-based or other signals, including ADS-B signals, which may be 1090 MHz or other frequencies. These signals are received at multiple ground stations, some of which may be ADS-B stations or both ADS-B and multilateration stations.
ADS-B signals may contain all of the performance metrics, Navigation Accuracy Category (NAC), Navigation Integrity Category (NIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), which are passed on from ADS-B station to an ADS-B processor. The ADS-B processor then outputs aircraft-derived metrics NIC, NAC, SIL, BAQ. ADS-B signals and all other transponder signals are also received at all ground stations, time-stamped, and sent to a multilateration processor. The multilateration processor may then generate Surveillance Integrity Category (SIC), Surveillance Integrity Level (SIL) and pass on Barometric Altitude Quality (BAQ) information.
Therefore two streams of information are passed onto ATC system processor containing the ADS-B aircraft-derived metrics NIC, NAC, SIL, BAQ and the multilateration-derived metrics SIC, SAC, SIL, and BAQ. The ATC system processor may then be configured to pass along both sets of messages to the ATC system, or to select a combination or fusion of the best metrics and tracking information for an aircraft.
The performance of ADS-B as discussed above is determined by the performance of the navigation system (e.g., GNSS, GPS) and other on board aircraft sensors, whereas the performance of the surveillance system is dependent upon the ground-based infrastructure, such as SSR, Radar or multilateration. Thus, performance of the surveillance system is not dependent upon aircraft mounted hardware, which is not within the control of the airport operator or other user. As the two systems rely upon different hardware, one makes a good back-up for the other. However, since the technologies used are different in nature, comparing the metrics (performance parameters, accuracy, and the like) can be difficult. The present invention solves this problem by providing comparable metrics for both systems. Thus, an ATC system can evaluate the metrics of both systems and determine which is the more accurate of the two, or detect errors in a particular system.



BRIEF DESCRIPTION OF THE DRAWINGS AND TABLES
Table 1 lists NIC values from 0 to 1 for a broad range of applications, ranging from lowest integrity (0) to highest integrity (1).
Table 2 lists NAC values from lowest accuracy applications to highest application applications (i.e., LAAS or precision landing).
Table 3 lists the NAC values in velocity.
Table 4 defines the integrity levels, which are the probability that the target will exceed a predetermined containment radius.
Table 5 contains a quality indicator that relates to the aircraft's barometric altimetry system performance.
Table 6 tabulates the results of risk evaluations from an assessment of ADS-B to Secondary Surveillance Radar (SSR) target separation requirements.
Table 7 tabulates the results of risk evaluations from an assessment of ADS-B to Secondary Surveillance Radar (SSR) target separation requirements.
Table 8 illustrates ADS-B supplemented with Multilateration.
Table 9 summarizes the requirements along with the linear values based on distance for Radar Performance accuracy specified for the FAA's newest Radar system the Air Traffic Control Beacon Interrogator model six (ATCBI-6).
Table 10 summarizes results of a performance assessment was made of the Ohio Valley multilateration configuration.
Table 11 summarizes the results for both terminal and en route applications, comparing the requirements for each application to actual MANLAT performance.
FIG. 1 is a plot, using conservative values of NACp=6 and NIC=4 for ADS-B performance, and defining the radar cross-range error distribution, of Close Approach Probability (Ccax where “x” is “s” or “w” depending on the Gaussian or wide angle error model) plotted in in comparison to the reference values (Pcax) for SSR to SSR separation.
FIG. 2 is a block diagram illustrating the methodology of the present invention using ADS-B as the preferred primary means of surveillance with multilateration as the secondary, or as a back-up means of surveillance.
FIG. 3 indicates jet routes above 18,000 feet in the example area in the Ohio Valley where the en route coverage area is approximately 125,000 square miles.
FIG. 4 is a diagram illustrating predicted accuracy at 18,000 feet with the geometry from the existing sensor layout, with one sensor failed in each airport system, or a total of 4 failed sensors.
FIG. 5 is a diagram illustrating predicted accuracy at a 4,000 ft altitude for terminal operations, showing 60 mile radius required coverage in each of the four airport terminal areas.
FIG. 6 illustrates the calculated DOP calculations for the geometry of the solution at 20,000 feet showing the accuracy of the surveillance solution.
FIG. 7 illustrates the calculated DOP calculations for the geometry of the solution at 10,000 feet showing the accuracy of the surveillance solution.



DETAILED DESCRIPTION OF THE INVENTION
In the Prior Art, ADS-B metrics are based on aircraft reporting of quality due in large part to the aircraft-determined quality of the navigation sources, hence the use of “N” for navigation integrity and accuracy metrics. The surveillance-based approach of the present invention does not rely upon on-board aircraft navigation information (e.g., GPS, inertial navigation, or the like), and would therefore be separate and independent from that data. To distinguish the different sources it may be useful to consider different nomenclature, such as “S” for surveillance-derived metrics, as indicated in Table 8, which illustrates ADS-B supplemented with Multilateration.
FIG. 2 is a block diagram illustrating the methodology of the present invention using ADS-B as the preferred primary means of surveillance with multilateration as the secondary, or a back-up means of surveillance. Aircraft 100 transmits various transponder-based or other signals 110, including ADS-B signals, which may be 1090 MHz or other frequencies. Signals 110 are received at multiple ground stations, some of which may be ADS-B stations 210 or both ADS-B and multilateration stations 200.
ADS-B signals 110 may contain all of the performance metrics, Navigation Accuracy Category (NAC), Navigation Integrity Category (NIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), which are passed on 260 from ADS-B station 210 to ADS-B processor 300. ADS-B processor then outputs aircraft-derived metrics NIC, NAC, SIL, and BAQ 350. ADS-B signals 110 and all other transponder signals are also received at all ground stations 200, 210, time-stamped, and sent 250 to multilateration processor 310. Multilateration processor 310 may then generate SIC, SAC, SIL, and pass on BAQ information 360.
Therefore two streams of information are passed onto ATC system processor 400 containing the ADS-B aircraft-derived metrics NIC, NAC, SIL, and BAQ 350 and the multilateration-derived metrics SIC, SAC, SIL, and BAQ 360.
ATC system processor 400 may then be configured to pass along both sets of messages 410 to the ATC system, or to select a combination or fusion of the best metrics and tracking information for aircraft 110.
The performance of ADS-B as discussed above is determined by the performance of the navigation system (e.g., GNSS, GPS) and other on board aircraft sensors, whereas the performance of the surveillance system is dependent upon the ground-based infrastructure, such as SSR, Radar or multilateration. Thus, performance of the surveillance system is not dependent upon aircraft mounted hardware, which is not within the control of the airport operator or other user. As the two systems rely upon different hardware, one makes a good back-up for the other. However, since the technologies used are different in nature, comparing the metrics (performance parameters, accuracy, and the like) can be difficult. The present invention solves this problem by providing comparable metrics for both systems. Thus, an ATC system can evaluate the metrics of both systems and determine which is the more accurate of the two, or detect errors in a particular system. The alternate surveillance data metrics also allow determination of appropriate aircraft separation criteria to be applied.
Radar Performance accuracy specified for the FAA's newest Radar system the Air Traffic Control Beacon Interrogator model six (ATCBI-6), contained in FAA ACTBI-6 Specification, FAA-E-2923, Sep. 10, 1997, incorporated herein by reference, is as follows. Range Accuracy is defined as a Range Bias of +30 ft, and a Range Jitter Standard Deviation (SD) of 25 ft. Azimuth Accuracy is defined as a Bias of +0.033 degrees, and a Jitter SD of 0.066 degrees. The requirements are summarized in Table 9, along with the linear values based on distance. Terminal area accuracy is based on 60 NM, and en route accuracy is based on 250 NM. The RMS values are determined based on summing the bias and jitter as follows:

RMS=Bias+2×SD  (1)

The azimuth RMS accuracy is 0.165 deg, the same as specified for the Airport Surveillance Radar, Model 9 (ASR-9), and close to the Air Route Surveillance Radar, Model 3 and Model 4 (ARSR-3 and ARSR-4) requirements as contained in National Airspace System Specification—NAS-SS-1000, FAA, May 1993, all of which are incorporated herein by reference. The azimuth accuracy, converted to a linear value may be used as the minimum requirement to be applied to Wide Area Multilateration (WAMLAT). Based on this, the accuracy requirements for a back-up surveillance system may be +320 nm for terminal area and +1333 m for en route surveillance.
The minimum update rates are 4.8 seconds for terminal area and 12 seconds for en route. The update requirements also include a minimum probability of detection. For the ATCBI-6 this is specified to be 98%. The ACTBI-6 specification specifies the rate of false target detection to be less than 1 in 400. The ADS-B standards are defined such that the probability of an undetected error in a single report is less than 10-6 per message, as specified in DO-242A, Minimum Aviation System Performance Standards for ADS-B, RTCA, Jun. 25, 2002, incorporated herein by reference. Since multilateration is considered to be a backup to ADS-B the latter should be a goal as the integrity requirement.
Availability requirements are specified by the FAA for individual surveillance systems, and are also defined in the overall NAS specification. For terminal area surveillance the most relevant requirements are for the ATCBI-6 and the Mode-S, both of which are specified to be 0.99995. For en route surveillance the most relevant requirements are for the ARSR-3 and ARSR-4, both of which are specified to be 0.9997.
Multilateration performance also needs to be quantified to compare the accuracy with Prior Art surveillance systems. By way of an example, an assessment is made of the potential coverage and accuracy available from multilateration systems implemented by Rannoch Corporation, assignee of the present application. Rannoch has many systems deployed world-wide for a variety of applications including military, commercial, and air traffic control, and in certain areas in the United States there are multiple systems that may be considered as part of a regional network.
The example shown in FIG. 3 is from the Ohio Valley, where there are four systems implemented at Louisville International Airport, Ohio State University, Cincinnati Lunken Municipal Airport, and Indianapolis International Airport. Each system is made up of five sensors, where one is on-airfield and four are off-airfield. When combined together, a wide area regional network of 20 sensors can be considered from this particular example.
It should be noted that the four systems are sited to provide terminal area coverage, and are not optimized for en route surveillance over longer distances. Nevertheless this analysis will show the possible performance for en route surveillance, even when ground system sites are not necessarily at optimum locations for en route coverage.
Coverage is met when the required accuracy is sufficient. FIG. 3 indicates jet routes above 18,000 feet, and the en route coverage area is approximately 125,000 square miles. With the geometry from the existing sensor layout, the predicted accuracy at 18,000 feet altitude is shown in FIG. 4. This performance is calculated with one sensor failed in each airport system, or a total of 4 failed sensors. This is one assumption used in the availability assessment. FIG. 5 shows predicted accuracy at a 4,000 ft altitude for terminal operations, showing a 60 mile radius required coverage in each of the four airport terminal areas. Again, the multilateration network is estimated to meet or exceed required surveillance accuracy throughout these areas.
System update rate is a function of the number of sensors in a coverage zone and probability of reception for each multilateration receiver. An update typically requires that three sensors receive and successfully decode the aircraft transponder transmissions. For Mode S transponders a conservative analysis would assume that only squitters, nominally transmitted once per second, are available for multilateration. A performance assessment was made of the Ohio Valley multilateration configuration. The results are shown in Table 10.
The results in Table 10 show that the multilateration system easily meets the required update rates for both terminal and en route coverage. The reason for the significant margin is that multilateration typically achieves good update performance within one second, while the terminal and en route requirements are 4.8 seconds and 12 seconds, respectively. Both regions were evaluated with a five second update. It was also assumed that one sensor in each airport system could be failed while still meeting the update requirements.
As previously indicated, the goal for multilateration should be the ADS-B message integrity, which is a probability of an undetected error less than 10-6 per message. This is allocated to two different requirements related to multilateration—false target detection and false identification. Both are integrity related parameters. Achieving a low probability of false target detection is a function of proper sensor location and processing techniques to detect erroneous measurements. These ensure that the probability of false target detection is less than 10-6 per update. The likelihood of false identification is minimized in a similar manner. A primary element here is the use of 24-bit parity for Mode S transmissions, which ensures that the probability of an undetected error is less than 10-7 per message.
Multilateration availability is a function of the reliability and level of redundancy, both in the central processing equipment and the sensors. For this assessment it was assumed that the central processing equipment has dual redundancy. The sensor configuration is such that a minimum of one sensor can fail in each airport system, without affecting performance. Another key assumption in assessing availability is the repair time following a failure. Typically this is assumed to be 0.5 hours for operational NAS systems. For this analysis it was assumed to be 8 hours, taking into account the system is a back-up and therefore should not require immediate repair. The results in Table 11 indicate that multilateration easily meets the requirements for both terminal and en route surveillance. As indicated in the discussion of the availability requirement, it is possible that a back-up system could have reduced availability. If that were the case the tradeoff could be made between the repair time following failures and overall availability, which would minimize the maintenance costs of the back-up system.
As previously noted, RTCA standards define the Figures of Merit or quality indicators for the system. When DO 260 was revised as 260A, NUC was specified in terms of NIC, NAC and SIL. Navigation Accuracy Category (NAC) is reported so that the surveillance application may determine whether the reported position has an acceptable level of accuracy for the intended application. In other words, the accuracy is based on the quality of the navigation information available to the aircraft, whether it is based on ground-based navigational aids or satellite systems.
For a ground-based equivalent, the following example of a wide area multilateration system is provided, using a distributed site across the Taiwan Strait from Kinmen Island to Peng Hu Island. If this ground-based infrastructure were to be used as an alternative or supplement to the aircraft's reported navigation position, the determining factor for accuracy (surveillance or navigation) is Dilution of Precision (or DOP as it is commonly called in satellite navigation). For the example here, a number of sensors were installed on the two islands across the Taiwan Strait. Six sensors were located at Kinmen Island (with two ATC centers) in the North East and two sensors were located on Peng Hu Island in the South West, connected via leased digital lines to Kinmen Island.
FIGS. 7 and 8 illustrate the calculated DOP calculations for the geometry of the solution at 20,000 feet and 10,000 feet, respectively, showing the accuracy of the surveillance solution is shown as <25 meters, 25-100 meters, 100-320 meters, and so on. This is an example of the use of surveillance from a ground-based infrastructure that may be used in lieu of an aircraft's reported navigation quality. As illustrated in FIGS. 7 and 8, the accuracy in the primary area of interest (between the two islands, where flight and approach paths are most common) is within 25 meters at both altitude levels. Accuracy outside of these areas drops off, however since these areas are not within the primary approach paths, increased accuracy may not be required. Increased accuracy could be easily obtained by adding additional sensors at other islands or even on floating buoys.
While the preferred embodiment and various alternative embodiments of the invention have been disclosed and described in detail herein, it may be apparent to those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope thereof.

## Claims

1. A system for measuring and monitoring performance metrics of a non-ADS-B tracking system and generating performance metrics for the non-ADS-B tracking system in terms of ADS-B equivalent performance metrics, the system comprising:
a plurality of ground station receivers for receiving from a vehicle, signals including ADS-B signals, the plurality of ground station receivers comprising at ADS-B stations, and alternate tracking system stations;
an ADS-B processor, coupled to at least a portion of the plurality of ground stations, for deriving aircraft-derived ADS-B metrics from the ADS-B signals;
an alternate tracking system processor, coupled to at least a portion of the plurality of ground stations for receiving tracking data from the alternate tracking system stations, determining vehicle position from the tracking data to generate an alternate tracking system vehicle position, and generating metrics from the alternate tracking system vehicle position in equivalent ADS-B metrics formats; and
a system processor for receiving ADS-B metrics from the ADS-B processor and alternate tracking system metrics from the alternate tracking system processor, the system processor performing at least one of selecting and fusing tracking data based upon the ADS-B and alternate tracking system metrics.

2. The system of claim 1, wherein the alternate tracking system stations comprise combined ADS-B and alternate tracking system stations.

3. The system of claim 2, wherein the system processor is an Air Traffic Control (ATC) system processor.

4. The system of claim 3, wherein the ATC system processor evaluates metrics of both ADS-B and the alternate tracking systems and determines which is the more accurate of the two, and detects errors in one of the ADS-B and alternate tracking systems.

5. The system of claim 4, wherein the ATC system applies alternate surveillance data metrics to determine appropriate aircraft separation criteria.

6. The system of claim 3, wherein the ADS-B signals contain at least one or more of performance metrics, Navigation Accuracy Category (NAC), Navigation Integrity Category (NIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), which is passed on from the ADS-B stations to an ADS-B processor.

7. The system of claim 6, wherein the ADS-B processor outputs at least one or more of aircraft-derived metrics NIC, NAC, SIL, and BAQ to the ATC processor.

8. The system of claim 7, wherein the alternate tracking system processor generates at least one or more of Surveillance Integrity Category (SIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), metrics information.

9. The system of claim 8, wherein the alternate tracking system processor outputs at least one or more of surveillance-derived metrics SIC, SIL, and BAQ to the ATC processor.

10. The system of claim 1, wherein the alternate tracking system includes one or more of multilateration, primary radar, secondary Surveillance Radar (SSR), Passive SSR, Passive primary radar, ADS-B angle of arrival from phase measurements.

11. A method for measuring and monitoring performance metrics of a non-ADS-B tracking system and generating performance metrics for the non-ADS-B tracking system in terms of ADS-B equivalent performance metrics, the method comprising the steps of:
receiving in a plurality of ground station receivers, signals from a vehicle including ADS-B signals, the plurality of ground station receivers comprising at ADS-B stations, and alternate tracking system stations;
deriving, in an ADS-B processor, coupled to at least a portion of the plurality of ground stations, aircraft-derived ADS-B metrics from the ADS-B signals;
receiving tracking data from the alternate tracking system stations and determining vehicle position from the tracking data in an alternate tracking system processor, coupled to at least a portion of the plurality of ground stations, generating an alternate tracking system vehicle position, and generating metrics from the alternate tracking system vehicle position in equivalent ADS-B metrics formats; and
receiving, in a system processor, ADS-B metrics from the ADS-B processor and alternate tracking system metrics from the alternate tracking system processor, the system processor performing at least one of selecting and fusing tracking data based upon the ADS-B and alternate tracking system metrics.

12. The method of claim 11, wherein the alternate tracking system stations comprise combined ADS-B and alternate tracking system stations.

13. The method of claim 12, wherein the system processor is an Air Traffic Control (ATC) system processor.

14. The method of claim 13, wherein the ATC system processor evaluates metrics of both ADS-B and the alternate tracking systems and determines which is the more accurate of the two, and detects errors in one of the ADS-B and alternate tracking systems.

15. The method of claim 14, wherein the ATC system applies alternate surveillance data metrics to determine appropriate aircraft separation criteria.

16. The method of claim 13, wherein the ADS-B signals contain at least one or more of performance metrics, Navigation Accuracy Category (NAC), Navigation Integrity Category (NIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), which is passed on from the ADS-B stations to an ADS-B processor.

17. The method of claim 16, wherein the ADS-B processor outputs at least one or more of aircraft-derived metrics NIC, NAC, SIL, and BAQ to the ATC processor.

18. The method of claim 17, wherein the alternate tracking system processor generates at least one or more of Surveillance Integrity Category (SIC), Surveillance Integrity Level (SIL) and Barometric Altitude Quality (BAQ), metrics information.

19. The method of claim 18, wherein the alternate tracking system processor outputs at least one or more of surveillance-derived metrics SIC, SIL, and BAQ to the ATC processor.

20. The method of claim 11, wherein the alternate tracking system includes one or more of multilateration, primary radar, secondary Surveillance Radar (SSR), Passive SSR, Passive primary radar, ADS-B angle of arrival from phase measurements.