August 20, 2001

Campbell

**08/17/01 CR Reroute Advisory Team Test Summary**

**[Participants]{.underline}**

Roger Beatty/AAL (in Dallas)

Keith Campbell/Mitre (at ATCSCC)

Ed Gannon/ATCSCC/NATCA (at ATCSCC)

Ed is a Severe Weather specialist and is intimately familiar with the
advisories and the ETMS system. His participation was a major
contribution.

**[Introduction and Objectives]{.underline}**

Friday's test was an initial sanity check from an operational point of
view. We took current advisories, converted them to the structured
format and generated flight lists using ETMS. The goals were to make
sure we could actually produce the information needed and to see if the
ETMS data was close enough to user data to be usable.

Key questions were:

1)  Do the structured advisories reflect the specialist's original
    intent?

2)  Is conversion to the structured format straightforward?

3)  Can we generate a flight list that reflects the advisory from the
    specialist's veiwpoint?

4)  Does the flight list match the flights a user would identify after
    reading the current advisory?

**[Summary of Results]{.underline}**

The test covered full evaluation of three reroute advisories. The test
was successful on all counts. Conversion of advisories to the structured
format and list generation (still manual at this stage) was
straightforward and did capture the intent of the advisories from the
specialist's point of view.

In two of the three cases, the ETMS list matched Roger's list with minor
exceptions that were not just acceptable but useful to Roger (more
details are below).

In the third case, the lists were completely different because Roger's
interpretation of the original advisory was different than Ed's intent.
The structured advisory and the list eliminated the ambiguity that led
to the mis-interpretation, so this third case was the biggest success of
all.

During the course of the test Ed and Keith also identified several minor
changes to the structured format to reduce workload and simplify entry.

**[Test procedure]{.underline}**

1)  Identify a suitable test advisory (Ed/Keith)

2)  Identify changes to time period or city pairs that will lead to a
    better test list (Ed/Keith)

3)  Communicate the test advisory to Roger (All)

4)  Convert the test advisory into the structured format (Ed/Keith)

5)  Generate a corresponding flight list using ETMS (Ed)

6)  Print and fax the original advisory, structured advisory, and flight
    list to Roger (Ed)

7)  User interprets the original advisory and identifies the impacted
    AAL flights based on his flight data and interpretation while Ed and
    Keith do steps 4,5,6 (Roger)

8)  Comparison of ETMS list to user list and identification of reasons
    for differences (Roger)

9)  Discussion of results (All)

**[Test Advisories]{.underline}**

Sample advisories used in the test are given below, as well as Roger's
findings in matching the lists. Unfortunately only hard copies of the
structured version and lists are available from the test, so they are
not included.

**[Test Advisory 1 (Washington Metro)]{.underline}**

(Original Advisory)

ATCSCC ADVZY 013 DCC 08/17/2001 WASHINGTON METRO ARRIVALS

REASON: FIX BALANCE (THIS SUSPENDS NRP DEPARTURES FROM

ZKC/ZME/ZFW/ZHU TO THE WASHINGTON METRO AIRPORTS, OTHER NRP FLIGHTS TO
DC METRO AREA OVER BKW/HVQ RESTRICTED TO THE ROUTES BELOW)

ASSIGNED REROUTE: DC METRO AREA ARRIVALS CAN EXPECT:

FROM/THRU ZKC (NORMALLY FILED OVER HVQ OR BKW) VIA:

\...ENL OR STL IIU J8 HVQ JASEN2 IAD

\...ENL OR STL IIU J526 BKW J147 CSN OTT5 BWI

\...ENL OR STL IIU J526 BKW FINKS6 DCA/ADW

ZOA/ZLA/ZAB/ZSE/ZLC/ZDV - ENSURE THAT NO DIRECTS ARE ISSUED PAST

FIRST POINT IN ZKC.

FROM ZME\...J42 BNA HVQ JASEN2 IAD

\...J42 BKW J147 CSN OTT5 BWI

\...J42 BKW FINKS6 DCA/ADW

FROM ZFW\...J52 ATL J14 CREWE J51 FAK COATT4 IAD

\...J42 BKW J147 CSN OTT5 BWI

\...J42 BKW FINKS6 DCA/ADW

FROM ZHU\...PREF ROUTES OVER ATL

FACILITIES INCLUDED: ZDC/ZID/ZKC/ZME/ZFW

VALID: FOR ARRIVALS SCHEDULED TO DC METROS FROM 1830-2130 DAILY.

EFFECTIVE TIME: 170915 - 172130

(Structured Version)

TITLE: WASHINGTON METRO ARRIVALS ADVZY: 13 SOURCE: DCC DATE: 08/18/2001

REASON: FIX BALANCE (THIS SUSPENDS NRP DEPARTURES FROM ZKC/ZME/ZFW/ZHU
TO THE WASHINGTON METRO AIRPORTS, OTHER NRP FLIGHTS TO DC METRO AREA
OVER BKW/HVQ RESTRICTED TO THE ROUTES BELOW)

FLOW: FROM:ZKC TO:IAD/BWI/DCA/ADW ETA BETWEEN: 08181830 AND 08182130

ASSIGNED REROUTE: \...ENL OR STL IIU J8 HVQ JASEN2 IAD

\...ENL OR STL IIU J526 BKW J147 CSN OTT5 BWI

\...ENL OR STL IIU J526 BKW FINKS6 DCA/ADW

FLOW: THRU: ZKC TO: IAD/BWI/DCA/ADW ETA BETWEEN: 08181830Z AND 08182130Z

ASSIGNED REROUTE: \...ENL OR STL IIU J8 HVQ JASEN2 IAD

\...ENL OR STL IIU J526 BKW J147 CSN OTT5 BWI

\...ENL OR STL IIU J526 BKW FINKS6 DCA/ADW

FLOW: FROM: ZME TO: IAD/BWI/DCA/ADW ETA BETWEEN: 08181830Z AND 08182130Z

ASSIGNED REROUTE: \...J42 BNA HVQ JASEN2 IAD

\...J42 BKW J147 CSN OTT5 BWI

\...J42 BKW FINKS6 DCA/ADW

FLOW: FROM: ZFW TO: IAD/BWI/DCA/ADW ETA BETWEEN: 08181830Z AND 08182130Z

ASSIGNED REROUTE: \...J52 ATL J14 CREWE J51 FAK COATT4 IAD

\...J42 BKW J147 CSN OTT5 BWI

\...J42 BKW FINKS6 DCA/ADW

FLOW: FROM: ZHU TO: IAD/BWI/DCA/ADW ETA BETWEEN: 08181830Z AND 08182130Z

ASSIGNED REROUTE: PREF ROUTES OVER ATL

FACILITIES INCLUDED: ZDC/ZID/ZKC/ZME/ZFW

REMARKS: ZOA/ZLA/ZAB/ZSE/ZLC/ZDV - ENSURE THAT NO DIRECTS ARE ISSUED
PAST FIRST POINT IN ZKC.

VALID: FOR ARRIVALS SCHEDULED TO DC METROS FROM 1830-2130 DAILY.

(Findings)

The ETMS list produced only a small number of AAL flights. The list
matched Roger's AAL list with the exception of one flight that appeared
on the ETMS list but not on Roger's list. This flight had been scheduled
to depart prior to the start of the advisory period, but was delayed
into the 0915-2130 window. Although the ATCSCC intended such flights to
be included, the current text makes this a matter of interpretation. The
structured version makes clear that delayed flights are also included.

**[Test Advisory 2, DFW to SAT/AUS/IAH/HOU (#41)]{.underline}**

(Original Advisory)

ATCSCC ADVZY 041 DCC 08/17/2001 REROUTE ADVISORY

IMPACTED AREA: ZFW

REASON: THUNDERSTORMS/ACFT DEVIATIONS

ASSIGNED REROUTE: DFW DEPARTURES SOUTH TO SAT/AUS/IAH CAN EXPECT:

SJT JCT SAT/AUS (CAPPED AOB FL270)

SJT LLO IAH/HOU

FACILITIES INCLUDED: ZFW ZHU

VALID UNTIL: 1800

PROBABILITY OF EXTENSION: MODERATE

SVRWX/GH

EFFECTIVE TIME: 171520 - 171800

(Structured Version)

ATCSCC ADVZY 041 DCC 08/17/2001 REROUTE ADVISORY

IMPACTED AREA: ZFW

REASON: THUNDERSTORMS/ACFT DEVIATIONS

FLOW: FROM: DFW TO: SAT/AUS/IAH/HOU

ETD BETWEEN: 171520 AND 171800

ASSIGNED REROUTE: SJT JCT SAT/AUS (CAPPED AOB FL270)

SJT LLO IAH/HOU

FACILITIES INCLUDED: ZFW ZHU

VALID UNTIL: 1800

PROBABILITY OF EXTENSION: MODERATE

SVRWX/GH

EFFECTIVE TIME: 171520 - 171800

(Findings)

The ETMS list produced only a small number of AAL flights. The list
matched Roger's AAL list with the exception of one flight that appeared
on the ETMS list but not on Roger's list. This flight had been scheduled
to depart prior to the start of the advisory period, but was delayed
into the 0915-2130 window. Although the ATCSCC intended such flights to
be included, the current text makes this a matter of interpretation. The
structured version makes clear that delayed flights are also included.

**[Test Advisory 3 Modified #35 ZLA/ZAB to DFW]{.underline}**

For test purposes we changed the time window to 18-22z.

(Original advisory)

ATCSCC ADVZY 035 DCC 08/17/2001 ROUTE ADVISORY

IMPACTED AREA: DFW ARRIVALS FROM ZLA/ZAB

REASON: TSTMS

ASSIGNED REROUTE: LA BASIN/TUS/PHX DEPTS EXECT:

..EWM INK JEN5 DFW

FACILITIES INCLUDED: ZLA/ZAB/ZFW

VALID UNTIL: 1800Z

PROBABILITY OF EXTENSION: LOW

REMARKS: LAS/ABQ DEPTS WILL BE LEFT ON ROUTES OVER TXO AND

ALLOWED TO DEVIATE FOR AS LONG AS REASIBLE.

ASSOCIATED RESTRICTIONS: 20 MIT ZLA

10 MIT ZAB

EFFECTIVE TIME: 171800 - 172200

(Structured Version)

ATCSCC ADVZY 035 DCC 08/17/2001 ROUTE ADVISORY

IMPACTED AREA: DFW ARRIVALS FROM ZLA/ZAB

REASON: TSTMS

FLOW: FROM:ZLA/ZAB TO:DFW

ETA BETWEEN: 171800 AND 172200

ASSIGNED REROUTE: ..EWM INK JEN5 DFW

FACILITIES INCLUDED: ZLA/ZAB/ZFW

VALID UNTIL: 1800Z

PROBABILITY OF EXTENSION: LOW

REMARKS: LAS/ABQ DEPTS WILL BE LEFT ON ROUTES OVER TXO AND

ALLOWED TO DEVIATE FOR AS LONG AS REASIBLE.

ASSOCIATED RESTRICTIONS: 20 MIT ZLA

10 MIT ZAB

EFFECTIVE TIME: 171800 - 172200

(Findings)

The mismatch between the ETMS flight list and Roger's flight list was
near 100%. Why? ATCSCC intended the time window to apply to arrival
times. Roger interpreted the times as departure times, which led to a
completely different set of flights. The structured advisory specifies
'ETA' are used to select the impacted flights to eliminate ambiguity
about the time window.

(Note also that the ambiguous 'LA Basin' is converted to the unambiguous
'ZLA')

**[Next Steps]{.underline}**

[Evaluation of complex playbook advisories]{.underline}

Ed identified several particularly complex elements in certain playbook
plays that require special consideration. Ed and Keith will construct
structured versions of these plays to ensure the structured version is
clear and not too cumbersome.

[FAA facility initial operational evaluation]{.underline}

The initial test provided a sanity check of the RAT concept by an ATCSCC
specialist and an airline user. A similar check is still needed by an
FAA facility representative.

[Coordination with ATCSCC Procedures group]{.underline}

Procedures will need to identify any procedural and training issues
created by the RAT initiative. They also manage much of the coordination
with NATCA from an ATCSCC perspective.

[Briefing to ETMS development community (Vomacka, Volpe)]{.underline}

Chuck Vomacka has identified a path for implementation of RAT proposals
within the ETMS system, but has also emphasized the need for clear and
detailed description of the proposals as soon as possible in order to
provide the new functionality by Spring/Summer 2002.