Patent Description:
Embodiments of the subject matter described herein relate generally to systems and methods for receiving ATC instructions. More particularly, embodiments of the subject matter relate to systems and methods for selectively providing ATC instructions to flight crew members on demand.

During a flight, a lot of messages may be exchanged between aircraft flight crews and ATC. The messages may be related to traffic avoidance, weather avoidance, route enhancement, advisory/caution indications, or other matters.

Some messages may be related to future maneuvers. Flight crew members may not need to access the messages related to future maneuvers at the time they are conveyed, but at a time when the flight crew is prepared to plan for the maneuver. When provided in advance, the flight crew may need to record or memorize instructions in the ATC message for future use. This can increase flight crew workload.

Hence, it is desirable to provide systems and methods for extracting ATC instructions provided in advance and to allow flight crew to access the instructions on demand. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.

A flight deck system on an aircraft for producing active voice tags as actuatable graphical elements on a flight path displayed on a graphical display unit is disclosed according to claim <NUM>.

A method on an aircraft for producing active voice tags as actuatable graphical elements on a flight path displayed on a graphical display unit is disclosed according to claim <NUM>.

Embodiments of the present disclosure may be described herein in terms of functional and/or logical components and various processing steps. It should be appreciated that such functional and/or logical components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions.

The subject matter described herein discloses apparatus, systems, techniques, and articles for extracting ATC instructions from ATC messages provided in advance and to allow flight crew to access the instructions on demand. The apparatus, systems, techniques, and articles disclosed herein can provide voice tags that can be overlaid a graphical display of an active flight path. The voice tags contain instructions derived from ATC messages that can be dynamically updated based on aircraft state information. The voice tags can be manually actuated by flight crew or automatically actuated upon the aircraft reaching a predetermined location. Use of voice tags can reduce flight crew workload by allowing the flight crew to access ATC instructions when they are needed without having to memorize or record the instructions in advance.

<FIG> is a block diagram depicting an example aircraft environment <NUM> in which relative, active flight, voice tags may be generated for display on a graphic display device and for actuation and use to convey ATC instructions via an aural message upon actuation of a voice tag. The example environment <NUM> includes a voice tag generation system <NUM> that is configured to analyze ATC (air traffic control) instructions and generate therefrom relative voice tags with an associated graphical icon to be displayed on a graphical display of an active flight plan displayed on a cockpit display unit. The graphical icons when actuated (e.g., via selection of the icon from the graphical display unit or automatically when the aircraft reaches a predetermined location) cause their associated relative voice tag to present (e.g., play over a speaker system in the aircraft) an aural message that includes a fixed component and/or a relative component. The fixed component identifies a maneuver (e.g., course change, altitude change, speed change, etc.) to be performed per an ATC instruction, and the relative component identifies how far (e.g., distance or time) the aircraft will travel before performing the ATC mandated instruction.

The example voice tag generation system <NUM> includes an ATC clearance processing module <NUM> and a graphical processing module <NUM>. Each of the ATC clearance processing module <NUM> and the graphical processing module <NUM> includes and is implemented by a processing component such as a controller (e.g., the same or separate controllers). The processing component includes at least one processor and a computer-readable storage device or media (e.g., memory <NUM>) encoded with programming instructions for configuring the processing component. The processor may be any custom-made or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), an auxiliary processor among several processors associated with the processing component, a semiconductor-based microprocessor (in the form of a microchip or chip set), any combination thereof, or generally any device for executing instructions.

The computer readable storage device or media (e.g., memory <NUM>) may include volatile and nonvolatile storage in read-only memory (ROM), random-access memory.

(RAM), and keep-alive memory (KAM), for example. KAM is a persistent or non-volatile memory that may be used to store various operating variables while the processor is powered down. The computer-readable storage device or media may be implemented using any of a number of known memory devices such as PROMs (programmable read-only memory), EPROMs (electrically PROM), EEPROMs (electrically erasable PROM), flash memory, or any other electric, magnetic, optical, or combination memory devices capable of storing data, some of which represent executable programming instructions, used by the processing component.

The example ATC clearance processing module <NUM> is configured to identify one or more specific instructions from a received message <NUM> (e.g., CPDLC or voice) from ATC <NUM> via an onboard radio or VDR <NUM>. To identify a specific instruction from a received message <NUM> from ATC <NUM>, the controller is configured to: separate the received message <NUM> into one or more message segments; for each message segment, correlate the message segment to an instruction type from a rules-set database <NUM>, and retrieve instruction parameters (e.g., instruction execution location and maneuver parameter such as heading change, altitude change, speed change, and others) from the message segment; and generate a specific instruction from the instruction type based on the instruction parameters retrieved from its correlated message segment.

The example graphical processing module <NUM> is configured to determine, for the specific instruction, based on aircraft state data and aircraft flight plan data <NUM>, a location relative to a planned flight path of the aircraft at which the specific instruction should be provided to flight crew; generate, for the specific instruction, a voice message configured to recite the specific instruction (e.g., including a fixed component and/or a relative component); associate with the voice message an actuatable graphical element (e.g., from graphical database <NUM>) that is actuatable to cause the voice message to be provided to flight crew on the aircraft (operation <NUM>); render the actuatable graphical element at or near the determined location on a depiction of the planned flight path that is displayed on the graphical display unit <NUM>; and cause the voice message associated with the actuatable graphical element to be provided as an aural message responsive to actuation of the actuatable graphical element.

To determine the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew, the example graphical processing module <NUM> is configured to: retrieve an instruction execution location from instruction parameters provided in the received message, and translate the instruction execution location to a location relative to the planned flight path of the aircraft.

To generate, for the specific instruction, a voice message configured to recite the specific instruction, the example graphical processing module <NUM> is configured to: identify a voice pattern to use for reciting the specific instruction (e.g., from a voice database <NUM>); and translate the specific instruction into the voice message using the identified voice pattern.

To cause the voice message associated with the actuatable graphical element to be provided the example graphical processing module <NUM> is configured to: determine, based on aircraft state data and aircraft flight plan data <NUM>, a projected time or distance in the future at which the specific instruction should be performed (e.g., the relative component); modify the voice message to include the projected time or distance in the future at which the specific instruction should be performed; and cause the modified voice message with the projected time or distance in the future at which the specific instruction should be performed to be provided as an aural message.

To cause the voice message associated with the actuatable graphical element to be provided, the example graphical processing module <NUM> may be further configured to cause the voice message to be provided as a textual message on a graphic display device.

In some example embodiments, the example graphical processing module <NUM> is further configured to cause the voice message associated with the actuatable graphical element to be automatically provided as an aural message and/or textual message when the controller determines that the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew has been reached.

<FIG> is a process flow chart depicting an example process <NUM> for producing active voice tags on a flight path displayed on a graphical display unit. The order of operation within the process <NUM> is not limited to the sequential execution as illustrated in the figure but may be performed in one or more varying orders as applicable and in accordance with the present disclosure.

The example process <NUM> includes receiving ATC messages from voice or data channels (operation <NUM>) and generating a graphical command to display (operation <NUM>). This can involve identifying one or more specific instructions from a received ATC message, wherein the identifying includes: separating the received message into one or more message segments; correlating, for each message segment, the message segment to an instruction type from a rules-set database <NUM>; retrieving instruction parameters (e.g., instruction execution location and maneuver parameter such as heading change, altitude change, speed change, and others) from the message segment; and generating a specific instruction from the instruction type based on the instruction parameters retrieved from its correlated message segment.

The example process <NUM> includes identifying a voice pattern (operation <NUM>). This can involve identifying a voice pattern from a voice database <NUM> that corresponds to the instruction.

The example process <NUM> includes relative voice tag insertion (operation <NUM>). This can involve determining, for the specific instruction, based on aircraft state data <NUM> and aircraft flight plan data <NUM>, a location relative to a planned flight path of the aircraft at which the specific instruction should be provided to flight crew; generating, for the specific instruction, a voice message configured to recite the specific instruction (e.g., including a fixed component and a relative component); and associating with the voice message an actuatable graphical element that is actuatable to cause the voice message to be provided to flight crew on the aircraft.

The example process <NUM> includes rendering the voice tag on the graphical display (operation <NUM>). This can involve rendering the voice tag (e.g., the actuatable graphical element) at or near the determined location on a depiction of the planned flight path that is displayed on the graphical display unit and causing the voice message associated with the actuatable graphical element to be provided as an aural message responsive to actuation of the actuatable graphical element.

<FIG> is a diagram depicting an example operating scenario with an example graphical display <NUM> of an active flight path <NUM> with a voice tag graphical element <NUM> rendered thereon. In this example, an aircraft icon <NUM> representative of the ownship is depicted on the flight path <NUM> along with a plurality of waypoints (LKV, SUMMA, and PAE) before ending at a runway (13R). The aircraft will receive one or more ATC messages, each of which could be a single or concatenated message. In this example, the aircraft received the following ATC message: "FLY PRESENT HEADING. AT LKV FLY HEADING <NUM>. REPORT PASSING LKV. " In response, an example voice tag generation system generated a relative voice tag graphical element <NUM> and positioned the relative voice tag graphical element <NUM> adjacent to the LKV waypoint on the display of the active flight path <NUM>. The example voice tag generation system also generates a voice message that is associated with the voice tag graphical element <NUM>. The voice message includes a fixed component, the instruction to follow from the ATC message, and a relative component, when relative to the aircraft's current position should the maneuver be performed. Example voice messages the example voice tag generation system may produce include "REACHING LKV IN <NUM> MINS. AFTER <NUM> MINS FLY HEADING <NUM> AND REPORT PASSING LKV" or "<NUM> TO REACH LKV. AFTER <NUM> FLY HEADING <NUM> AND REPORT PASSING LKV" or others. The relative component can be set when the relative voice tag graphical element <NUM> is actuated (e.g., via cursor selection or touch selection).

<FIG> is a diagram depicting an example operating scenario with an example graphical display <NUM> of an active flight path <NUM> with a plurality of voice tag graphical elements <NUM>, <NUM>, <NUM> rendered thereon. In this example, an aircraft icon <NUM> representative of the ownship is depicted on the flight path <NUM> along with a waypoint (KPHX). The aircraft can receive one or more ATC messages, each of which could be a single or concatenated message. In this example, the aircraft received the following ATC message: "MAINTAIN FL <NUM>. AT KPHX CLIMB TO MAINTAIN FL <NUM>. " In response, an example voice tag generation system generated the plurality of relative voice tag graphical elements <NUM>, <NUM>, <NUM> and positioned the relative voice tag graphical elements <NUM>, <NUM>, <NUM> at three locations on the active flight path <NUM>. The example voice tag generation system also generated voice messages that are associated with the voice tag graphical element <NUM>, <NUM>, <NUM>. The voice messages includes a fixed component, the instruction to follow from the ATC message, and/or a relative component, when relative to the aircraft's current position should the maneuver be performed. An example voice message the example voice tag generation system may produce for relative voice tag graphical element <NUM> includes "MAINTAIN ALT <NUM> FOR THE NEXT <NUM> MINS. " An example voice message the example voice tag generation system may produce for relative voice tag graphical element <NUM> includes "REACHING KPHX IN <NUM> MINS. " An example voice message the example voice tag generation system may produce for relative voice tag graphical element <NUM> includes "FLY ALT <NUM> TILL <NUM> AND CLIMB TO FL <NUM>. " The relative component can be set when the relative voice tag graphical element <NUM> is actuated (e.g., via cursor selection or touch selection).

<FIG> is a process flow chart depicting an example process <NUM> for producing active voice tags on a flight path displayed on a graphical display unit. The order of operation within the process <NUM> is not limited to the sequential execution as illustrated in the figure but may be performed in one or more varying orders as applicable and in accordance with the present disclosure.

The example process <NUM> includes identifying a specific instruction from a received message (e.g., CPDLC or voice) from air traffic control (ATC) (operation <NUM>). Identifying the specific instruction from the received message from air traffic control may include separating the received message into one or more message segments; correlating, for each message segment, the message segment to an instruction type from a rules-set database and retrieve instruction parameters from the message segment; and modifying each instruction type to a specific instruction based on the instruction parameters (e.g., instruction execution location, maneuver parameter such as heading, altitude, speed) retrieved from its correlated message segment.

The example process <NUM> includes determining, for the specific instruction, based on aircraft state data and aircraft flight plan data, a location relative to a planned flight path of the aircraft at which the specific instruction should be provided to flight crew (operation <NUM>). Determining the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew may include: retrieving an instruction execution location from instruction parameters provided in the received message; and translating the instruction execution location to a location relative to the planned flight path of the aircraft.

The example process <NUM> includes generating, for the specific instruction, a voice message configured to recite the specific instruction (operation <NUM>). Generating, for the specific instruction, the voice message configured to recite the specific instruction may include: identifying a voice pattern to use for reciting the specific instruction from a voice database; and translating the specific instruction into the voice message using the identified voice pattern.

The example process <NUM> includes associating with the voice message an actuatable graphical element that is actuatable to cause the voice message to be provided to flight crew on the aircraft (operation <NUM>) and rendering the actuatable graphical element at or near the determined location on a depiction of the planned flight path that is displayed on the graphical display unit (operation <NUM>). The generated voice message when actuated via the actuatable graphical element may be configured to recite, based on the determined location, a projected time, distance, or aircraft state in the future at which the specific instruction should be performed. Therefore, when actuated before the aircraft reaches the determined location the generated voice message includes how far (time or distance) before the maneuver is to be performed.

The example process <NUM> includes providing the voice message associated with the actuatable graphical element as an aural message responsive to actuation of the actuatable graphical element (operation <NUM>). Providing the voice message associated with the actuatable graphical element may include: determining, based on aircraft state data and aircraft flight plan data, a projected time or distance in the future at which the specific instruction should be performed; modifying the voice message to include the projected time or distance in the future at which the specific instruction should be performed; and causing the modified voice message with the projected time or distance in the future at which the specific instruction should be performed to be provided as an aural message. In addition to providing an aural message, a textual message may also be provided on a graphic display device.

The example process <NUM> optionally includes automatically providing the voice message associated with the actuatable graphical element as an aural message upon reaching the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew (operation <NUM>).

In one embodiment, a flight deck system on an aircraft for producing active voice tags as actuatable graphical elements on a flight path displayed on a graphical display unit is provided according to claim <NUM>.

These aspects and other embodiments may include one or more of the following features. The generated voice message is further configured to recite, based on the determined location, a projected time, distance, or aircraft state in the future at which the specific instruction should be performed. To identify a specific instruction from a received message from air traffic control, the controller may be configured to: separate the received message into one or more message segments; correlate, for each message segment, the message segment to an instruction type from a rules-set database and retrieve instruction parameters from the message segment; and modify each instruction type to a specific instruction based on the instruction parameters (e.g., instruction execution location, maneuver parameter such as heading, altitude, speed) retrieved from its correlated message segment. To determine the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew, the controller may be configured to: retrieve an instruction execution location from instruction parameters provided in the received message; and translate the instruction execution location to a location relative to the planned flight path of the aircraft. To generate, for the specific instruction, a voice message configured to recite the specific instruction, the controller may be configured to: identify a voice pattern to use for reciting the specific instruction from a voice database; and translate the specific instruction into the voice message using the identified voice pattern. To cause the voice message associated with the actuatable graphical element to be provided, the controller may be configured to: determine, based on aircraft state data and aircraft flight plan data, a projected time or distance in the future at which the specific instruction should be performed; modify the voice message to include the projected time or distance in the future at which the specific instruction should be performed; and cause the modified voice message with the projected time or distance in the future at which the specific instruction should be performed to be provided as an aural message. To cause the voice message associated with the actuatable graphical element to be provided, the controller may be further configured to cause the voice message to be provided as a textual message on a graphic display device. The controller may be further configured to cause the voice message associated with the actuatable graphical element to be automatically provided as an aural message when the controller determines that the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew has been reached.

In another embodiment, a method on an aircraft for producing active voice tags as actuatable graphical elements on a flight path displayed on a graphical display unit is provided according to claim <NUM>.

These aspects and other embodiments may include one or more of the following features. The generated voice message is further configured to recite, based on the determined location, a projected time, distance, or aircraft state in the future at which the specific instruction should be performed. Identifying the specific instruction from the received message from air traffic control may comprise: separating the received message into one or more message segments; correlating, for each message segment, the message segment to an instruction type from a rules-set database and retrieve instruction parameters from the message segment; and modifying each instruction type to a specific instruction based on the instruction parameters (e.g., instruction execution location, maneuver parameter such as heading, altitude, speed) retrieved from its correlated message segment. Determining the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew may comprise: retrieving an instruction execution location from instruction parameters provided in the received message; and translating the instruction execution location to a location relative to the planned flight path of the aircraft. Generating, for the specific instruction, the voice message configured to recite the specific instruction may comprise: identifying a voice pattern to use for reciting the specific instruction from a voice database; and translating the specific instruction into the voice message using the identified voice pattern. Providing the voice message associated with the actuatable graphical element may comprise: determining, based on aircraft state data and aircraft flight plan data, a projected time or distance in the future at which the specific instruction should be performed; modifying the voice message to include the projected time or distance in the future at which the specific instruction should be performed; and causing the modified voice message with the projected time or distance in the future at which the specific instruction should be performed to be provided as an aural message. Providing the voice message associated with the actuatable graphical element may further comprise providing the voice message as a textual message on a graphic display device. The method may further comprise automatically providing the voice message associated with the actuatable graphical element as an aural message upon reaching the location relative to the planned flight path of the aircraft at which the specific instruction should be provided to flight crew.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in software executed by a processor, or in a combination of the two. A software may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

Claim 1:
A flight deck system on an aircraft for producing active voice tags as actuatable graphical elements on a flight path displayed on a graphical display unit, the flight deck system comprising a controller configured to:
identify a specific instruction from a received message from air traffic control (ATC);
determine, for the specific instruction, based on aircraft state data and aircraft flight plan data, a location relative to a planned flight path of the aircraft at which the specific instruction should be provided to flight crew;
generate, for the specific instruction, a voice message configured to recite the specific instruction;
associate with the voice message the voice tag that is actuatable to cause the voice message to be provided to flight crew on the aircraft;
render the voice tag at or near the determined location on a depiction of the planned flight path that is displayed on the graphical display unit; and cause the voice message associated with the voice tag to be provided as an aural message responsive to actuation of the voice tag wherein to cause the voice message associated with the voice tag to be provided the controller is configured to:
determine, based on aircraft state data and aircraft flight plan data, a projected time or distance in the future at which the specific instruction should be performed;
modify the voice message to include the projected time or distance in the future at which the specific instruction should be performed; and
cause the modified voice message with the projected time or distance in the future at which the specific instruction should be performed to be provided as the
aural message.