Flight crew training system

A method is present for flight crew training. Flight crew interactions are recorded during a lesson to form recorded flight crew interactions. Flight deck displays occurring during the lesson are recorded to form recorded flight deck displays. A flight training video is formed from the recorded flight crew interactions and the recorded flight deck displays.

BACKGROUND INFORMATION

The present disclosure relates generally to training lessons and in particular to a method and apparatus for flight crew training. Still more particularly, the present disclosure relates to a method, apparatus, and program code for a multimedia flight crew training program.

Flight crew training is a course of study followed by one or more flight crew members learning to operate an aircraft. Flight crew training includes a combination of theoretical learning conducted by self paced computer based training (CBT) modules, instructor lead flight training devices (FTD) full flight simulators (FSS), and may include practical exercises conducted with actual aircraft.

A student in a flight crew training curriculum goes through a number of different instructor lead FTD and FFS lessons. Normally, two students are trained together as a flight crew, one as captain and one as the first officer. In preparation for each lesson, each student studies a training manual (TM) and flight crew operations manual (FCOM) to visualize various aircraft systems, operations, procedures, and other information.

These training manuals are in printed form, in which text, pictures, and diagrams are present to prepare for each defined lesson. Further, the training manual may cross reference other manuals, such as the flight crew training manual (FCTM), to obtain more detail.

In preparing for each lesson, the students may review multiple documents or manuals. The students then attends a briefing prior to the scheduled (FTD or FFS) simulator session. The student is required to perform the pre-briefed procedures in the simulator for the particular lesson.

Further, instructors for these flight training curriculums also have an expanded version of the lesson plans for use in identifying details of information to be presented in each lesson.

With these types of manuals, a student is required to mentally visualize the actions to be performed in the simulator session for each lesson. Instructors also are required to interpret what and how training should be performed for each lesson from the expanded training manuals that they receive. The currently available types of training materials may be open to different interpretations by students and instructors. As a result, the materials emphasized and taught may not be standardized around the world in different training locations.

Therefore, it would be advantageous to have a method and apparatus that overcomes the problems described above.

SUMMARY

In one advantageous embodiment, a method is present for flight crew training. Flight crew interactions are recorded during a lesson to form recorded flight crew interactions. Flight deck displays occurring during the lesson are recorded to form recorded flight deck displays. A flight training video is formed from the recorded flight crew interactions and the recorded flight deck displays.

In another advantageous embodiment, a data processing system comprises a bus, a communications unit connected to the bus, a storage device connected to the bus, and a processor unit connected to the bus. The processor unit executes program code to record flight crew interactions during a lesson to form recorded flight crew interactions. The processor unit also executes the program code to record flight deck displays occurring during the lesson to form recorded flight deck displays. The processor unit executes the program code to form a flight training video from the recorded flight crew interactions and the recorded flight deck displays.

In yet another advantageous embodiment, a computer program product is present for flight crew training. The computer program product comprises program code stored on a computer recordable storage medium. Program code is present for recording flight crew interactions during a lesson to form recorded flight crew interactions. Program code is also present for recording flight deck displays occurring during the lesson to form recorded flight deck displays. Program code is present for forming a flight training video from the recorded flight crew interactions and the recorded flight deck displays.

DETAILED DESCRIPTION

The different advantageous embodiments recognize that current curriculum requires students to be able to visualize a large range of different systems, operations, procedures, and other suitable material from printed or electronic materials when preparing for lessons. Further, the different advantageous embodiments also recognize that instructors for flight training curriculums also use similar materials. These materials may identify information about goals, teaching points, or procedures to emphasize.

The different advantageous embodiments, however, recognize that currently available instructor materials do not provide a dynamic visual reference of the training. The different advantageous embodiments recognize that the currently used lesson plans are unable to provide the desired standardization in flight training lessons when used by different instructors.

The different advantageous embodiments recognize that it is important to have a consistent standardized flight training course, in which the same information and emphasis for different procedures, operations, and systems are emphasized in the same manner. In other words, additional emphasis for a particular procedure should not be presented by one instructor, with other instructors providing less emphasis for the particular procedure.

Further, the different advantageous embodiments also recognize that current materials do not provide a capability to visualize or review actions taken by flight crew members and instructors during a lesson. The different advantageous embodiments recognize that adequate preparation for a lesson may require longer study times to adequately prepare and/or complete a lesson.

Thus, the different advantageous embodiments provide a method, apparatus, and computer program code for flight crew training. Flight crew interactions are recorded during a lesson along with flight deck displays that occur during the lesson. This recorded information is used to form a flight training video which may be distributed to students and instructors around the world. With the use of this type of flight training video, the lessons may be more easily standardized with different instructors teaching the same lesson.

With reference now toFIG. 1, a diagram illustrating a flight curriculum creation environment is depicted in accordance with an advantageous embodiment. Flight curriculum creation environment100includes flight deck simulator102and recording computer104.

Flight deck simulator102is a simulator of a flight deck of an aircraft, in which a pilot and other crew members may control an aircraft. Flight deck simulator102may be, for example, without limitation, a flight training device and/or full flight simulator. Flight deck simulator102may be implemented using any commercially available flight deck simulator along with modifications according to the different advantageous embodiments. In these examples, flight deck simulator102may be implemented using a flight deck simulator available from CAE, Inc. and/or Thales.

In this depicted example, flight deck simulator102includes electronic flight system106and video camera system108. Video camera system108is an example of a modification made to flight deck simulator102to record various activities that may occur within flight deck simulator102. Electronic flight system106includes computer110, flight deck displays112, and control panel114. Additionally, electronic flight system106also may include electronic flight bag116.

Computer110may execute computer readable program code in a functional form to simulate an aircraft during various phases of a flight. Electronic flight bag116is an electronic information device that may include various resources, such as an aircraft operating manuals, airplane performance software, electronic logbook, and navigation charts.

Flight deck displays, in these examples, include a number of different displays. These displays may include, for example, without limitation, primary flight display117, multifunction display118, navigation display120, head up display122, and engine indicating and crew alerting system (EICAS) display124.

Primary flight display117may provide information such as, for example, airspeed, altitude, heading, attitude, vertical speed, and glideslope. Multifunction display118may provide status information about aircraft systems such as, for example, communications, auxiliary power unit (APU), fuel, and electrical systems. Navigation display120may present heading/track, flight plan route, waypoint, airport, navigational aid and weather information. Navigation display120may provide a moving map type of presentation.

Head up display (HUD)122may provide projected airplane flight data on the HUD combiner mounted just in front of the windshield. A head up display combiner is a movable reflective glass surface in these examples. Engine indicating and crew alerting system (EICAS) display124may present information about aircraft systems, including propulsion, warnings, flight controls, fuel, and air systems. These displays may mimic traditional gauges while supplying digital readouts of various parameters. Example displays presented for flight deck display112may vary, depending on the particular implementation.

In other implementations, other displays may be used in addition to or in place of the displays illustrated inFIG. 1. For example, navigation display120and multifunction display118may be combined into a single display. In other advantageous embodiments, head up display122may not be present.

Control panels114provide controls to allow the flight crew to perform various operations during a flight. For example, control panels114may be used to select a display range and mode and enter data. Control panels114, in these examples, also may encompass the control column or yoke.

Video camera system108is an additional component that may be installed within flight deck simulator102. Video camera system108may be a number of video cameras that may be positioned within flight deck simulator102. A number of items, as used herein, refers to one or more items. For example, a number of video cameras is one or more video cameras. Video camera system108provides the capability to record crew interactions and instructor actions during a lesson.

Video camera system108sends video data126to recording computer104through communications link128. Communications link128also may be used to carry commands, such as command130, to control recording activities by video camera system108.

Additionally, computer110and electronic flight bag116also are in communication with recording computer104through communications link132. Communications link132is added to flight deck simulator102to obtain display data133from computer110and display data134from electronic flight bag116. Display data133and display data134contain data from flight deck display112generated during a lesson. In these examples, this display data includes data from the displays generated during a lesson.

Flight training video process136, executing on recording computer104, receives video data126, display data133, and display data134to generate flight training videos138. Each video within flight training videos138may be for a particular lesson. A flight training video within flight training videos138may be for an entire lesson. In some advantageous embodiments, only a portion of a lesson may be repeated, since later lessons include repeat operations from prior lessons. Flight training video process136stores video data126, display data133, and display data134as raw data140for use in creating flight training videos138.

In these examples, flight training video process136may be used to edit data within raw data140to generate a particular flight training video in flight training videos138.

After flight training videos138have been created, these videos may be distributed for use by instructors and students. In these examples, both instructors and students receive the same version, which show the exact operations, actions, interactions, and other suitable information that is to be emphasized during a lesson. In this manner, a standardized training program may be established in which the emphasis is the same when presented by different instructors. Flight training videos138will provide information to instructors as to what should be emphasized based on the guidance provided in the flight training videos.

The illustration of flight curriculum creation environment100inFIG. 1is not meant to imply physical or architectural limitations to the manner in which different advantageous embodiments may be implemented. For example, in some advantageous embodiments, recording computer104may be located in an engineering cabin. In yet other advantageous embodiments, recording computer104may be a separate data processing system connected to flight deck simulator102. Further, recording computer104may be located in the same physical location as flight deck simulator102.

In other advantageous embodiments, recording computer104may be in a remote location in which communications links128and132extend over a network, such as the internet or a wide area network. Other components may be used in addition to or in place of the ones illustrated inFIG. 1. For example, physical crew seating areas are present in flight deck simulator102but not shown in this example.

Turning now toFIG. 2, a diagram of a data processing system is depicted in accordance with an illustrative embodiment. Data processing system200is an example of a data processing system that may be used to implement various components in flight curriculum creation environment100.

For example, data processing system200may be used to implement computer110, electronic flight bag116, recording computer104, and any other suitable device within this environment. In this illustrative example, data processing system200includes communications fabric202, which provides communications between processor unit204, memory206, persistent storage208, communications unit210, input/output (I/O) unit212, and display214.

Memory206and persistent storage208are examples of storage devices. A storage device is any piece of hardware that is capable of storing information either on a temporary basis and/or a permanent basis. Memory206, in these examples, may be, for example, a random access memory or any other suitable volatile or non-volatile storage device. Persistent storage208may take various forms depending on the particular implementation.

For example, persistent storage208may contain one or more components or devices. For example, persistent storage208may be a hard drive, a flash memory, a rewritable optical disk, a rewritable magnetic tape, or some combination of the above. The media used by persistent storage208also may be removable. For example, a removable hard drive may be used for persistent storage208.

Program code216is located in a functional form on computer readable media218that is selectively removable and may be loaded onto or transferred to data processing system200for execution by processor unit204. Program code216and computer readable media218form computer program product220in these examples. In one example, computer readable media218may be in a tangible form, such as, for example, an optical or magnetic disc that is inserted or placed into a drive or other device that is part of persistent storage208for transfer onto a storage device, such as a hard drive that is part of persistent storage208.

In a tangible form, computer readable media218also may take the form of a persistent storage, such as a hard drive, a thumb drive, or a flash memory that is connected to data processing system200. The tangible form of computer readable media218is also referred to as computer recordable storage media. In some instances, computer readable media218may not be removable.

In some illustrative embodiments, program code216may be downloaded over a network to persistent storage208from another device or data processing system for use within data processing system200. For instance, program code stored in a computer readable storage medium in a server data processing system may be downloaded over a network from the server to data processing system200. The data processing system providing program code216may be a server computer, a client computer, or some other device capable of storing and transmitting program code216.

The different components illustrated for data processing system200are not meant to provide architectural limitations to the manner in which different embodiments may be implemented. The different illustrative embodiments may be implemented in a data processing system including components in addition to or in place of those illustrated for data processing system200.

Other components shown inFIG. 2can be varied from the illustrative examples shown. The different embodiments may be implemented using any hardware device or system capable of executing program code. As one example, data processing system200may include organic components integrated within organic components and/or may be comprised entirely of organic components, excluding a human being. For example, a storage device may be comprised of an organic semiconductor.

As another example, a storage device in data processing system200is any hardware apparatus that may store data. Memory206, persistent storage208, and computer readable media218are examples of storage devices in a tangible form.

Additionally, a communications unit may include one or more devices used to transmit and receive data, such as a modem or a network adapter. Further, a memory may be, for example, memory206, or a cache such as found in an interface and memory controller hub that may be present in communications fabric202.

With reference now toFIG. 3, a diagram of a computer program product is depicted in accordance with an advantageous embodiment. Computer program product300is an example of one implementation for computer program product220inFIG. 2. In particular, computer program product300may be used to transport flight training videos such as, for example, flight training videos138inFIG. 1.

In this example, computer program product300comprises computer recordable storage medium302with flight training videos304. Computer recordable storage medium302also may include player306, curriculum program308, and manuals310. Player306may be used to play flight training videos304. Curriculum program308may present lessons using manuals310. Curriculum program308may integrate the use of player306to present flight training videos304, as well as information for manuals310when a student and/or instructor prepares for a lesson. Computer program product300may be used as part of a computer-based training (CBT) program for students and/or instructors preparing for lessons.

In this example, flight training videos304are examples of flight training videos generated using flight curriculum creation environment100inFIG. 1. Flight training video312is an example of a flight training video within flight training videos304. In this illustrative example, flight training video312includes flight crew interactions314, flight instructor narration316, flight crew narration318, flight system displays320, and control panel display322.

Flight crew interactions314contain the interactions between flight crew during a lesson. These flight crew interactions may include, for example, communications exchanged between flight crew members during an operation. Flight crew interactions314also may include actions taken by flight crew members such as, for example, manipulating various controls.

Flight instructor narration316contains the actions and comments made by a flight instructor during the lesson. Flight instructor narration316may include, for example, instructions given to the flight crew, clarifications on actions to be taken, verbalization of important points, goals, and other information about the lesson.

Flight crew narration318includes additional verbalization by the flight crew that may not normally be present during flight crew interactions314. Flight crew narration318is a subset or type of flight crew interactions314in these examples. Flight crew narration318may include, for example, a flight crew member explaining what that flight crew member did, is doing, or about to do or look for during a lesson.

Flight system displays320present the displays that occur during flight crew interactions314that involve manipulating controls within the aircraft. Flight system displays320may show or emphasize particular displays of importance. Flight system displays320may show all displays relevant to the lesson or only a portion of the displays as they become relevant during the lesson.

Control panel display322may present an identification of controls being manipulated by the flight crew during flight crew interactions314. Control panel display322may provide a better identification of the controls being manipulated in addition to the view provided in flight crew interactions314.

The illustration of computer program product300inFIG. 3is not meant to imply physical or architectural limitations to the manner in which different advantageous embodiments may be implemented. In other advantageous embodiments, other components in addition to or in place of the ones illustrated may be used. For example, in some advantageous embodiments, only flight training videos304may be present, without other programs or information. In yet other advantageous embodiments, computer recordable storage medium302also may include tests or quizzes to help reinforce student learning.

Computer recordable storage medium302may take various forms. For example, without limitation, computer recordable storage medium302may be a hard drive, a thumb drive, a flash memory, a digital versatile disk, a random access memory, or some other suitable storage media.

With reference now toFIG. 4, a block diagram illustrating a display that may be presented in a flight training video is depicted in accordance with an advantageous embodiment. In this example, flight training video display400is a block diagram illustrating components that may be presented on a display device for a flight training video, such as, for example, flight training video312inFIG. 3.

Flight training video display400includes flight deck video display402, flight deck displays404, and control panel406. Flight deck video display402is a video of a flight crew made during a lesson. Flight deck video display402also may include the flight instructor. Flight deck video display402presents visual and audio information about interactions, instructions, and other information presented during a lesson. Flight deck displays404present the flight deck displays that are generated during the lesson. Control panel406may display and identify controls being manipulated during the lesson.

The illustration of flight training video display400inFIG. 4is not meant to imply physical or architectural limitations to the manner in which different displays may be presented. For example, additional components may be used in place of or in addition to the ones illustrated. In one example, flight deck displays404may be arranged in a different manner from what is shown. As another example, flight deck displays404may wrap around flight deck video display402.

In other advantageous embodiments, control panel406may not be presented in flight training video display400. Flight training video display400is presented as a block diagram of components that may be present in a flight training video and not meant to imply limitations in the manner or arrangement of how information is presented.

With reference now toFIG. 5, a diagram illustrating an example of a flight training video display is depicted in accordance with an advantageous embodiment. Flight training video display500is an example of one implementation for a flight training video display400inFIG. 4.

As illustrated, flight training video display500presents flight deck displays502, and flight deck video display504. Instructor506, crew member508, and crew member510can be seen in flight deck video display504. In this example, crew member508is the captain, while crew member510is the first officer. From this display, interactions between crew member508and crew member510, as well as instructor506, may be seen. Further, the communications, instructions, alerts, and other audio information may be presented by an audio device corresponding to the actions being taken in flight deck video display504.

This illustration of flight training video display500inFIG. 5is not meant to limit the manner in which other flight training video displays may be presented. For example, in other flight training video displays, a control panel may be displayed that identifies controls being manipulated by a particular crew member.

With reference now toFIG. 6, a flowchart of a process for planning a recording of a lesson is depicted in accordance with an advantageous embodiment. The process illustrated inFIG. 6may be implemented to create scripts of directions for a lesson that is to be recorded for use in a flight training video, using flight curriculum creation environment100inFIG. 1.

The process begins by identifying actions for the lesson (operation600). These actions are ones that are to be emphasized and standardized for a particular lesson, regardless of who or where the lesson is being taught. The standardization of actions in operation600may insure that only those actions are performed. In other words, additional actions or less actions do not occur with respect to a particular lesson. Additionally, operation600may be used to standardize a training video for a particular airline to follow their own particular standardized operating procedures for their own student training and/or regulatory agency approval.

Thereafter, a script is generated (operation602). The script may include talking points and/or specific verbiage and instructions. The crew members and instructors are then prepared for the lesson using the script (operation604), with the process terminating thereafter. In preparing the crew members and instructors, the crew members may be other instructors or other experienced crew members. The different crew members and instructors may review the script to identify what should be emphasized and what actions should be performed during a particular lesson.

With reference now toFIG. 7, a flowchart of a process for recording information for creating a flight training video is depicted in accordance with an advantageous embodiment. The process illustrated inFIG. 7may be implemented using a flight curriculum creation environment such as, for example, flight curriculum creation environment100inFIG. 1. In particular, the information needed for the video may be recorded using video camera system108and recording computer104, in conjunction with flight deck simulator102inFIG. 1.

The process begins by starting the recording (operation700). The recording may be started when the lesson begins or after a portion of the lesson has begun. For example, a number of actions are repeated in every lesson. These actions may not be needed for later training videos in a series of lessons since those actions have been covered in prior training videos. In starting the lesson, the flight crew members and instructors begin the different interactions for the lesson.

The process records the flight crew interactions (operation702). In operation702, the recorded interactions include the physical movements, as well as the communications between crew members. Additionally, these flight crew interactions also may include additional statements or explanations provided by a crew member that normally would not occur during a normal flight. These additional interactions may aid a student and/or instructor in what actions and communications should occur between flight crew members.

The process records flight deck displays (operation704). In this operation, the flight deck displays are recorded as they are presented and changed during the lesson in response to flight crew interactions with each other and the different controls in the aircraft. All of the flight deck displays are recorded. At a later time, different displays may be selected for emphasis or presentation when the flight training video is generated.

The process records the instructor interactions (operation706). The instructor interactions include gestures and audible statements made by the instructor during the lesson. While recording the flight instructor interactions, a standardization may be made with respect to preparing other instructors at a later point in time as to what actions and directions should be given by an instructor for a particular lesson.

The process then determines whether the recording is complete (operation708). If the recording is not complete, the process returns to operation702. Otherwise, the process terminates. The recording may be complete when the lesson is terminated. In some advantageous embodiments, a recording of the entire lesson is not necessary because certain actions are repeated again in every lesson. As a result, in later lessons, only a portion of the lesson may be recorded containing new actions.

The process illustrated inFIG. 7may be started once each lesson or started at a number of different points in the lesson, depending on what actions are desired to be recorded for a particular flight training video.

With reference now toFIG. 8, a flowchart of a process for creating a flight training video is depicted in accordance with an advantageous embodiment. The process illustrated inFIG. 8may be implemented in a data processing system such as, for example, recording computer104inFIG. 1. This process may be implemented using flight training video process136inFIG. 1.

The process begins by selecting video data (operation800). This video data may be video data generated during a lesson. The video data selected may be a portion of a lesson or the entire lesson depending on the particular implementation. The process then selects flight display data (operation802). This operation may include identifying which flight displays may be useful for presentation.

The selected data is edited (operation804). This editing may include, for example, changing flight displays that are presented in the flight training video based on actions taken by particular flight crew members. In this manner, the relevant displays to a particular action performed by a flight crew member may be presented so that a student and/or instructor may see the expected changes. The flight display data also may include, for example, a display of an outside view of the aircraft depending on the particular action. For example, a view of another aircraft or a landing strip may be provided.

The process adds additional information (operation806). This operation is an optional one and may be used to provide other information to a user. For example, control panels and an indication of which controls on a control panel are being manipulated during flight crew interactions may be provided as part of the flight training video to provide an ability to better understand what actions have been taken.

The process then stores the completed project as a flight training video (operation808), with the process terminating thereafter. Operation808may include storing the flight training video on a computer recordable storage media for distribution to students and/or instructors.

The flowcharts and block diagrams in the different depicted embodiments illustrate the architecture, functionality, and operation of some possible implementations of apparatus, methods and computer program products. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of computer usable or readable program code, which comprises one or more executable instructions for implementing the specified function or functions.

In some alternative implementations, the function or functions noted in the block may occur out of the order noted in the figures. For example, in some cases, two blocks shown in succession may be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

Thus, the different advantageous embodiments provide a method, apparatus, and computer program code for flight crew training. In these different examples, the flight crew interactions and flight deck displays occurring during a lesson are recorded. The flight training video is formed from these recordings.

In this manner, the actions that are to be performed in a particular lesson may be standardized by providing students and/or instructors a recording of exactly what should occur during a particular lesson. This type of standardization may be performed within a particular airline or for a particular school. By providing this video along with other flight training curriculum materials, the time needed for students and/or instructors to prepare for a lesson may be reduced, students achieve a better overall understanding of airplane operation, in addition to providing for increased curriculum standardization across training facilities around the world.

The description of the different advantageous embodiments has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. Further, different advantageous embodiments may provide different advantages as compared to other advantageous embodiments.

The embodiment or embodiments selected are chosen and described in order to best explain the principles of the embodiments, the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.