Patent Description:
An interactive computer simulation system performs one or more interactive computer simulations. Each interactive computer simulation comprises one or more virtual simulated elements each representing an actual system (e.g., multiple virtual aircraft systems each representing an actual aircraft). Each interactive computer simulation provides a virtual computer generated environment and various tangible instruments (or controls) in a simulation station to allow enactment of different scenarios for the purpose of training one or more users (or trainees), using one or more of the virtual simulated elements, in the operation and/or understanding of the corresponding one or more actual systems. The virtual simulated element, or simulated element, is defined herein as a simulated system. The simulated element is a virtual version that simulates, to the extent required by the interactive computer simulation, behavior of an actual system. The various tangible instruments accessible to the one or more users in the simulation station replicate actual instruments or otherwise reproduce behavior of the actual instruments found in the actual system.

In order to properly train the users and allow them to improve, assessments are made considering different expected results.

Document <CIT> discloses a system for pilot training, wherein virtual-reality, augmented reality, and advanced computer interfaces are applied in order to get the most out of time, money and effort required for the training. Every hand movement of a trainee is decoded by a computer, in the context of the lesson being applied at that moment, and the virtual environment reacts accordingly, showing modifications in the virtual cockpit's displays of physical mockup. The system receives, logs and processes inputs from the trainee's interaction to evaluate the achievement of lesson goals. A separate station capable of reproducing all the audio and visual information delivered to the trainees is provided and allows an instructor to follow the lesson's activities, and help and evaluate the trainee's performance.

Document <CIT> describes an aircraft electronic flight-mission simulation and scoring system, wherein a standardized scoring processor scores performance of a user as the user flies at least one scorable mission of at least one simulated aircraft.

The present invention aims at improving the quality and relevance of the assessments made in the context of interactive training computer simulations.

The invention concerns an interactive computer-based training system according to claim <NUM>, an interactive computer simulation station according to claim <NUM>, a method for assessing a training activity according to claim <NUM>, and a computer program according to claim <NUM>.

This Summary is not intended to
identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

In a first set of embodiments a first aspect is directed to a simulation mapping system for determining a plurality of performance metric values in relation to a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element comprising a plurality of dynamic subsystems. The simulation mapping system comprises a processor module that obtains dynamic data related to the virtual element being simulated in an interactive computer simulation station comprising a tangible instrument module. The dynamic data captures actions performed by the user during the training activity on one or more tangible instruments of the tangible instrument module. The processor module also constructs a dataset corresponding to the plurality of performance metric values from the dynamic data having a target time step by synchronizing dynamic data from at least two of the dynamic subsystems into the dataset considering the target time step, the at least two of the dynamic subsystems being associated to at least one common performance metric values from the plurality of performance metric values and by inferring, for at least one missing dynamic subsystems of the plurality of dynamic subsystems missing from the dynamic data, a new set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one missing dynamic subsystems impacting at least one common performance metric values from the plurality of performance metric values.

The processor module may optionally obtain dynamic data from a plurality of interactive computer simulation stations and constructs the dataset having the target time step for the plurality of interactive computer simulation stations.

The processor module may optionally further provide the dataset as a common standardized stream consumers, the consumers comprising a grading system. The common standardized stream may comprise classification information related to the plurality of performance metric values.

The processor module may optionally, when constructing the dataset corresponding to the plurality of performance metric values from the dynamic data having the target time, add at least one simulated dynamic subsystem missing from the dynamic data and an additional set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one simulated dynamic subsystems impacting the at least one common performance metric values from the plurality of performance metric values.

The processor module may optionally apply a linear quadratic estimation (LQE) when constructing the dataset and/or a probabilistic directed acyclic graphical model when constructing the dataset.

In the first set of embodiments a second aspect is directed to a method for determining a plurality of performance metric values in relation to a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element comprising a plurality of dynamic subsystems. The method comprises obtaining dynamic data related to the virtual element being simulated in an interactive computer simulation station comprising a tangible instrument module. The dynamic data captures actions performed by the user during the training activity on one or more tangible instruments of the tangible instrument module. The method also comprises constructing a dataset corresponding to the plurality of performance metric values from the dynamic data having a target time step by synchronizing dynamic data from at least two of the dynamic subsystems into the dataset considering the target time step, the at least two of the dynamic subsystems being associated to at least one common performance metric values from the plurality of performance metric values and inferring, for at least one missing dynamic subsystem of the plurality of dynamic subsystems missing from the dynamic data, a new set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one missing dynamic subsystems impacting the at least one common performance metric values from the plurality of performance metric values.

The method may optionally further comprise obtaining dynamic data from a plurality of interactive computer simulation stations, wherein constructing the dataset having the target time step is performed for the plurality of interactive computer simulation stations.

The method may optionally further comprise providing the dataset as a common standardized stream consumers, the consumers comprising a grading system. The common standardized stream may optionally comprise classification information related to the plurality of performance metric values.

The method may optionally further comprise, when constructing the dataset corresponding to the plurality of performance metric values from the dynamic data having the target time, adding at least one simulated dynamic subsystem missing from the dynamic data and an additional set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one simulated dynamic subsystems impacting the at least one common performance metric values from the plurality of performance metric values.

Optionally, constructing the dataset may performed by applying a linear quadratic estimation (LQE) and/or by applying a probabilistic directed acyclic graphical model when constructing the dataset.

In a second set of embodiments a first aspect of is directed to an interactive computer simulation system for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The interactive computer simulation system comprises an interactive computer simulation station and a processor module. The interactive computer simulation station comprises a tangible instrument module, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation.

The processor module obtains a plurality of performance metric datasets related to the virtual element being simulated, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module and, during execution of the interactive computer simulation, detects, in the plurality of performance metric datasets, a plurality of actual maneuvers of the virtual element during the training activity, identifies one or more standard operating procedures (SOP) for the training activity from a plurality of the individually detected actual maneuvers, provides, in real-time upon detection of the SOPs, information for display in the interactive computer simulation related the SOPs.

The system may optionally further comprise a simulation mapping system for determining a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems. The plurality of performance metric datasets may be provided by the simulation mapping system.

The processor module may further obtain a scorecard related to the training activity to establish a list of the one or more SOPs of interest. The one or more SOPs may identify the plurality of the individually detected actual maneuvers related thereto.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the detected SOPs. The information for display in the interactive computer simulation related the SOPs may further comprise the grading scorecard for the detected SOPs.

The detected actual maneuvers may be logged for post-activity debriefing.

In an optional embodiment, the processor module further obtains a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers comprising a plurality of expected individual maneuvers expected and one or more nested maneuvers formed by more than one individual maneuvers from the plurality of expected individual maneuvers, computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifies and grades one or more actual nested maneuvers against corresponding ones of the expected nested maneuvers and, notwithstanding performance of the actual nested maneuvers, identifies and grades a plurality of actual individual maneuvers against the plurality of expected individual maneuvers.

In the second set of embodiments a second aspect is directed to an interactive computer simulation station for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The interactive computer simulation station comprises a tangible instrument module, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module.

The processor module obtains a plurality of performance metric datasets related to the virtual element being simulated, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module and, during execution of the interactive computer simulation, detects, in the plurality of performance metric datasets, a plurality of actual maneuvers of the virtual element during the training activity, identifies one or more standard operating procedures (SOP) for the training activity from a plurality of the individually detected actual maneuvers and provides, in real-time upon detection of the SOPs, information for display in the interactive computer simulation related the SOPs.

The interactive computer simulation station may further comprise a network interface nodule for receiving the plurality of performance metric datasets from a simulation mapping system that determines a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation.

The processor module may optionally further obtain a scorecard related to the training activity to establish a list of the one or more SOPs of interest. The one or more SOPs may further identify the plurality of the individually detected actual maneuvers related thereto.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the detected SOPs. The information for display in the interactive computer simulation related the SOPs may comprise the grading scorecard for the detected SOPs.

In the second set of embodiments a third aspect is directed to a method for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The method comprises in an interactive computer simulation station, providing a tangible instrument module to the user for controlling the virtual element in the interactive computer simulation. The method also comprises obtaining a plurality of performance metric datasets related to the virtual element being simulated, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module and, during execution of the interactive computer simulation at the interactive computer simulation station, detecting, in the plurality of performance metric datasets, one or more actual maneuvers of the virtual element during the training activity, identifying one or more standard operating procedures (SOP) from the detected actual maneuvers and displaying, in real-time upon detection of the SOPs, information in the interactive computer simulation related the SOPs.

The method may further optionally comprise determining, at a simulation mapping system, a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems. The plurality of performance metric datasets may be provided by the simulation mapping system.

The method may further optionally comprise obtaining a scorecard related to the training activity to establish a list of the one or more SOPs of interest. The one or more SOPs may further identify the plurality of the individually detected actual maneuvers related thereto.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the detected SOPs. The information for display in the interactive computer simulation related the SOPs may then optionally comprise the grading scorecard for the detected SOPs.

The method may further optionally comprise logging the detected actual maneuvers and debriefing the training activity from the logged detected actual maneuvers.

In some embodiments, the method may further optionally comprise obtaining a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers comprising a plurality of expected individual maneuvers expected and one or more nested maneuvers formed by more than one individual maneuvers from the plurality of expected individual maneuvers, computing the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifying and grades one or more actual nested maneuvers against corresponding ones of the expected nested maneuvers and, notwithstanding performance of the actual nested maneuvers, identifying and grading a plurality of actual individual maneuvers against the plurality of expected individual maneuvers.

In a third set of embodiments a first aspect is directed to an interactive computer-based training system for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The training system comprises an interactive computer simulation station comprising a tangible instrument module, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module. The processor module obtains a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module, obtains a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers, computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifies one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performs computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

The system may further optionally comprise a simulation mapping system for determining a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems, wherein the plurality of performance metric datasets is provided by the simulation mapping system.

The processor module may further optionally map, in real-time, each one of the actual maneuvers of the virtual element during the training activity on causal model for linking the one actual maneuver with previous ones of the actual maneuvers. The processor module may then optionally associate a probability rating to the one or more root causes of the failed actual maneuvers considering the causal model.

The processor module may further optionally provide to an instructor of the user, in real-time, the one or more root causes of the failed actual maneuvers.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the actual maneuvers. The grading scorecard for the actual maneuvers may be provided for display in the interactive computer simulation.

In the third set of embodiments a second aspect is directed to an interactive computer simulation station for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The interactive computer simulation station comprises a tangible instrument module, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module. The processor module obtains a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module, obtains a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers, computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifies one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performs computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

The processor module may further optionally map, in real-time, each one of the actual maneuvers of the virtual element during the training activity on causal model for linking the one actual maneuver with previous ones of the actual maneuvers and associate a probability rating to the one or more root causes of the failed actual maneuvers considering the causal model.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the actual maneuvers. The grading scorecard for the actual maneuvers may then be provided for display in the interactive computer simulation.

In the third set of embodiments a third aspect is directed to a method for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The method comprises obtaining a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of interactions of the user with a tangible instrument module of an interactive computer simulation station, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation, obtaining a plurality of expected maneuvers of the virtual element during the training activity, computing the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifying one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performing computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

The method may optionally further comprise determining, at a simulation mapping system, a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems, wherein the plurality of performance metric datasets is provided by the simulation mapping system.

The method may optionally further comprise mapping, in real-time, each one of the actual maneuvers of the virtual element during the training activity on causal model for linking the one actual maneuver with previous ones of the actual maneuvers. The method may then further comprise associating a probability rating to the one or more root causes of the failed actual maneuvers considering the causal model and providing to an instructor of the user, in real-time, the one or more root causes of the failed actual maneuvers. The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the actual maneuvers. The method may optionally further comprise providing for display in the interactive computer simulation the grading scorecard for the actual maneuvers.

The present invention aims further at a computer program comprising instructions for performing the method as presented above, when these instructions are run by at least one processor. Possibly, the instructions can be distributed among several processors of respective entities of a system as presented above.

Further features and exemplary advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the appended drawings, in which:.

Reference is now made to the drawings in which <FIG> shows a logical modular view of an exemplary interactive computer simulation system <NUM> in accordance with the teachings of the present invention. The interactive computer simulation system <NUM> performs one or more interactive computer simulations. Each interactive computer simulation comprises one or more virtual simulated elements each representing an actual system (e.g., multiple virtual aircraft systems each representing an actual aircraft). Each interactive computer simulation provides a virtual environment and various tangible instruments (or controls) to allow enactment of different scenarios for the purpose of training one or more users (or trainees), using one or more of the virtual simulated elements, in the operation and/or understanding of the corresponding one or more actual systems. The virtual simulated element, or simulated element, is defined herein as a simulated system, and may further comprise multiple simulated dynamic subsystems, or dynamic subsystems. The simulated element is a virtual version that simulates, to the extent required by the interactive computer simulation, behavior of an actual system. Correspondingly, each of the simulated dynamic subsystems of the simulated element is a virtual version, to the extent required but the interactive computer simulation, behavior of actual subsystems of the actual system.

In the depicted embodiment of <FIG>, the interactive computer simulation system <NUM> comprises an interactive computer simulation station <NUM> for controlling at least one of the virtual simulated elements from the computer simulation executed on the interactive computer simulation system <NUM>. The interactive computer simulation system <NUM> typically comprises multiple simulation stations (not shown) that each allow one or more users to interact to control a virtual simulated element in one of the interactive computer simulation(s) of the interactive computer simulation system <NUM>. The interactive computer simulation system <NUM> also comprises a debriefing station <NUM> and a monitoring station <NUM> also sometimes referred to as an Instructor Operating Station (IOS). The monitoring stations may be provided for allowing various management tasks (not shown) to be performed in the interactive computer simulation system <NUM>. The tasks associated with the monitoring station <NUM> allow for control and/or monitoring of one or more ongoing interactive computer simulations. For instance, the monitoring station <NUM> may be used for allowing an instructor to participate to the interactive computer simulation and possibly additional interactive computer simulation(s). In some embodiments, the monitoring station <NUM> is provided with the interactive computer simulation station <NUM> (1700A). In other embodiments, the monitoring station <NUM> may be co-located with the interactive computer simulation station <NUM> (1700C), e.g., within the same room or simulation enclosure or remote therefrom (1700C), e.g., in different rooms or in different locations connected through a network <NUM>. Skilled persons will understand the many instances of the monitoring station <NUM> may be concurrently provided in the interactive computer simulation system <NUM>. The monitoring station <NUM> may provide a computer simulation management interface, which may be displayed on a dedicated monitoring station <NUM> user interface <NUM> or the GUI module <NUM>. The monitoring station <NUM>, in some embodiments, is provided as the GUI <NUM> on a portable computing device (e.g., smartphone, tablet, portable computer or the like).

When multiple simulation stations <NUM> are present in the system <NUM>, the monitoring station <NUM> may present different views of the computer program management interface (e.g., to manage different aspects therewith) or they may all present the same view thereof. The computer program management interface may be permanently shown on a first of the screens of the monitoring station <NUM> display module while a second of the screens of the monitoring station <NUM> display module shows a view of the interactive computer simulation (i.e., adapted view considering characteristics of the second screen). The computer program management interface may also be triggered on the monitoring station <NUM>, e.g., by a touch gesture and/or an event in the interactive computer program (e.g., milestone reached, unexpected action from the user, or action outside of expected parameters, success or failure of a certain mission, etc.). The computer program management interface may provide access to settings of the interactive computer simulation and/or of the simulation station <NUM>. A virtualized monitoring station may also be provided to the user (e.g., through the GUI module <NUM>) on a main screen, on a secondary screen or a dedicated screen.

In some embodiments, the interactive computer simulation system <NUM> comprises a debriefing station <NUM>. The debriefing station <NUM> is sometimes referred to as a Brief and Debrief System (BDS). The debriefing station <NUM> may provide functionalities also provided by the monitoring station <NUM> in the context of debriefing past sessions thereat. For instance, when monitoring station <NUM> and/or debriefing station <NUM> functionalities are provided through the interactive computer simulation station <NUM>, the GUI module <NUM> / <NUM> / <NUM> may further be used to monitor and control one or more ongoing or recorded interactive computer simulation (e.g., triggering/monitoring events and/or selecting a perspective from which to view the ongoing or recorded chain of events of one or more interactive computer simulation).

The simulation station <NUM>, the monitoring station <NUM> and the debriefing station <NUM> may be connected via a network <NUM>, via direct connections or a mix of direct and network connections. In the depicted example of <FIG>, the simulation station <NUM> is a distinct simulation station while, in some embodiments, the simulation station <NUM> may be integrated with one or more of the simulation stations. Various network links may be implicitly or explicitly used in the context of the present invention. While a link may be depicted as a wireless link, it could also be embodied as a wired link using a coaxial cable, an optical fiber, a category <NUM> cable, and the like. A wired or wireless access point (not shown) may be present on links. Likewise, any number of routers and/or switches (not shown) may be present on links, which may further transit through the Internet.

In the depicted example of <FIG>, the simulation station <NUM> comprises a memory module <NUM>, a processor module <NUM> and a network interface module <NUM>. The processor module <NUM> may represent a single processor with one or more processor cores or an array of processors, each comprising one or more processor cores. In some embodiments, the processor module <NUM> may also comprise a dedicated graphics processing unit <NUM>. The dedicated graphics processing unit <NUM> may be required, for instance, when the interactive computer simulation system <NUM> performs an immersive simulation (e.g., pilot training-certified flight simulator), which requires extensive image generation capabilities (i.e., quality and throughput) to maintain expected realism of such immersive simulation. Typically, each of the monitoring station <NUM> and/or debriefing station <NUM> comprise a memory module similar to <NUM>, a processor module similar to <NUM> having a dedicated graphics processing unit similar to <NUM>, a network interface similar to <NUM> and a bus similar to <NUM>, which have not been replicated on <FIG> for the sake of readability. In some embodiments, the monitoring station <NUM> and/or debriefing station <NUM> may also comprise an instrument module similar to <NUM> and a simulation mapping system similar to 1800A.

The memory module <NUM> may comprise various types of memory (different standardized or kinds of Random Access Memory (RAM) modules, memory cards, Read-Only Memory (ROM) modules, programmable ROM, etc.). The network interface module <NUM> represents at least one physical interface that can be used to communicate with other network nodes. The network interface module <NUM> may be made visible to the other modules of the simulation station <NUM> through one or more logical interfaces. The actual stacks of protocols used by the physical network interface(s) and/or logical network interface(s) <NUM>, <NUM>, <NUM>, <NUM> of the network interface module <NUM> do not affect the teachings of the present invention. The variants of processor module <NUM>, memory module <NUM> and network interface module <NUM> usable in the context of the present invention will be readily apparent to persons skilled in the art.

A bus <NUM> is depicted as an example of means for exchanging data between the different modules of the simulation station <NUM>. The present invention is not affected by the way the different modules exchange information between them. For instance, the memory module <NUM> and the processor module <NUM> could be connected by a parallel bus <NUM>, but could also be connected by a serial connection or involve an intermediate module (not shown) without affecting the teachings of the present invention.

Likewise, even though explicit mentions of the memory module <NUM> and/or the processor module <NUM> are not made throughout the description of the various embodiments, persons skilled in the art will readily recognize that such modules are used in conjunction with other modules of the simulation station <NUM> to perform routine as well as innovative steps related to the present invention.

In the depicted example of <FIG>, the interactive computer simulation system <NUM> comprises a simulation mapping system <NUM>. As further explained and exemplified below, the simulation mapping system <NUM> gathers, processes, converts and/or sends dynamic data related to the interactive computer simulation, typically in the form of one or more streams of information, from the dynamic system and dynamic subsystems of the interactive computer simulation system <NUM> (e.g., instrument module <NUM>, user interface <NUM> /<NUM> / <NUM>, video recorder system, simulation engine, simulation station's security system, etc.). The dynamic data is typically generated during the interactive computer simulation in relation to the simulated element along a session timeline.

In some embodiments, the simulation mapping system <NUM> comprises a local simulation mapping system 1800A, in each of the interactive computer simulation stations <NUM>, and a coordinating simulation mapping system 1800B for the interactive computer simulation system <NUM>. In some embodiments, the coordination aspects of the simulation mapping system <NUM> are distributed between the different local simulation mapping systems 1800A. In some embodiments, the local aspects of the simulation mapping system <NUM> are performed from the coordinating simulation mapping system 1800B (e.g., through access to a storage system <NUM> and/or to the different elements of the interactive computer simulation system <NUM>).

In some embodiments, the simulation mapping system 1800B comprise a memory module similar to <NUM>, a network interface similar to <NUM> and a bus similar to <NUM>, which have not been replicated on <FIG> for the sake of readability. The simulation mapping system <NUM> may rely on the processor module <NUM> to process and/or convert the dynamic data. The simulation mapping system <NUM> may also comprise, in addition or alternatively, a processor module <NUM> to process and/or convert the dynamic data. The processor module <NUM> may further comprise a dedicated graphics processing unit similar to <NUM>. The processor module <NUM> may also comprise a dedicated real-time processing unit (not shown) to process and/or convert at least some of the dynamic data. The dedicated real-time processing unit provides enhanced capabilities to support real-time processing or real-time processing priority. The dedicated real-time processing unit may be required, for instance, when the interactive computer simulation system <NUM> performs an immersive simulation (e.g., pilot training-certified flight simulator), which may require the dynamic data to be timely processed and/or converted to maintain expected realism of such immersive simulation. In some embodiments, the processor module <NUM> is partly or completely integrated in a cloud-based processing service. The processor module <NUM>, when used in the context of the simulation mapping system <NUM>, may therefore comprise capabilities to interact and/or manage the cloud-based processing service through the network interface <NUM>.

The simulation mapping system <NUM> may further comprise (not shown) an environment tracking module, which may be used to capture one or more feed of images and/or environmental data from the interactive computer simulation station <NUM>. For instance, the environment tracking module may comprise one or more <NUM>-degree camera and/or a plurality of cameras throughout the interactive computer simulation station <NUM> to provide a choice of perspectives therein. For instance, the perspectives offered through the cameras may be set to cover as many critical locations in the interactive computer simulation station <NUM> (e.g., position of the hands of trainee(s), readings or settings on one or more of the instruments of the instrument module <NUM> and/or determination of a position of one or more instruments, tracking of the trainee(s)' gaze or other body parts, etc. The environment tracking module may also comprise one or more sound recorders (e.g., for conversations in the simulation station as well as with outside elements), one or more thermometer, one or more biometric readers (e.g., trainee(s)' status readings, gaze detector, sleepiness detector, etc.), smoke or other visual impairment detector, etc.).

The interactive computer simulation system <NUM> comprises a storage system <NUM> for, among other aspects, collecting dynamic data in relation to the dynamic system and dynamic subsystems while the interactive computer simulation is performed. The dynamic data stored in the storage system <NUM> comprises dynamic data necessary for the simulation mapping system <NUM> as well as results from the processing and/or converting performed by the simulation mapping system <NUM>. <FIG> shows examples of the storage system <NUM> as a distinct database system 1500A, a distinct module 1500B of the computer system <NUM>, a sub-module 1500C of the memory module <NUM> of the simulation station <NUM> and/or a storage system 1500D comprises in the simulation mapping system <NUM>. The storage system <NUM> may also comprise storage modules (not shown) on the monitoring station <NUM> and/or debriefing station <NUM>. The storage system <NUM> may be distributed over different systems A, B, C, D and/or the monitoring station <NUM> and/or debriefing station <NUM> or may be in a single system. The storage system <NUM> may comprise one or more logical or physical as well as local or remote hard disk drive (HDD) (or an array thereof). The storage system <NUM> may further comprise a local or remote database made accessible to the simulation station <NUM> by a standardized or proprietary interface or via the network interface module <NUM> (e.g., cloud-based storage service). In some embodiments, the storage system <NUM> stores the dynamic data and/or the processed / converted data in relation to the simulation mapping system <NUM> in a cloud-based storage service. The variants of storage system <NUM> usable in the context of the present invention will be readily apparent to persons skilled in the art.

The interactive computer simulation station <NUM> may comprise a graphical user interface (GUI) module <NUM> that may be used to visualize virtual dynamic subsystems from the virtual simulated element. The GUI module <NUM> may comprise one or more display screens such as a wired or wireless flat screen, a wired or wireless touch-sensitive display, a tablet computer, a portable computer or a smart phone.

Users of the interactive computer simulation system <NUM> (e.g., users of the simulation stations <NUM>) interact in the interactive computer simulation to control a virtual simulated element in a computer generated environment of the interactive computer simulation system <NUM> (e.g., instructors or experts, trainees such as a pilot and co-pilot, a driver, an operator, a surgeon, a flight investigator, a training analyst, a flight analyst, etc.). Examples of virtual simulated elements include a simulated aircraft system, a simulated ground vehicle system, a simulated spacecraft or space station system, a simulated control room system, unmanned vehicle or drone, simulated human mannequin, etc. Examples of virtual dynamic subsystems vary depending on the virtual simulated element. In the example of a simulated aircraft system, typical virtual dynamic subsystems may include virtual hydraulic systems, virtual communication systems, virtual display systems, virtual wiring systems, virtual inflight entertainment systems, virtual fuel systems, virtual lighting systems, virtual rudder system, virtual flap system, virtual landing gear system, etc. In the example of a simulated living system, typical virtual dynamic subsystems may include blood system, digestive system immunity response system, lymphatic system, nervous system, biometric data such as temperature, blood pressure and other related physical data, etc. When a trainee or user is involved, actual measurements of biometric data may also be recorded (e.g., for subsequent correlation with other recorded data). For instance, biometric data from a pilot interacting in a computer simulation with one or more tangible instruments at the simulation station <NUM> may be recorded (such as temperature, blood pressure and other related physical data). As a skilled person would appreciate, most virtual subsystems are directly or indirectly affected by interactions of the user with one or more tangible instruments that allow the user to interact (e.g., provide different commands in order to control the virtual simulated element) during the interactive computer system in the computer generated environment. Some other virtual subsystems may be affected by time elapsed during the interactive computer system and may further take into account the interactions of the user with one or more tangible instruments. For instance, in the example of a simulated aircraft system, a virtual aircraft structure subsystem may comprise one or more virtual mechanical components. Failure of any one of virtual mechanical components, or the virtual aircraft structure subsystem altogether, may be based on accumulated mechanical stress considering use time (e.g., number of flights and operating hours) and also based on maneuvers caused by the pilot manipulating the one or more tangible instruments.

The tangible instrument provided by the instrument modules <NUM> are tightly related to the element being simulated. In the example of the simulated aircraft system, typical instruments include various switches, levers, pedals and the like accessible to the user for controlling the aircraft in the interactive computer simulation. Depending on the type of simulation (e.g., level of immersivity), the tangible instruments may be more or less realistic compared to those that would be available in an actual aircraft. For instance, the tangible instrument provided by the module <NUM> may replicate an actual aircraft cockpit where actual instruments found in the actual aircraft or physical interfaces having similar physical characteristics are provided to the user (or trainee). As previously describer, the actions that the user or trainee takes with one or more of the tangible instruments provided via the instrument module <NUM> (modifying lever positions, activating/deactivating switches, etc.) allow the user or trainee to control the virtual simulated element in the interactive computer simulation. In the context of an immersive simulation being performed in the interactive computer simulation system <NUM>, the instrument module <NUM> would typically support a replicate of an actual instrument panel found in the actual system being the subject of the immersive simulation. In such an immersive simulation, the dedicated graphics processing unit <NUM> would also typically be required. While the present invention is applicable to immersive simulations (e.g., flight simulators certified for commercial pilot training and/or military pilot training), skilled persons will readily recognize and be able to apply its teachings to other types of interactive computer simulations.

In some embodiment, an optional external input/output (I/O) module <NUM> and/or an optional internal input/output (I/O) module <NUM> may be provided with the instrument module <NUM>. Skilled people will understand that any of the instrument modules <NUM>, <NUM> and/or <NUM> may be provided with one or both of the I/O modules such as the ones depicted for the computer system <NUM>. The external input/output (I/O) module <NUM> of the instrument module <NUM>, <NUM> and/or <NUM> may connect one or more external tangible instruments (not shown) therethrough. The external I/O module <NUM> may be required, for instance, for interfacing the interactive computer simulation system <NUM> with one or more tangible instrument identical to an Original Equipment Manufacturer (OEM) part that cannot be integrated into the computer system <NUM> (e.g., a tangible instrument exactly as the one that would be found in the actual system subject of the interactive simulation). The internal input/output (I/O) module <NUM> of the instrument module <NUM> may connect one or more tangible instruments integrated with the instrument module <NUM>. The I/O <NUM> may comprise necessary interface(s) to exchange data, set data or get data from such integrated tangible instruments. The internal I/O module <NUM> may be required, for instance, for interfacing the interactive computer simulation system <NUM> with one or more integrated tangible instrument identical to an Original Equipment Manufacturer (OEM) part (e.g., a tangible instrument exactly as the one that would be found in the actual system subject of the interactive simulation). The I/O <NUM> may comprise necessary interface(s) to exchange data, set data or get data from such integrated tangible instruments.

In some embodiments, a simulation plan may further be loaded (not shown) from the storage system <NUM> in relation the interaction computer simulation that involves the virtual simulated element. The simulation plan may comprise a training plan, a lesson plan or a scenario-based plan (e.g., with specific or dynamic objectives to be reached). The simulation plan may also be used alternatively or additionally to set the period of time covering simulated events from the interactive computer simulation related to the selected virtual subsystem.

The interactive computer simulation system <NUM> is typically used to train personnel for complex and /or risky operations. Each interactive computer simulation provides a virtual environment and various tangible instruments (or controls) to allow enactment of different scenarios for the purpose of training one or more users (or trainees), using one or more of the virtual simulated elements, in the operation and/or understanding of the corresponding one or more actual systems. In some situations, real-life training is simply not possible because the target scenario cannot be enacted safely in the real-life (e.g., military mission, rescue mission, medical treatment or operation, etc.). In other situations, it is impractical and/or too costly to enact the training scenario in real-life. The interactive computer simulation system <NUM> alleviates the risks and allows for repeated training. The interactive computer simulation system <NUM> also limits the overall costs of training when compared to real-life training. Evaluating the performance of the trainee, while it is sometimes only useful, may be critically important (e.g., evaluating preparedness before a mission, certifying competences for license purposes, etc.).

Typically, an evaluation of a trainee in the context of the interactive computer simulation system <NUM> consists of an assessment by an instructor based on an interpretation of collected information (e.g., stored dynamic data associated with different events) as well as on visual subjective observations performed by the instructor during the simulation. While it is agreed that a certain level of subjectivity is inherent to most if not all evaluations, there is a perceived risk that the competences of the trainees may not be properly and systematically assessed. For instance, two different instructors may make different visual observations and interpret the same collected information differently. Similarly, quality and/or completeness of the collected data may not sufficient to properly assess performance.

For instance, different interactive computer simulation stations <NUM> may comprise slightly different versions of the tangible instrument module <NUM> for a single virtual element, leading to differences in the collected dynamic data (e.g., different avionics components in two replicated cockpit of different aircraft simulators for the same real aircraft). Furthermore, some data from dynamic subsystems necessary for the purpose of evaluation of may not be collected at all (e.g., because the data is not exposed to the rest of the virtual environment). For instances, data collected for an aircraft yoke may comprise simulated hydraulic pressure levels in different affected subsystems without comprising the angular position of the actual hardware yoke in the replicated cockpit, or vice-versa. Synchronization of the dynamic data may also create discrepancies in the quality of the resulting evaluation. Typically, the simulation of each of the systems and subsystems requires clock signals (or time steps) for the purpose of synchronization. While a subsystem typically keeps a single time step throughout a given interactive computer simulation, the time step for different subsystems may be different. Conversely, for data collection efficiency purposes, the time at which the dynamic data is collected is not typically constant throughout the simulation and may not either be the same as the initially defined time steps. This discrepancy leads to different integration steps, which, for dynamic systems and subsystems, may induce states divergence. For non-dynamic systems, the difference in time steps induces time delays that might have critical impact on the states being recreated. As another example, some simulators will fully virtualize the tangible instrument <NUM> output inside the interactive simulation station <NUM> and collect the dynamic data in the form of digital value accordingly (i.e., store a vector of flight-related instructions instead of storing a vector of angular positions for the aircraft yoke). The virtualization made of any given instrument is dependent on technologies available at the time of the development of the virtual element and, when a real instrument is integrated in a replicated environment, is also dependent on the technologies used by the manufacturer of the instrument. The resulting collected data may therefore present disparities considering the manner in which the virtualization has been made.

Reference is now made to <FIG>. <FIG> depicts an example of data exchange in the context of training of one or more users in completion of one or more training activities. <FIG> provides an exemplary modular view of the system <NUM> where multiple interactive training simulation stations (<NUM> and <NUM>) are depicted. Examples of training activities are depicted respectively on <FIG> (<NUM>) and <FIG> (<NUM>), in relation to flight simulations. Of course, skilled persons will acknowledge that the teachings presented herein are applicable to many different types of interactive simulations and training activities (e.g., flight, land and/or marine vehicle, healthcare-related element, etc.). On <FIG>, the virtual element is a simulated aircraft <NUM> on a flight path <NUM>. The training activity <NUM> consists for one or more trainees to land the virtual aircraft <NUM>. In the interactive computer simulation station <NUM>, the trainees interact with the tangible instrument module <NUM> to control the virtual aircraft <NUM>. Different stages <NUM>, <NUM>, <NUM>, <NUM>, <NUM> are defined for the training activity and different standard operation procedures (SOPs) <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> for the stages.

On <FIG>, the training activity <NUM> consists for one or more trainees to follow a defined flight trajectory during which the virtual aircraft <NUM> is expected to perform against a predefined pattern. In the interactive computer simulation station <NUM>, the trainees interact with the tangible instrument module <NUM> to control the virtual aircraft <NUM>. Different manoeuvers are measured at different points <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and <NUM> for the training activity. On the depicted example <NUM>, first grades are awarded for each of the maneuvers (e.g., between <NUM> and <NUM>, between <NUM> and <NUM>, between <NUM> and <NUM>, etc.) and a grade is awarded for the complete training activity <NUM>, which may also be referred to as a nested maneuver (i.e., a maneuver that consists of multiple individual maneuvers performed in a specific manner and/or order).

In <FIG>, a simulator data acquisition <NUM> represents the collection of "raw" dynamic data related to one or more interactive computer simulations. For instances, it may represent flight telemetries related to an aircraft in a flight simulation. The simulator data acquisition <NUM> of the dynamic data happens at or from the interactive computer simulation station <NUM>. For instance, dynamic data related to dynamic systems and dynamic subsystems is collected, without analysis or synchronization (e.g., as it is produced or emitted from different components of the interactive computer simulation). The simulation-related data is sent <NUM> to a data frame processor <NUM>. While a single arrow is shown <NUM>, it should be understood that the simulation-related data is continually provided to the data frame processor <NUM> as it is collected. The data frame processor <NUM> builds <NUM> simulation data frames from the received data. For instance, in the example of a flight simulation, building <NUM> the simulation data frames at the data frame processor <NUM> may involve converting raw flight telemetries into a synchronized time series required for event detection. An example of how building <NUM> the simulation data frames can be performed is provided with particular reference to <FIG> hereinbelow. Again, it should be understood that the simulation data frames are continually provided from the data frame processor <NUM>, e.g., in accordance with a target time step. The simulation data frames comprise performance metric values related to the ongoing interactive computer simulation.

Different consumers may be interested in the simulation data frames. The example of <FIG> shows a simulation event detection <NUM> entity and a training event detection <NUM> entity, which are involves in assessment of performance of one or more users during the interactive computer simulation. Examples of consumers, amongst others, may comprise a maintenance agent for the interactive computer simulation station (e.g., in relation to QTGs) and accounting systems (e.g., in relation to occupancy and/or costs of operation). In the example of <FIG>, the simulation data frames are sent <NUM>, <NUM> respectively towards a simulation event detection <NUM> entity and a training event detection <NUM> entity. Note that it may be pushed through a broadcast and/or multicast mechanism and/or could be pulled by the consumers.

The simulation event detection <NUM> entity is then shown detecting <NUM> a simulation event in the received data. The detection <NUM> may be the result of processing a single of the received frames or the result of processing multiple frames, whether received consecutively or not. For instance, the detected event may be related to a general parameter of the virtual element being simulated (e.g., speed, altitude, temperature, ambient conditions in the interactive computer simulation station, etc.). The detected event may be the result of processing the data frame to detect flight event (ex: a flight exceedance or any other flag on flight status). It may be necessary to persistently collect the detected event <NUM> (e.g., depending on the nature of the event or the relation of the event to the training activity). The related data is then sent <NUM> for storage at an analytic storage <NUM> (e.g., part of the storage system <NUM>). The analytic storage <NUM> may be a database (e.g., SQL compatible) and may further be used to hold scorecards and other analytic data related to training activities.

The training event detection <NUM> entity is then shown detecting <NUM> a training event in the received data. The detection <NUM> may be the result of processing a single of the received frames or the result of processing multiple frames, whether received consecutively or not. For instance, the detected event may be related to a standard operation procedure (SOP) as depicted on <FIG>, an individual maneuver from <FIG> or the nested maneuver <NUM> altogether. It may be necessary to persistently grade the detected event <NUM> (e.g., depending on the nature of the event or the relation of the event to the training activity). The related data is then sent <NUM> for analysis by a grading calculator <NUM> that may further require additional simulation related events to properly compute <NUM> the grade and build a related scorecard. Additional simulation related data may then be requested <NUM> from the analytic storage <NUM> and returned <NUM> thereby, if anything relevant exists (e.g., during computational regression following a causal model to identify a root cause, to grade a nested maneuver, etc.). The related scorecard is then sent <NUM> for storage at the analytic storage <NUM>.

The simulation event detection <NUM> entity may also more selectively detect <NUM> a simulation event in the received data considering scorecards related to the training activity (e.g., a specific period or trigger point from the interactive computer simulation). The simulation event detection <NUM> may therefore requests scorecards <NUM> from the analytic storage <NUM>, which returns <NUM> relevant ones, if any therefrom. The detection <NUM> may be the result of processing a single of the received frames or the result of processing multiple frames, whether received consecutively or not. For instance, the detected event may be related to a general parameter of the virtual element being simulated in relation to the training activity (e.g., speed, altitude, temperature whereas ambient conditions in the interactive computer simulation station may not be relevant, etc.). The detected event may be the result of processing the data frame to detect flight event (ex: a flight exceedance or any other flag on flight status). It may be necessary to persistently collect the detected event <NUM> (e.g., depending on the nature of the event or the relation of the event to the training activity). The related data is then sent <NUM> for storage at the analytic storage <NUM>. In some embodiments, the simulation mapping system <NUM> comprises the data frame processor <NUM>, the simulation event detection <NUM>, the analytic storage <NUM>, the training event detection <NUM> and the grading calculator <NUM>.

Reference is now made to <FIG>, <FIG> and <FIG> depicting a first set of embodiments. In the depicted example, the simulation mapping system <NUM> is for determining a plurality of performance metric values in relation to a training activity performed by a user in an interactive computer simulation. The interactive computer simulation simulates a virtual element (e.g., flight, land and/or marine vehicle, healthcare-related element, etc.) comprising a plurality of dynamic subsystems. The simulation mapping system comprises a processor module (e.g., <NUM>, <NUM>) that obtains dynamic data related to the virtual element being simulated in an interactive computer simulation station comprising a tangible instrument module. The dynamic data captures actions performed by the user during the training activity on one or more tangible instruments of the tangible instrument module.

The processor module also constructs a dataset corresponding to the plurality of performance metric values from the dynamic data having a target time step by synchronizing dynamic data from at least two of the dynamic subsystems into the dataset considering the target time step, the at least two of the dynamic subsystems being associated to at least one common performance metric values from the plurality of performance metric values and by inferring, for at least one missing dynamic subsystems of the plurality of dynamic subsystems missing from the dynamic data, a new set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one missing dynamic subsystems impacting at least one common performance metric values from the plurality of performance metric values.

In the first set of embodiments a second aspect is directed to a method <NUM> for determining a plurality of performance metric values in relation to a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element comprising a plurality of dynamic subsystems. The method <NUM> comprises obtaining <NUM> dynamic data related to the virtual element being simulated in an interactive computer simulation station comprising a tangible instrument module. The dynamic data captures actions performed by the user during the training activity on one or more tangible instruments of the tangible instrument module provided <NUM> to the user. The method <NUM> also comprises constructing a dataset corresponding to the plurality of performance metric values from the dynamic data having a target time step by synchronizing <NUM> dynamic data from at least two of the dynamic subsystems into the dataset considering the target time step, the at least two of the dynamic subsystems being associated to at least one common performance metric values from the plurality of performance metric values and inferring <NUM>, for at least one missing dynamic subsystem of the plurality of dynamic subsystems missing from the dynamic data, a new set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one missing dynamic subsystems impacting the at least one common performance metric values from the plurality of performance metric values. <NUM>, <NUM> and <NUM> are repeated (<NUM>) as needed considering the behavior of the virtual element / the user in the interactive computer simulation.

The method <NUM> may optionally further comprise obtaining dynamic data from a plurality of interactive computer simulation stations, wherein constructing the dataset having the target time step is performed for the plurality of interactive computer simulation stations.

The method <NUM> may optionally further comprise providing the dataset as a common standardized stream consumers, the consumers comprising a grading system. The common standardized stream may optionally comprise classification information related to the plurality of performance metric values.

The method <NUM> may optionally further comprise, when constructing the dataset corresponding to the plurality of performance metric values from the dynamic data having the target time, adding at least one simulated dynamic subsystem missing from the dynamic data and an additional set of data into the dataset from dynamic data associated to one or more co-related dynamic subsystems, the co-related dynamic subsystems and the at least one simulated dynamic subsystems impacting the at least one common performance metric values from the plurality of performance metric values.

Reference is now made to <FIG>, <FIG> and <FIG> depicting a second set of embodiments. In the depicted example, an interactive computer simulation system (e.g., <NUM>) is provided for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The interactive computer simulation system comprises an interactive computer simulation station (e.g., <NUM>) and a processor module (e.g., <NUM>, <NUM>). The interactive computer simulation station comprises a tangible instrument module (e.g., <NUM>), the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation.

The system may optionally further comprise a simulation mapping system (e.g., <NUM>) for determining a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems. The plurality of performance metric datasets may be provided by the simulation mapping system.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the detected SOPs. The information for display in the interactive computer simulation related the SOPs may further comprise the grading scorecard for the detected SOPs. The detected actual maneuvers may be logged for post-activity debriefing.

In the second set of embodiments, a second aspect is directed to an interactive computer simulation station (e.g., <NUM>) for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The interactive computer simulation station comprises a tangible instrument module <NUM>, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module.

The processor module (e.g., <NUM>) obtains a plurality of performance metric datasets related to the virtual element being simulated, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module and, during execution of the interactive computer simulation, detects, in the plurality of performance metric datasets, a plurality of actual maneuvers of the virtual element during the training activity, identifies one or more standard operating procedures (SOP) for the training activity from a plurality of the individually detected actual maneuvers and provides, in real-time upon detection of the SOPs, information for display in the interactive computer simulation related the SOPs.

The interactive computer simulation station may further comprise a network interface nodule (e.g., <NUM>) for receiving the plurality of performance metric datasets from a simulation mapping system that determines a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation.

In the second set of embodiments a third aspect is directed to a method <NUM> for training a user in an interactive computer simulation in the performance of a task through a training activity, the interactive computer simulation simulating a virtual element. The method <NUM> comprises in an interactive computer simulation station, providing <NUM> a tangible instrument module (e.g., <NUM>) to the user for controlling the virtual element in the interactive computer simulation. The method <NUM> also comprises obtaining <NUM> a plurality of performance metric datasets related to the virtual element being simulated, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module and, during execution of the interactive computer simulation at the interactive computer simulation station, detecting <NUM>, in the plurality of performance metric datasets, one or more actual maneuvers of the virtual element during the training activity, identifying <NUM> one or more standard operating procedures (SOP) from the detected actual maneuvers and displaying <NUM>, in real-time upon detection of the SOPs, information in the interactive computer simulation related the SOPs. <NUM>, <NUM>, <NUM> and optionally <NUM> may be repeated <NUM> multiple times, depending on the behavior of the virtual element / the user in the interactive computer simulation.

The method <NUM> may further optionally comprise determining, at a simulation mapping system, a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems. The plurality of performance metric datasets may be provided by the simulation mapping system.

The method <NUM> may further optionally comprise obtaining a scorecard related to the training activity to establish a list of the one or more SOPs of interest. The one or more SOPs may further identify the plurality of the individually detected actual maneuvers related thereto.

The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the detected SOPs. The information for display in the interactive computer simulation related the SOPs may then optionally comprise the grading scorecard for the detected SOPs.

The method <NUM> may further optionally comprise logging the detected actual maneuvers and debriefing the training activity from the logged detected actual maneuvers.

In some embodiments, the method <NUM> may further optionally comprise obtaining a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers comprising a plurality of expected individual maneuvers expected and one or more nested maneuvers formed by more than one individual maneuvers from the plurality of expected individual maneuvers, computing the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifying and grades one or more actual nested maneuvers against corresponding ones of the expected nested maneuvers and, notwithstanding performance of the actual nested maneuvers, identifying and grading a plurality of actual individual maneuvers against the plurality of expected individual maneuvers.

Reference is now made to <FIG> and <FIG> depicting a third set of embodiments. An interactive computer-based training system (e.g., <NUM>) is depicted for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The training system comprises an interactive computer simulation station (e.g., <NUM>) comprising a tangible instrument module (e.g., <NUM>), the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module (e.g., <NUM>, <NUM>). The processor module obtains a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module, obtains a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers, computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifies one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performs computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

In the third set of embodiments a second aspect is directed to an interactive computer simulation station (e.g., <NUM>) for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The interactive computer simulation station comprises a tangible instrument module (e.g., <NUM>), the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation and a processor module. The processor module (e.g., <NUM>) obtains a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module, obtains a plurality of expected maneuvers of the virtual element during the training activity, the plurality of expected maneuvers, computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifies one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performs computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

In the third set of embodiments a third aspect is directed to a method <NUM> is depicted for assessing a training activity performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element. The method <NUM> comprises obtaining <NUM> a plurality of performance metric datasets related to the virtual element being simulated the interactive computer simulation station, the plurality of performance metric datasets representing results of interactions of the user provided <NUM> with a tangible instrument module (e.g., <NUM>) in an interactive computer simulation station, the user interacting with the tangible instrument module for controlling the virtual element in the interactive computer simulation, obtaining <NUM> a plurality of expected maneuvers of the virtual element during the training activity, computing <NUM> the plurality of performance metric datasets to identify actual maneuvers of the virtual element during the training activity, identifying <NUM> one or more failed actual maneuvers of the virtual element during the training activity against corresponding ones of the expected maneuvers and performing <NUM> computational regression on the actual maneuvers of the virtual element compared to the expected maneuvers of the virtual element to identify one or more root causes of the failed actual maneuvers, the computational regression being performed on the actual maneuvers notwithstanding the corresponding expected maneuvers being met thereby.

The method <NUM> may optionally further comprise determining, at a simulation mapping system (e.g., <NUM>), a plurality of performance metric values in relation to the training activity performed by the user in the interactive computer simulation, the interactive computer simulation simulating the virtual element comprising a plurality of dynamic subsystems, wherein the plurality of performance metric datasets is provided by the simulation mapping system.

The method <NUM> may optionally further comprise mapping, in real-time, each one of the actual maneuvers of the virtual element during the training activity on causal model for linking the one actual maneuver with previous ones of the actual maneuvers. The method <NUM> may then further comprise associating a probability rating to the one or more root causes of the failed actual maneuvers considering the causal model and providing to an instructor of the user, in real-time, the one or more root causes of the failed actual maneuvers. The plurality of performance metric datasets related to the virtual element being simulated may be used to provide a grading scorecard for the actual maneuvers. The method <NUM> may optionally further comprise providing <NUM> for display in the interactive computer simulation the grading scorecard for the actual maneuvers. <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and optionally <NUM> may be repeated <NUM> multiple times, depending on the behavior of the virtual element / the user in the interactive computer simulation.

Claim 1:
An interactive computer-based training system (<NUM>) for assessing a training activity (<NUM>, <NUM>) performed by a user in an interactive computer simulation, the interactive computer simulation simulating a virtual element (<NUM>), the training system (<NUM>) comprising:
an interactive computer simulation station (<NUM>) comprising a tangible instrument module (<NUM>), the user interacting with the tangible instrument module for controlling the virtual element (<NUM>) in the interactive computer simulation; and
a processor module (<NUM>, <NUM>) that:
obtains a plurality of expected maneuvers of the virtual element at different stages (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>) during the training activity (<NUM>, <NUM>);
obtains a plurality of performance metric datasets related to the virtual element (<NUM>) being simulated by the interactive computer simulation station (<NUM>), the plurality of performance metric datasets representing results of the interactions between the user and the tangible instrument module (<NUM>);
computes the plurality of performance metric datasets to identify actual maneuvers of the virtual element (<NUM>) during the training activity (<NUM>, <NUM>);
maps, in real-time, each one of the actual maneuvers of the virtual element (<NUM>) at the different stages (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>) during the training activity (<NUM>, <NUM>) on a causal model for linking the one actual maneuver with previous ones of the actual maneuvers;
identifies as a failed actual maneuver at one of said stages (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>), among said actual maneuvers, an actual maneuver at said one stage that the user failed to perform compared to an expected maneuver at the one stage;
performs computational regression on the actual maneuvers of the virtual element (<NUM>) compared to the expected maneuvers of the virtual element (<NUM>) to identify one or more root causes of the failed actual maneuvers based on the causal model, the computational regression being performed on the actual maneuvers even if some of the actual maneuvers are not identified as failed actual maneuvers; and
provides to an instructor of the user, in real-time, the one or more root causes of the failed actual maneuvers.