# Patent

## Title
Method and system for generating a skill sheet

## Abstract

A method and system generates skill sheets for a user participating in a medical emergency response simulation program. Providing a simulation scenario, a skill sheet template is chosen. The skill sheet template comprises a plurality of line items. The relevance of the line items are determined. Each relevant line item is evaluated and a score is computed. A skill sheet is generated from the evaluated line items of the skill sheet templates. The skill sheets generated are in compliance with Department of Transportation standards.

## Background
BACKGROUND
Emergency medical services (EMS) personnel must obtain and maintain various certifications in order to work in their profession and treat patients. To become certified or maintain certification, EMS personnel must take and pass standardized written and practical tests. The standards adhered to by these tests are specified by organizations such as the U.S. Department of Transportation (DOT) and the National Registry of Emergency Medical Technicians (NREMT).
The tests include an evaluation of a candidate's skill in conducting patient assessment and making appropriate treatment decision using standardized protocols for medical, trauma, and cardiac patient problems. The evaluations are conducted by an instructor using a set of standardized skill sheets that specify the protocol order and points possible for each action or decision on the skill sheet.
FIG. 1 shows an exemplary prior art medical skill sheet used by an instructor. As shown, the skill sheet is very comprehensive and comprises line items for areas such as “SCENE SIZE-UP” 10, “INITIAL ASSESSMENT” 20, “FOCUSED HISTORY AND PHYSICAL EXAMINATION/RAPID ASSESSMENT” 30, “ON-GOING ASSESSMENT” 40, and “CRITICAL CRITERIA” 42. All line items, such as line item 70, “Determines responsiveness/level of consciousness” have a “Possible Points” 50 and a “Points Awarded” 60 for scoring the candidate.
During a test, the instructor presents the candidate with a scenario. The scenario is described by the instructor, and also may include actors acting out the scenario. The candidate must articulate their decision and actions, sometimes physically demonstrating various actions. For example, depending on the scenario, a candidate may need to open a patient's airway with a head-tilt-chin-lift motion. As the candidate describes and performs the actions, the instructor uses the appropriate skill sheet to check-off and score the student on each line item.
The skill sheets are one of the most difficult items for a candidate to master since they integrate many aspects of classroom and book learning. The best way for a candidate to prepare for a skill sheet test and improve their proficiency is though practice and repetition. Unfortunately, it is often difficult to arrange for practice tests since a qualified and objective instructor is required to conduct the drill and allow the candidate to repeat the drill a multiple number of times. Additionally, actors may be necessary, further complicating the situation. Furthermore, while the instructors should ideally be objective and follow the protocols precisely, oftentimes they are not or cannot be due to fatigue, level of experience, personal feeling towards the candidate, and the like.
Thus a need presently exists for a method and system for generating a skill sheet in a consistent and objective manner, and without the limitations of the prior art.
SUMMARY
By way of introduction, the preferred embodiments below provide a method and system for generating a skill sheet. Skill sheets are generated for a user participating in a simulation program such as a medical emergency response simulation program. The simulation program comprises a human model for simulating the response of a simulated human subject to the input of the user. Providing a simulation scenario, a template is chosen. The template comprises a plurality of line items. The relevance of the line items is determined. The relevance may be determined at the outset of the simulation scenario and dynamically during the simulation according to user input. The relevant line items are evaluated which includes computing a score for the relevant line items. A skill sheet is generated comprising the scored line items of the skill sheet template. The skill sheets are generated in a format consistent with a standard such as a Department of Transportation standard or a National Registry of Emergency Medical Technicians standard. A system comprises a simulator comprising a human model. An event logger is in communication with the simulator. An evaluator is in communication with the simulator and with the event logger. At least one skill sheet template is in communication with the evaluator. A skill sheet generator is in communication with the evaluator. The simulator and the event logger receives user input.
The foregoing paragraph has been provided by way of general introduction, and it should not be used to narrow the scope of the following claims. The preferred embodiments will now be described with reference to the attached drawings.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a prior art medical skill sheet.
FIG. 2 is a system for generating a skill sheet.
FIG. 3 is a method for generating a skill sheet.
FIGS. 4A–D is a medical skill sheet template.
FIGS. 5A–C is a trauma skill sheet template.
FIGS. 6A–C is a cardiac skill sheet template.
FIGS. 7A–D is a skill sheet resulting from a simulation.
FIGS. 8A–C is a medical skill sheet resulting from a simulation.



DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS
FIG. 2 shows a system for generating a skill sheet. The present invention generates a skill sheet for a user, such as an EMS candidate, participating in a medical emergency response simulation program. The system comprises a simulator 210 that receives as input user input 200. The simulation program comprises a human model 212 for simulating the response of a simulated human subject, or patient, according to the input of the user 200. The simulation program allows the user to gather relevant information about a patient's signs, symptoms, prior history, and perform various treatments and appropriate EMS communications. One example of a simulation program is Brady's Medical Emergency Response Simulator by Summit Performance Group, LLC, and published by Prentice Hall.
The system further comprises an event logger 220 that receives as input the user input 200 and the output of the simulator 210. The output of the simulator comprises variables indicating the status of the patient 212 and the type of user input 200. Some examples of user input are variables indicating at what time the user arrived on the scene, when the user started to transport the patient, when the user called advanced life support, when the user examined a particular body part, when the user asked witnesses questions, and the like. Some examples of simulator output are errors such as the inappropriate use of pain stimulus, completed actions such as if the user asked the patient a question and whether the patient was able to respond, and progression events such as whether the patient is in cardiac arrest, has a spinal cord injury, has respiratory distress, and the like.
The event logger 220 stores user input 200 and the simulator output 210. An evaluator 230 receives as input the output of the event logger 220 and the output of the simulator 210. The evaluator also receives as input skill sheet templates 240. The evaluator 230 and skill sheet templates 240 will be described in greater detail below. A skill sheet generator 250 receives the output of evaluator 230. The generator 250 produces a scored skill sheet in an acceptable format for display to the user.
Briefly, simulator 210 simulates a patient according to one of a multiplicity of simulation scenarios, and further simulates the response of the patient to the actions of the user 200. The user 200 interacts with the patient to determine the patient's problem or problems. The user 200 may also administer various forms of medical treatment to the patient. The user actions 200 as well as the output of simulator 210 are logged by the event logger. The appropriate skill sheet templates 240 are chosen according to the simulation scenario and the user input. An evaluator scores the skill sheet templates by examining the output of the simulator and the output of the event logger 220. The evaluator evaluates according to appropriate standards, such as the DOT standards, and in compliance with industry standard skill sheets and skill sheet scoring protocols. The skill sheet generator 250 generates a skill sheet or skill sheets comprising the scores evaluated by the evaluator 230 along with any comments or other appropriate text.
FIG. 3 shows a method for generating a skill sheet. The simulation program 210 provides a multiplicity of simulation scenarios for allowing the user to practice emergency medicine on the human model or patient 212. Some examples of simulation scenarios are the patient has chest pains and goes into cardiac arrest, the patient has hypoglycemia, the patient has a stroke, the patient has a broken wrist, the patient has internal bleeding, the patient has external life threatening bleeding, and the like. It is appreciated by those of ordinary skill in the art that many more simulation scenarios are possible.
Referring to FIG. 3, and providing one of the multiplicity of simulation scenarios (step 100), a skill sheet template is chosen (step 102). Depending on the simulation scenario more than one skill sheet template may be chosen. It is also possible that, as the simulation executes and the user interacts with the patient, an additional skill sheet template that was not chosen at the outset of the simulation is chosen during the simulation.
A medical skill sheet template is shown in FIGS. 4A–D. The skill sheet template comprises a plurality of line items. The line items represent actions that the user may take during the simulation. The line items are grouped by categories such as “SCENE SIZE-UP” 110 (FIG. 4A), “INITIAL ASSESSMENT” 112 (FIG. 4A), “FOCUSED HISTORY AND PHYSICAL EXAM/RAPID ASSESSMENT” 114 (FIG. 4B), “ONGOING ASSESSMENT” 116 (FIG. 4C), and “CRITICAL CRITERIA” 118 (FIG. 4D). Each line item comprises a condition variable 122, a points possible variable 126, and a points awarded variable 128. Each line item may also comprise a text message 124, and a comment 130. Examining line item 120 of FIG. 4B, the condition variable 122 is medicalPoints[18], the text message 124 is “Signs and Symptoms (Assess history of present illness),” the points possible variable 126 is medicalPossible[18], and the points awarded variable 128 is medicalPoints[18]. As shown, the condition variables 122, points possible variables 126, and points awarded variables 130 are members of arrays. Additional skill sheet templates are shown in FIGS. 5A–C and 6A–C. FIGS. 5A–C is a trauma skill sheet template. FIGS. 6A–C is a cardiac skill sheet template. FIGS. 5A–C and 6A–C follow the same format as the medical skill sheet template of FIGS. 4A–D, but comprise different line items. The templates of FIGS. 4A–D, 5A–C, and 6A–C comprise line items consistent with DOT standard skill sheets. Other skill sheet templates comprising line items consistent with other standard skill sheets such as AHA standard skill sheets and NREMT standard skill sheets may be used.
Each simulation scenario (step 100) comprises a set of skill sheet variables for choosing a skill sheet template (step 102 and 240 of FIG. 2). For example, if the simulation scenario simulates a patient with a broken wrist, the skill sheet variables indicate that medical_skill_sheet=false, trauma_skill_sheet=true, and cardiac_skill_sheet=false, that is the medical and cardiac skill sheet templates are not chosen, and the trauma skill sheet template is chosen. For more complicated simulation scenarios, the skill sheet variables may change dynamically during the execution of the simulation scenario. For example, in a different simulation, the patient may not develop a cardiac problem until well into the simulation. The cardiac problem may be induced by a bad choice taken by the user. In one simulation the patient does not go into cardiac arrest until two minutes into the simulation. At that time, the cardiac_skill_sheet variable may change from false to true.
Upon choosing a skill sheet template (step 102), the relevance of each line item of the plurality of line items is determined (step 104). Some line items will always be relevant regardless of the simulation scenario. For example line item 134 of the medical skill sheet template of FIG. 4A, “Forms general impression of patient,” is always relevant according to DOT standards. Other line items will be relevant depending upon the simulation scenario, or depending upon user input.
Each simulation scenario maintains relevance variables for indicating which line items are relevant so at the outset of the simulation, those line items are determined in compliance with the prevailing standards. For example, if the simulation scenario comprises an unconscious patient, line items comprising taking c-spine precautions are always relevant according to DOT standards. Also, if a child in the simulation scenario has fallen a distance of greater than ten feet, or the simulation comprises a motor vehicle accident, the line items comprising taking c-spine precautions are indicated as relevant according to DOT standards.
Some line items, while not determined as relevant by the relevance variables, can become relevant as the simulation progresses, or due to user input. For example, if the user takes c-spine precautions on the patient when no c-spine precaution is indicated or necessary, the line items associated with c-spine precautions are determined as relevant, and the user will be evaluated on those line items as described below in accordance with the prevailing standards.
Referring back to FIG. 3, the relevant line items are evaluated (step 106) according to user input to the simulation scenario as logged by the event logger 220 and indicated by the output of the simulator 210. Proper and appropriate user actions for a patient is fully specified in prevailing standards, such as the DOT standard. Other standards are, for example, the U.S. Department of Transportation (DOT) National Highway Traffic Safety Administration (NHTSA) National Standard Curriculum (NSC) for First Responder, Emergency Medical Technician—Basic, Emergency Medical Technician—Intermediate, and Emergency Medical Technician—Paramedic; the American Safety and Health Institute (ASHI) for Automated External Defibrillator (AED), Advanced Cardiac Life Support (ACLS), First Responder, Oxygen Administration, Wilderness Emergency Care (WEC), Safety Training and Aquatic Rescue (STAR), CPR for Community, Workplace and Professional Rescuers, and Basic First Aid; the American Heart Association for Advanced Cardiac Life Support (ACLS), Pediatric Advanced Life Support (PALS), Basic Life Support (BLS), and Cardiopulmonary Resuscitation (CPR) and Emergency Cardiovascular Care; the American Red Cross for First Aid, CPR and AED, and Water Safety; the National Ski Patrol (NSP) for Outdoor Emergency Care Skill Guides; the U.S. Federal Emergency Management Agency (FEMA) for Terrorism Awareness, and Terrorism Operations; the American College of Surgeons for Advanced Trauma Life Support, Prehospital Trauma Life Support; the National Registry of EMTs (NREMT) for EMT—Basic, and EMT—Paramedic; the American Academy of Pediatrics for Pediatric Prehospital Pediatric Care; and the National Association of EMTs for Pediatric Prehospital Emergency Care.
As mentioned above, user input may comprise querying the patient, communicating with the patient, checking vital signs of the patient, administering various forms of treatment such as drugs, immobilization, wound treatments, and the like. An extensive database of questions and actions the user can take is maintained by the simulator 210 and made available to the user 200 in the form of a toolbox. The user has access to the toolbox and can choose from a multiplicity of actions, even if it is an incorrect action, to take given the situation and feedback provided to the user by the patient 212.
The evaluator 230 (FIG. 2) evaluates each relevant line item (step 106 of FIG. 3). Evaluating comprises computing a score, or points awarded (128 of FIGS. 4A–D), for each relevant line item. For some line items, the score is computed while the simulation is executing. For other line items, the score is computed after the simulation has ended by using, at least in part, the logged events stored by the event logger 220 (FIG. 2). The type and sequence of user input in order to receive a correct line item score varies according to each line item and simulation. By way of example, the “Altered Mental Status” (132 of FIG. 4B) category comprises a multiplicity of line items. The DOT skill sheet procedures prescribe that the user should elicit information about the episode 135, onset 135, duration 135, associated symptoms 136, evidence of trauma 137, interventions 138, seizure 139, and fever 140. If the user does this in accordance with prevailing standards, the associated line items will receive a correct score. Some user actions can be applied to all cases of altered mental status, for example checking the patient's forehead skin condition to determine if they have a fever. Some correct user actions are more specific to the particular simulated patient problem, such as if the underlying problem is a stroke, the user should check for any weakness or motor deficit on one side. If the patient is an unresponsive seizure patient, a more detailed examination of the head, including an examination of the ears, mouth, etc., is required according to prevailing assessment protocols. A correct line item score for most line items is a score equal to one, although some line items may have a score of greater than one, or may have a score of “OK” or “n/a.”
The evaluator 230 comprises procedures for determining if the type of user actions, and optionally the sequence of user actions are correct. In one exemplary procedure shown below, the simulation scenario is a complex trauma and medical case. The following exemplary procedure checks for a trauma case with a diabetes problem, and then checks if the user actions are in compliance with accepted protocols:
















if (diabetes problem AND a trauma case) then
-complex trauma




and medical case



--1: episode, onset, duration: 33
-ask question 33



--2: associated Sx: 3,50,53,56
-questions to ask









--3: evidence of trauma: examine head and pupils with











penlight



--4: interventions: 117
-ask question 117



--5: seizure: 102
-ask question 102



--6: fever: get temperature
-palpate body part




forehead










If all of the above user actions are performed then the relevant line items are scored with the maximum points possible. The actions are received by the evaluator 230 from the event logger 220, the simulator 210, or both. If some or all of the actions are not taken, the score may be reduced. Some routines also specify that user action must occur according to a specific sequence and within certain time periods to be considered correct. Each line item is evaluated according to a routine such as shown above and as specified in the DOT and other appropriate standards.
Some user input is logged by the event logger (220 of FIG. 2). The logged input is referenced by procedures such as shown above at a later time in the simulation, or after the simulation has ended, to evaluate each relevant line item score. For example, if the user inappropriately administers pain stimulus, the sequence and timing of the user action is not important. However, the mistake should be indicated by a line item score along with any relevant comments (130 of FIG. 4A). Such user actions are logged by the event logger 220. Errors are also logged dynamically, while the simulation is executing. For example if the user places the patient on a spine board after beginning transport of the patient, an error is logged by setting a variable. The variable is used when computing the line item score according to a procedure such as shown above. User input may also comprise time stamps so that the correctness of the user input can be computed based on the absolute time, relative time, or both. An example of absolute time is a defibrillator shock must be administered to the patient within 90 seconds of cardiac arrest. An example of relative time is an airway must be opened before inserting an airway adjunct. Some line items require multiple actions to be performed correctly and in the correct order.
A complete exemplary evaluation procedure for medical skill sheet line item 18 (120 of FIG. 4B) is shown below. Evaluation procedures for medical skill sheet line item 24 and line item 33 are also shown. As described with reference to the above procedure, the numbers refer to question number indexes stored in the question database, but may also refer to body part number indexes for performing actions on specified body parts as indicated by the comments in the procedure below. Thus, medical skill sheet line item 18 procedure is as follows:












if the present illness is altered mental status then


   set DOTMedicalHx.AMS.indicated to 1  -- this causes the


      correct output to be displayed (see Exhibit C)


   set DOTMedicalHx.AMS.bodyPart to “head”


if stroke problem then


   --1: episode, onset, duration: 81,96; 33; 110 -- questions


      that must be asked while Pt. is conscious


   --2: associated Sx: 3,50,53,56,83,84,85,107,108 -- questions


      that must be asked while Pt. is conscious


   --3: evidence of trauma: examine head with examine tool and


      pupils with penlight








   --4: interventions: 117
-- question that must be







      asked while Pt. is conscious








   --5: seizure: 102
-- question that must be







      asked while Pt. is conscious


   --6: fever: get temperature - palpate bodypart forehead


   -- Focused Exam Requirements ---- medical skill sheet line


      item 24: “Problem focused physical examination” -----


   set DOTMedicalHx.bodyPart to “head”








   set DOTMedicalHx.examine to “4”
-- this is a


      bodypart number







   set DOTMedicalHx.pupilCheckIndicated to true








   set DOTMedicalHx.questions to “”
-- no additional


      questions required


   set DOTMedicalHx.complexQuestions to “”
-- no additional







      questions required


   -- Ongoing Ax Requirements ---- medical skill sheet line


      item 33: “Repeats focused assessment regarding Pt


      complaints or injuries”


   set DOTMedicalHx.ongoingQuestions to “92,3,50,53”


   set DOTMedicalHx.OngoingComplexQuestions to “8”


if (diabetes problem AND a trauma case) then -- complex trauma


      and medical case


   --1: episode, onset, duration: 33


   --2: associated Sx: 3,50,53,56


   --3: evidence of trauma: examine head and pupils with


      penlight


   --4: interventions: 117


   --5: seizure: 102


   --6: fever: get temperature - palpate bodypart forehead


if (diabetes and NOT a trauma case) then


   --1: episode, onset, duration: 81,96; 33; nothing for


      duration


   --2: associated Sx: 3,50,53,56,83,84,85 -- need more in


      depth questions, pure medical case


   --3: evidence of trauma: examine head and pupils


   --4: interventions: 25


   --5: seizure: 102


   --6: fever: get temperature


   -- Focused Exam Requirements ---- medical skill sheet line


      item 24 -----


   set DOTMedicalHx.bodyPart to “head”


   set DOTMedicalHx.examine to “4”


   set DOTMedicalHx.pupilCheckIndicated to true


   set DOTMedicalHx.questions to “”


   set DOTMedicalHx.complexQuestions to “”


   -- Ongoing Ax Requirements ---- medical skill sheet line


      item 33 -----


   set DOTMedicalHx.ongoingQuestions to “92,3,50,53”


   set DOTMedicalHx.OngoingComplexQuestions to “8”


if (unresponsive seizure patient) then


   set DOTMedicalHx.AMS.indicated to 1


   set DOTMedicalHx.bodyPart to “head”


   --1: episode, onset, duration: no questions required, Pt


      can't respond


   --2: associated Sx: no questions required, Pt can't respond


   --3: evidence of trauma: examine head and pupils with


      penlight


   --4: interventions: no questions required, Pt can't respond


   --5: seizure: no questions required, Pt can't respond


   --6: fever: get temperature - palpate bodypart forehead


   -- Focused Exam Requirements ---- medical skill sheet line


      item 24 -----


   set DOTMedicalHx.bodyPart to “head”


   set DOTMedicalHx.examine to “2,4,5,6,7,8” -- more


      careful/detailed examination of head is indicated


   set DOTMedicalHx.pupilCheckIndicated to true


   set DOTMedicalHx.questions to “” - no questions required, Pt


      can't respond


   set DOTMedicalHx.complexQuestions to “” - no questions


      required, Pt can't respond


   -- Ongoing Ax Requirements ---- medical skill sheet line


      item 33 -----


   set DOTMedicalHx.ongoingQuestions to “” -- no questions


      required, Pt can't respond


   set DOTMedicalHx.OngoingComplexQuestions to “” -- no


      questions required, Pt can't respond









In executing the above procedures, variables are set indicating the number of user actions performed correctly and the number of user actions missed or performed incorrectly. The value of the variables are added and a percentMissed variable is set indicating the percentage of actions missed or done incorrectly. Based on the percentMissed variable, a score for line item 18, medicalPoint[18], is computed according to the following exemplary procedure of evaluator 230:















set medicalPoints[18] based on percentMissed:











  = 0%
:
medicalPoints[18] = 4 points



  <= 25%
:
medicalPoints[18] = 3 points



  <= 50%
:
medicalPoints[18] = 2 points



  <= 75%
:
medicalPoints[18] = 1 points



else
:
medicalPoints[18] = 0 points










As mentioned with reference to FIG. 4A, each line item has a points possible variable 126. The total number of points possible is set according to the simulation scenario and DOT or other skill sheet standards. Some line items may be determined as not relevant according to step 104 and are thus scored “n/a.”
Referring back to FIG. 3, after all line items are evaluated, a skill sheet is generated (step 108) from the evaluated line items of the skill sheet templates. The skill sheet is presented in a format such as a DOT format, an AHA format, or an NREMT format. The skill sheet may be displayed to the user on a computer screen or monitor, or may be printed. The skill sheet may also be put in the form of HTML (hypertext markup language) code for displaying via Internet web browsers. Many different skill sheets may be generated such as a trauma skill sheet, a medical skill sheet, a cardiac skill sheet, a cardio-pulmonary resuscitation skill sheet, and an automated external defibrillation skill sheet. Other examples of skill sheets and skill sheet formats include EMT skill sheets and EMT Paramedic Level of Practice skill sheets from the National Registry of Emergency Medical Technicians such as patient assessment/management—trauma, patient assessment/management—medical, cardiac arrest management/AED, big-valve mask apneic patient, spinal immobilization—supine patient, spinal immobilization—seated patient, immobilization skill—long bone, immobilization skills—joint injury, immobilization skills—traction splinting, bleeding control—shock management, airway, oxygen and ventilation skills—upper airway adjuncts and suction, mouth-to-mask with supplemental oxygen, oxygen administration, ventilatory management—endotracheal intubation, ventilatory management—dual lumen airway device insertion following an unsuccessful endotracheal intubation attempt, and ventilatory management—esophageal obturator airway insertion following an unsuccessful endotracheal intubation attempt. Further examples of skill sheets and skill sheet formats from the National Registry of Emergency Medical Technicians are bleeding control/shock management, dual lumen airway device, dynamic cardiology, intravenous therapy, oral station, patient assessment—medical, patient assessment—trauma, pediatric intraosseous infusion, pediatric ventilatory management, spinal immobilization—seated patient, spinal immobilization—supine patient, static cardiology, and ventilatory management—adult.
FIGS. 7A–D shows the printed output of an HTML generated skill sheet. The output comprises multiple skill sheets from one simulation scenario. In this simulation scenario, the trauma skill sheet was not relevant as indicated by the section entitled “Trauma Assessment & Management” in FIG. 7A. The cardiac skill sheet was also not relevant to this simulation as shown in FIG. 7D under the section entitled “Cardiac Arrest Management/AED.” The medical skill sheet, entitled “Medical Assessment & Management,” is shown in the FIGS. 7A–D. The skill sheet comprises the values of the variables of the line items of the medical skill sheet template (FIGS. 4A–D) as discussed above. For example, some line items comprise the text message (124 of FIG. 4A), the points possible (126 of FIG. 4A), the points awarded (128 of FIG. 4A), and comments (130 of FIG. 4A). A total, indicated by the label “TOTAL” in FIG. 7C is also displayed and shows the total points and percentage failure. FIGS. 8A–C show an alternative presentation of the medical skill sheet in the form of a screen output.
The present invention may be implemented on a computer such as a desktop or laptop computer commonly found in homes and businesses. A computer-readable medium may store instruction for generating the skill sheet which, when executed by a processor, such as a computer's processor, causes the processor to perform the steps of the methods described above. Examples of computer-readable medium are floppy disks, hard disk drives, DRAM, SRAM, flash memory, optical storage, magnetic storage, magneto-optical storage, non-volatile solid-state memory, volatile solid-state memory, and the like.
Other simulators can be used with the present invention. For example, a human model for Advanced Life Support (ALS) may be used for practicing skills such as intubation, 12-lead EKG operation, intravenous fluid (IV) and drug administration, and capnography and copnometry assessment. Another simulator includes terrorism awareness and operation simulation training for training first responders to assess scene safety, identify likely hazards, perform scene containment and patient triage, and the like. Yet another simulator comprises outdoor professional emergency medical training for assessing and treating patients given limited medical resources and long transportation times to definitive medical care. Outdoor professional emergency medical personnel include individual such as ski patrol personnel, forest fire fighters, and outdoor guides. Still another simulator is a simulator for non-professional individuals responding to immediate accidents or medical crises such as sudden cardiac arrest, home first aid, and child care. This simulator may include simulation scenarios for cardiopulmonary resuscitation and the application of automated external defibrillators.
The foregoing detailed description has discussed only a few of the many forms that this invention can take. It is intended that the foregoing detailed description be understood as an illustration of selected forms that the invention can take and not as a definition of the invention. It is only the following claims, including all equivalents, that are intended to define the scope of this invention.

## Claims

1. A method for generating a skill sheet for a user participating in a medical emergency response simulation program, the simulation program comprising a model for simulating the response of a simulated subject to the input of the user, the method comprising:
(a) providing a simulation scenario;
(b) choosing a skill sheet template, wherein the skill sheet template comprises a plurality of line items;
(c) determining which line items of the plurality of line items are relevant;
(d) evaluating each relevant line item; and
(e) generating a skill sheet according to said evaluating in (d).

2. The invention of claim 1 wherein said determining in (c) comprises determining according to the simulation scenario.

3. The invention of claim 1 wherein said determining in (c) comprises determining according to the user input.

4. The invention of claim 1 wherein said evaluating in (d) comprises computing a score for each relevant line item of the plurality of relevant line items.

5. The invention of claim 4 further comprising for each relevant line item, computing a number of possible points.

6. The invention of claim 4 further comprising for each relevant line item, computing the score by determining the sequence and type of the user input.

7. The invention of claim 6 further comprising computing the score by comparing the determined sequence and type of user input to a known correct sequence and type of user input.

8. The invention of claim 4 further comprising logging the user input and computing the score according to the logged user input.

9. The invention of claim 1 wherein said evaluating in (d) comprises evaluating while the simulation scenario is executing.

10. The invention of claim 1 wherein said evaluating in (d) comprises evaluating after the simulation scenario has ended.

11. The invention of claim 1 wherein said evaluating in (d) comprises assigning a comment to at least some of the plurality of relevant line items.

12. The invention of claim 1 wherein each relevant line item comprises a condition variable, a text message variable, a points possible variable, a points awarded variable, and a comments variable.

13. The invention of claim 1 wherein said generating in (e) comprises presenting the skill sheet to the user in a Department of Transportation format.

14. The invention of claim 1 wherein said generating in (e) comprises presenting the skill sheet to the user in a National Registry of Emergency Medical Technicians format.

15. The invention of claim 1 wherein said generating in (e) comprises presenting the skill sheet to the user in an American Heart Association format.

16. The invention of claim 1 wherein said generating in (e) comprises generating at least one of the following skill sheets: a trauma skill sheet, a medical skill sheet, a cardiac skill sheet, a cardio-pulmonary resuscitation skill sheet, an automated external defibrillation skill sheet.

17. The invention of claim 1 wherein said generating in (e) comprises generating a skill sheet selected from the group of skill sheets consisting of Department of Transportation skill sheets, National Registry of Emergency Medical Technicians skill sheets, and American Heart Association skill sheets.

18. The invention of claim 1 wherein said generating in (e) comprises generating hypertext markup language code.

19. The invention of claim 1 wherein said generating in (e) comprises displaying a name of the skill sheet, a line item description, a points possible, and a points awarded.

20. The invention of claim 19 wherein said generating in (e) further comprises displaying a comment.

21. A computer-readable medium having stored thereon instructions for generating a skill sheet which, when executed by a processor, causes the processor to perform the steps of:
(a) providing a simulation scenario;
(b) choosing a skill sheet template, wherein the skill sheet template comprises a plurality of line items;
(c) determining which line items of the plurality of line items are relevant;
(d) evaluating each relevant line item; and
(e) generating a skill sheet according to said evaluating in (d).

22. A computer program product for generating a skill sheet, the program product comprising:
a computer readable medium;
simulation scenario means stored on said computer readable medium for simulating the response of a simulated human subject to a user input;
choosing means stored on said computer readable medium for choosing a skill sheet template;
determining means stored on said computer readable medium for determining a relevance of a plurality of line items of the skill sheet template;
evaluating means stored on said computer readable medium for evaluating the plurality of relevant line item; and
generating means stored on said computer readable medium for generating a skill sheet.

23. A system for generating a skill sheet for a user, the system comprising:
a simulator;
an event logger in communication with the simulator;
an evaluator in communication with said simulator and said event logger;
at least one skill sheet template in communication with said evaluator; and
a skill sheet generator in communication with said evaluator;
wherein said simulator receives user input from the user; and
wherein said event logger receives user input from the user.

24. The invention of claim 23 wherein said at least one skill sheet template comprises a plurality of line items.

25. The invention of claim 24 wherein said plurality of line items are consistent with skill sheet standards selected from the group of skill sheets standards consisting of Department of Transportation skill sheets, National Registry of Emergency Medical Technicians skill sheets, and American Heart Association skill sheets.

26. The invention of claim 24 wherein each of said plurality of line items comprises a condition variable, a text message variable, a points possible variable, a points awarded variable, and a comments variable.

27. The invention of claim 23 wherein said at least one skill sheet template is a medical skill sheet.

28. The invention of claim 23 wherein said at least one skill sheet template is a trauma skill sheet.

29. The invention of claim 23 wherein said at least one skill sheet template is a cardiac skill sheet.

30. The invention of claim 23 wherein said simulator comprises a human model.

31. The invention of claim 23 wherein said simulator comprises a plurality of simulation scenarios.