Overview of the Agent-Based Modeling and Behavior Representation (AMBR) Model Comparison Project

The Air Force Research Laboratory (AFRL) is sponsoring a series of human performance model comparisons under the Agent-based Modeling and Behavior Representation (AMBR) Model Comparison Project. The first comparison challenged the modelers to build human cognitive models of multiple task management and attention sharing, embodied in the behavior of an air traffic controller operating in a simplified ATC task. The second comparison involved modifying the human behavior representation (HBR) models and the simulation environment to operate as an HLA Federation. BBN Technologies, as the model comparison moderator, designed the experiments, provided the simplified ATC simulation environment in which the models run, and collected data on actual human operators performing the task. CHI Systems, Soar Technology, Carnegie Mellon University, and a team from AFRL’s Logistics and Sustainment Division built the HBR models. This paper is the first of several presented as part of the AMBR Symposium at the 10 Annual Computer-Generated Forces and Behavior Representation Conference, and it is intended as an introduction to that set. The paper provides an overview of AFRL’s rationale for investing in this line of research, makes explicit the AMBR Model Comparison’s goals, describes the iterative model comparison structure chosen for accomplishing those goals, and concludes with an introduction to the first two rounds of the project. 1. Background and Rationale In recent years, the Human Effectiveness directorate of the Air Force Research Laboratory (AFRL/HE) has increased its investment in science and technology for human behavior representation. This increase has occurred as a result of a convergence of evidence in the mid-to-late 1990’s that there was an existing and future need for increased realism in models of human and organizational behavior for use in military simulations. 1.1 The National Research Council Report At the request of the Defense Modeling and Simulation Office (DMSO), the National Research Council (NRC) established a panel to review the state of the art in human behavior representation as applied to military simulations. The panel consisted of leading experts in individual behavior, organizational behavior, decision making, human factors, computational modeling, and military simulations. Results of the panel’s efforts were published in a 1998 book in which they concluded that “The modeling of cognition and action by individuals and groups is quite possibly the most difficult task humans have yet undertaken. Developments in this area are still in their infancy.” [1, p. 341-342]. Having established the need for more research in this area, the panel suggested short-, intermediate-, and longterm goals for stimulating progress. These were intended to serve as suggested research directions for DMSO and other DoD agencies with an interest in modeling and simulation. A short-term suggestion was for increased human performance data collection. Real-world, Report Documentation Page Form Approved OMB No. 0704-0188 Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. 1. REPORT DATE MAY 2001 2. REPORT TYPE Conference Proceedings 3. DATES COVERED 01-01-2000 to 31-04-2001 4. TITLE AND SUBTITLE Overview of the Agent-Based Modeling and Behavior Representation (AMBR) Model Comparison Project 5a. CONTRACT NUMBER F33615-99-C-6002