bluuebunny/crossref_metadata_2025 huggingface dataset:
Encoding of Information in Auditory Displays: Initial Research on Flexibility and Processing Codes in Dual-task Scenarios
Authors: Nees Michael A. , Walker Bruce N.
Published: January 2012

Interest in the use of sound as a means of information display in human-machine systems has surged in recent years. While researchers have begun to address issues surrounding good auditory display design as well as potential domains of application, little is known about the cognitive processes involved in interpreting auditory displays. In multi-tasking scenarios, dividing concurrent information display across modalities (e.g., vision and audition) may allow the human operator to receive (i.e., to sense and perceive) more information, yet higher-level conflicts in the encoding and representation of information may persist. Surprisingly few studies to date have examined auditory information display in dual-task scenarios. This study examined the flexibility of encoding of information and processing code conflicts in a dual-task paradigm with auditory graphs—a specific class of auditory displays that represent quantitative information with sound. Results showed that 1) patterns of dual-task interference were task dependent, and 2) a verbal interference task was relatively more disruptive to auditory graph performance than a visuospatial interference task, particularly for point estimation.
Global Perspectives on the Use of Naturalistic Driving Data to Improve Highway Safety
Authors: Fitch Gregory M. , Hankey Jonathan M.
Published: January 2012

Naturalistic driving studies provide a relatively new, powerful tool for understanding driver behavior. This collection of vehicle and driver data provides an opportunity to garner a greater understanding of driver behavior and safety issues than ever before possible. The purpose of this panel is to discuss how various car manufactures around the world are using or plan to use naturalistic driving data to improve transportation safety. Top researchers in the area of safety and human factors form this panel. The panelists in alphabetical order are: Joerg Breuer, Head of Active Safety (Mercedes-Benz - Germany); John-Fredrik Grönvall, Manager, Traffic Accident Research - Volvo Safety Centre (Volvo Car Corporation - Sweden); Raymond Kiefer, Structure and Safety Integration Center (General Motors - USA); and Tomohiro Yamamura, Manager, Advanced Engineering Group (Nissan - Japan).
Visual Entropy Metric Reveals Differences in Drivers' Eye Gaze Complexity across Variations in Age and Subsidiary Task Load
Authors: Schieber Frank , Gilland Jess
Published: January 2012

The purpose of this study was to evaluate the global complexity of drivers' eye movement behavior as a function of advanced adult age and variations in information processing resource demands. Global complexity was operationalized using an information theory metric commonly known as entropy. Fourteen young (mean age = 27) and 14 older (mean age = 75) participants drove on a 2-lane rural highway while simultaneously performing a subsidiary loading task designed to increase cognitive demands drawing upon either verbal-memory resources or visual-spatial resources (within the context of Wickens' (1980) multiple resource model of attention). Compared to traditional distributional measures of eye movement behavior such as mean saccade amplitude and fixation dwell time, the entropy measure of global complexity was better able to distinguish between young and old drivers as well as between baseline driving and conditions of high visual-spatial task load. These results strongly suggest that global measures of eye movement behavior hold significant potential for increasing our understanding of the interacting effects of normal adult aging and task-induced cognitive demands within the context of real-world driving.
Towards Developing an Indirect Video Visibility System for Large Trucks
Authors: Fitch Gregory M. , Wierwille Walter W. , Schaudt William A. , Hanowski Richard J.
Published: January 2012

Large trucks were involved in approximately 14,800 crashes between April 2001 and December 2003 as a result of making lane changes and merges (Starnes, 2006). The elimination of blind spots may help drivers avoid such conflicts by improving their spatial awareness of surrounding vehicles. This study investigated the ability of two candidate Camera/Video Imaging Systems (C/VISs) to provide information on longitudinal clearance to an adjacent vehicle. Sixteen commercial vehicle drivers performed merge maneuvers in front of an adjacent confederate vehicle while driving a tractor-trailer on the Virginia Smart Road. Both C/VIS enhancements were found to significantly improve gap judgment and merge performance. Performance differences between the two C/VIS concepts are examined.
Driver Gear-Shifting Behaviors and Errors
Authors: Harley Erin M. , Trachtman Doris , Heckman Genevieve M. , Young Douglas E.
Published: January 2012

Survey data have revealed that forgetting the current gear is a frequent driver error (Reason et al., 1990), yet very little research has been done on how drivers move gearshift levers and what causes them to make gearshift errors. In two experiments, 65 adults of all ages drove two vehicles on a closed course. Participants each performed multiple trials in which they drove or reversed to a location, shifted to Park, and exited and re-entered the vehicle. For approximately 1000 shifts into Park, the movements and forces that drivers applied to the gearshift lever were measured. Data revealed that drivers shifted to Park in a ballistic manner, and continued to apply force to the gearshift lever after reaching the Park detent. This force far exceeded that which was required to move the lever into Park. On select trials, participants were induced to hurry, and distractions such as cell phones, radio, and conversation, were introduced during the driving task. A total of 35 gearshift errors (e.g., failure to shift, or mis-shift) were observed in both experiments, all but one of which occurred on either a hurried or a hurried-plus-distraction trial. On no trial did any participant leave the gearshift lever between Reverse and Park. Data suggest that participants rely on the kinesthetic feedback from the lever hitting the mechanical stop at the end of the Park gate to determine when they have reached the Park position, and that drivers are more likely to make gearshift errors when they are hurried or distracted.
New Insights into Driving Using Recurrence Quantification Analysis
Authors: Cooper Joel , Strayer David
Published: January 2012

Traditional measures of central tendency and dispersion, such as the mean and standard deviation, ignore ordering effects in time-series data. Hidden within the ordered regularity of time series' may lie unique human performance characteristics. Recurrence quantification analysis (RQA), a contemporary tool designed for the investigation of nonlinear-time-series data, is used to explore lateral driving movement in a simulated car-following task. This investigation assesses a previously published data set that contrasts baseline driving performance, with performance while legally intoxicated, and hands-free/hand-held cell phone conversation. A number of distinguishing lateral movement characteristics were found using RQA. Free from the constraints imposed by discrete driving measures, RQA has the potential to provide real-time measures of driver workload under a variety of conditions.
United We Stand: Using Multiple Tools to Solve a Multi-dimensional Problem
Authors: Mitchell Diane Kuhl
Published: January 2012

Researchers at the Army Research Laboratory (ARL) investigated the impacts of reducing the number and location of personnel assigned to a Combined Arms Battalion Headquarters on Soldier workload, fatigue, and performance. Initial requirements were for 24 personnel to be located within four armored vehicles. Due to design constraints, however, the number of personnel needed to be reduced or some personnel moved to other vehicles. To recommend a solution to this problem, the researchers had to consider multiple human factors issues such as function allocation, mental workload, work space, and fatigue. Therefore, they used multiple human performance modeling tools including JACK, IMPRINT, C3TRACE and FAST to evaluate the problem. Each of these tools provided the analysts with analytical results on a unique aspect of the problem. By integrating these results, the researchers demonstrated the impacts of multiple aspects of this problem. Their recommended solution was closer to optimal because it incorporated many aspects of the problem than are considered typically.
Integrating Human Factors with Systems Engineering: Using WESTT to Design a Novel User Interface for Incident Command Systems
Authors: Houghton Robert , Baber Chris , Chaudemanche Eric
Published: January 2012

This paper describes the use of the WESTT software tool to support the specification of a user interface for incident command. Observations of fire-fighters on training courses were captured in a spreadsheet and fed into the WESTT tool which then constructs social network, use-case, sequence diagram and propositional network analyses. Following this, a form of class diagram is constructed that can be used as the basis for user interface design. The designs were well received by the target audience.
Integrated HSI
Authors: Malone Thomas B. , Pharmer James , Lockett-Reynolds Janae , Duma Katherine Muse
Published: January 2012

In the conduct of Human Systems Integration (HSI) as practiced by the U.S. Navy, HSI is more than the sum of its parts. While HSI includes the individual domains concerned with addressing requirements for the human in the system, it also includes the interaction of these domains, and the synthesis across the individual domains of the respective requirements for human performance, human behavior, human availability, human productivity, human competence, human well being, and human accommodation. The integration of the HSI domains is achieved at two levels, consolidation of domain activities in support of overarching HSI, and tradeoffs among HSI domains to optimize the integration of the human in the system. At the first level, the seven domains of HSI are integrated among themselves and into the systems engineering process. This integration is achieved through collaboration and cooperation among the individual domains, and a focus on what must be done in each domain at each phase of the systems engineering process to generate relevant domain requirements. The second level of integration addresses the tradeoffs that must be conducted among the HSI domains to achieve the most effective and affordable integration of the human element with system hardware, software, firmware, courseware, procedures, organizations, environments, and information.
Human Systems Integration—In the Trenches
Authors: Narkevicius Jennifer McGovern , Alley Teresa
Published: January 2012

Systems are always in some phase of development. Large scale systems development activities are often required by the Government. Without the required Government in-house expertise, Contractors provide a significant amount of the technical expertise necessary to achieve systems development. This panel will explore various views of that system development from the perspective of a large systems integrator, a manager of Human Systems Integration (HSI) professionals, a “bench level” HSI professional and an academic institute provider of advanced technology solutions. Discussion will encompass the different perspectives, tools, techniques and approaches required for these different aspects of system development within the systems engineering activity.
Impact of Advanced Display Features on Situation Awareness, Workload, and Performance of Complex Military Tasks
Authors: Cosenzo Keryl , Pomranky Regina , Capstick Erin
Published: January 2012

The objective of this research was to evaluate the effect of advanced interface features on an operator's ability to perform the duties and responsibilities associated with the role of Platoon Leader (PL); maintain and monitor vehicles in a formation, respond to communications, and maintain security around his vehicle. Participants conducted a military convoy mission using a basic interface (representative of the current force technology) and an interface with advanced warnings, cautions, and alerts (WCAs). Participants completed two missions with each interface configuration. Results showed that the advanced interface significantly improved the PL's ability to respond correctly and quickly to vehicles deviating from the formation. Further, participants reported better situation awareness and lower workload with the advanced interface than the baseline interface. Appropriately applied advanced formation tools such as vehicle status information and WCAs do improve military effectiveness and are important for military operations.
Does the Angle of a Fingerprint Scanner Affect User Performance?
Authors: Theofanos Mary , Stanton Brian , Sheppard Charles , Micheals Ross , Zhang Nien-Fan
Published: January 2012

As the deployment of biometric technologies such as slap fingerprint scanners has become more widespread in government applications there is an increased awareness of the human-computer interaction that such technologies involve. User behavior can impact operational system performance especially throughput and the quality of the collected biometric samples. This paper describes a study for the Department of Homeland Security that examined the impact on the time required to collect fingerprints and the quality of fingerprint images when fingerprint scanners are angled at tall counters to accommodate a broader range of visitors. Angling the fingerprint scanner had no impact on user performance.
Feedback Support for Training: Accounting for Learner and Task
Authors: McLaughlin Anne Collins , Rogers Wendy A. , Fisk Arthur D.
Published: January 2012

Years of research on feedback has not produced universal prescriptions for feedback during training. Results are split in two directions; those recommending more feedback during training and those recommending less. This has resulted in no unified theory and little understanding of other factors that might affect feedback mechanisms. The current experiment manipulated the cognitive load of the task and measured the working memory capacities of the learners to see whether forcing the learner to self-evaluate affects learning of a cognitive task and how this might be moderated by learner ability and task load. Results generally showed that reducing task load through supportive feedback resulted in more learning.
The Psychosocial Factor: A Neglected Aspect of Team Performance?
Authors: Orasanu Judith , Parke Bonny , Fischer Ute , McDonnell Lori , Rogers David G. , Entin Elliot
Published: January 2012

Recent efforts to enhance team performance have been grounded in analysis of team cognition, shared mental models, communication, and teamwork skills. However, alternative lines of work in social psychology and organizational development have addressed “psychosocial” factors, e.g., team cohesion, human relations training and transformational leadership. The goal of this panel is to explore the relevance of these factors for improving team performance. Panelists will describe research advances from laboratory and operational environments (military, space, and medicine), including tools for assessing team cohesion, psychosocial training strategies, analytical methods for examining changes in team performance, and limits to psychosocial approaches.
Performance of Egocentric Range Estimation in a Laptop Based Virtual Environment
Authors: Lee W. Sciarini , Kemper Don , Guay Laura , Nicholson Denise
Published: January 2012

There are limited opportunities and options for deployable units to practice the wide range of skills and tasks needed to stay mission ready. If not practiced, the degradation of skill can have unexpected and disastrous consequences for military personnel and their operations. One such degradable skill is range estimation, which is the ability to accurately determine the distance between one's egocentric position and an observed position (or the distance between two observed positions). Proficiency in this essential skill is fundamental to success in a wide range of operations including land navigation, marksmanship, and the call for indirect fires; therefore, efforts towards reducing skill degradation between formal training cycles are essential. Additionally, when considering the limited amount of space available to deployed units for equipment, an optimal training system should serve multiple purposes. The Multi-platform Operational Team Training Immersive Virtual Environment (MOT2IVE) is a deployable, laptop based simulation prototype that targets the consolidation of declarative knowledge and the acquisition of procedural knowledge. This study was conducted to explore the potential of using the MOT2IVE system as a supplemental practice tool to combat the degradation of range estimation skills by increasing immersion though the use of projection. Participants estimated target ranges in a live estimation course, a MOT2IVE virtual environment (VE) course and a projected version of the VE course. Results showed significant performance differences between estimations made in the laptop and projection environments and the live environment. While the range estimation results were consistent with the findings of previous research, these findings suggest that attempting to increase immersion through the use of projection on a single screen does not significantly affect performance.
Effects of Automation Types on Air Traffic Controller Situation Awareness and Performance
Authors: Sethumadhavan Arathi
Published: January 2012

The Joint Planning and Development Office has proposed the introduction of automated systems to help air traffic controllers handle the increasing volume of air traffic in the next two decades (JPDO, 2007). Because fully automated systems leave operators out of the decision-making loop (e.g., Billings, 1991), it is important to determine the right level and type of automation that will keep air traffic controllers in the loop. This study examined the differences in the situation awareness (SA) and collision detection performance of individuals when they worked with information acquisition, information analysis, decision and action selection and action implementation automation to control air traffic (Parasuraman, Sheridan, & Wickens, 2000). When the automation was unreliable, the time taken to detect an upcoming collision was significantly longer for all the automation types compared with the information acquisition automation. This poor performance following automation failure was mediated by SA, with lower SA yielding poor performance. Thus, the costs associated with automation failure are greater when automation is applied to higher order stages of information processing. Results have practical implications for automation design and development of SA training programs.
Do Velocity Vectors Support Multiple Object Tracking?
Authors: Oinonen Krista , Oksama Lauri , Rantanen Esa , Hyönä Jukka
Published: January 2012

We examined the effect of velocity vectors on human ability to extrapolate movement of multiple moving objects. This was achieved using an identity tracking task, in which objects (line-drawings of familiar objects) first move for 5 s, after which they temporarily disappear from view. In order to examine different aspects of vector information, we compared 4 velocity vector conditions: (1) no vectors were displayed; (2) only a history trail was displayed; (3) a condition where the end of the velocity vector pointed to exactly where the objects would reappear after the masking; (4) a constant heading length was displayed. Based on recent studies on Keane and Pylyshyn (2006) and Oinonen et al. (2009), we hypothesized that the condition, where exact location information is presented, would improve performance compared to baseline. The results supported this hypothesis by indicating that history trail or directional vector do not improve performance but only complete visual information about the future location will help to anticipate movement in multiple object tracking.
Data and Knowledge as Predictors of Perceptions of Display Clutter, Subjective Workload and Pilot Performance
Authors: Alexander Amy L. , Stelzer Emily M. , Kim Sang-Hwan , Kaber David B. , Prinzel Lawrence J.
Published: January 2012

Display clutter is defined as an unintended effect of displaying visual imagery that may obscure or confuse other information, or that may be redundant or not relevant to the task at hand. There exists a limited amount of research that has explored both data-driven and knowledge-driven parameters as dual contributors to perceptions of clutter. In the present study, six pilots flew simulated approaches under varied workload conditions with synthetic and enhanced vision display configurations that represented “low,” “medium,” and “high” clutter. Results evinced that high clutter displays produced elevated reports of perceived clutter and workload due to density or redundant presentation of information, while low clutter displays were perceived as less cluttered but challenging to use because of a lack of information typically required for flight. Pilots identified both data-driven (bottom-up) and knowledge-driven (top-down) as contributors to clutter, and these challenges were mirrored in flight technical performance. Conclusions support the notion that design of advanced technologies must consider not only the physical appearance of data within the display, but also the utility of that information to tasks the displays are designed to support.
A Peripherally-Located Virtual Instrument Landing Display Affords More Precise Control of Approach Path during Simulated Landings than Traditional Instrument Landing Displays
Authors: Bulkley Nathan K. , Dyre Brian P. , Lew Roger , Caufield Kristin
Published: January 2012

We compared the precision of simulated fixed-wing aircraft landing approaches with three different head-up display (HUD) formats: a) MIL-STD-1787B Cruise Mode, b) MIL-STD-1787B Instrument Landing System (ILS) Mode, and c) a virtual ILS HUD presented to the visual periphery. Non-pilot participants used simplified controls to guide a landing simulation under both day and night visual meteorological conditions. Experiment 1 confirmed that testing non-pilots with our experimental setting could induce the black-hole illusion, in which the approach is lower than appropriate at night. Experiment 2 compared landing performance aided by the three HUD formats under the same visual conditions. We found that both ILS displays improved approach path precision as compared to the MIL-STD Cruise Mode, and that the peripherally-located virtual ILS HUD reliably afforded the greatest precision. These results suggest that ILS approaches may be better supported by presenting a virtual ILS display to the visual periphery.
Assessing the Effects of Conformal Terrain Features in Advanced Head-Up Displays on Pilot Performance
Authors: Kim Sang-Hwan , Kaber David B.
Published: January 2012

The objective of this study was to assess the effect of Synthetic Vision System (SVS) and/or Enhanced Vision System (EVS) rendering of terrain features on pilot performance, including path control and situation awareness (SA), when presented in an advanced head-up display (HUD) during various phases of a landing approach under instrument meteorological conditions (IMCs). Results indicated that SVS imagery increase overall SA but degraded flight path control performance due to visual confusion with other display features. EVS increased flight path control accuracy but decreased system awareness by creating visual distractions for pilots (moisture returns), while they were focused on path control. The combination of SVS and EVS generated offsetting effects but there were still decrements in performance in the final landing phase due to overall HUD clutter. In general, display configurations in this study did not affect pilot spatial awareness but there was an influence on awareness of (iconic) system information. An IMC-day condition produced worse pilot performance than night flight because of reduced visual saliency of HUD information features. Flight performance was not different between phases of approach but levels and types of pilot SA did vary from leg to leg.
Why are those Lights Flashing?
Authors: Long Kevin M. , McGarry Kathleen A.
Published: January 2012

This paper describes the results of a Human-in-the-Loop simulation that took place in the Air Traffic Management Lab at MITRE/CAASD. The study explored the effectiveness of three different lighting configurations for the Final Approach Runway Occupancy Signal at preventing runway incursions. Pilots were presented with scenarios containing surface conflicts in which one of the three lighting configurations were used to alert air crews, in addition to scenarios that contained no conflicts. The results of the study suggest that all of the configurations were effective at preventing runway incursions, but that none of the configurations were significantly better than another.
A Comparison of Performance and Psychophysiological Classification of Complex Task Performance
Authors: Wilson Glenn F. , Estepp Justin , Davis Iris
Published: January 2012

Psychophysiologically guided classifiers have been used to distinguish between low and high mental workload conditions. Prior studies used cognitive tasks that were quite different in terms of the cognitive demands placed on the operator. It is not clear if these classifiers can discriminate between tasks that are more similar in cognitive demand. A complex uninhabited aerial vehicle simulator provided conditions that were similar but placed emphasis on different aspects of the task. Performance and subjective workload data could only discriminate between the baseline task and the three more difficult tasks. Artificial neural networks (ANN) that used psychophysiological data were able to discriminate among the four tasks with a mean accuracy of 83.4%. ANNs that used a larger number of features and saliency analysis produced higher classification accuracies than ANNs using fewer features. It appears that when comparing cognitively similar complex tasks, given sufficient information, ANNs are capable of finer discrimination than performance and subjective workload measures.
The Effects of the Adaptability and Reliability of Automation on Performance, Stress and Workload
Authors: Taylor Grant S. , Szalma James L.
Published: January 2012

One way in which non-human agents manifest in complex systems is through the use of adaptive automation. In this case, the degree of involvement of a computer-based agent can be controlled dynamically as a function of environmental conditions and operator state. The current study examined the effects of specific aspects of adaptive automation, reliability and adaptability (the ability of the system to adapt appropriately to changes in task demand), on human performance, stress, and workload.
Human-Robot Interaction: Issues in the Design of Interfaces for Work in Distant Environments
Authors: Gillan Douglas J.
Published: January 2012

The goal of technology tends to be to enhance and extend human capabilities. One purpose of robotics is to be able to work in a task environment that is distant from you, often because that distant environment is less safe and/or less accessible than your current environment. HRI must address a number of critical issues in order for human-robot system interfaces to be effective and efficient. The goal of this symposium is to identify selected critical interface issues and to provide conceptual/theoretical, empirical, and applied discussions of the interface-related issues in HRI.
Map and Ground View Integration in UGV Systems: A Structured Observational Analysis
Authors: Chadwick Roger A. , Vargas Joseph C.
Published: January 2012

Compared to natural perception, unmanned ground vehicle (UGV) operations place the human operator at a perceptual disadvantage, especially with regard to spatial comprehension and navigation. Map views using dynamic informative vehicle icons are seen as key to the efficiency of UGV mission scenarios. The recently completed ARL ADA Navigation Aides Experiment, a collaborative venture of New Mexico State University, North Carolina State University, Alion Science, and SA Technologies, provided an opportunity for observing participant behavior in UGV scenarios using various map options. Observations, anecdotal evidence, and conjectures regarding the human factors of map use in UGV interface systems are discussed.
Situation Awareness and Team Communication in Robot Control
Authors: Riley Jennifer M. , Strater Laura D. , Davis Fleet , Strater Sean , Faulkner Laurie
Published: January 2012

Operator performance in robotics tasks is impacted by the situation awareness (SA) that individuals or teams are able to acquire and maintain on the robot, the associated environments, and the tasks to be completed. SA can be influenced by team processes when multiple humans must work together for coordinating control of multiple robotic systems. In this study, we investigated the relationship between SA and team verbal communications in a collaborative robotics tasks involving robots under semi-autonomous control. Results indicate that the content, format, and amount of communication can significantly impact operator SA and task performance.
The Tradeoff of Frame Rate and Resolution in a Route Clearing Task: Implications for Human-Robot Interaction
Authors: McDermott Patricia L. , Fisher Alia
Published: January 2012

The implications of bandwidth allocation are described for teleoperation in a military task that involved navigation, target detection, and target identification. Color versus grayscale imagery was manipulated. Participants themselves traded off resolution and frame rate settings. Participants minimized switching between resolution/frame rate settings and tended to use settings with high resolution/low frame rate. Courses completed with the highest resolution (and lowest frame rate) had the fastest target identification times, but no other differences were observed between settings. Color imagery offered advantages for overall course time and the time to identify a tank as friendly or enemy.
Design and Validation of a Synthetic Task Environment to Study Dynamic Unmanned Aerial Vehicle Re-Planning
Authors: Cook Maia B. , Smallman Harvey S. , Lacson Frank C. , Manes Daniel I.
Published: January 2012

A key challenge facing unmanned aerial vehicle (UAV) operators is the need to re-plan routes on-the-fly when situations change. Operators must comprehend three-dimensional (3D) scenes and a multitude of potentially competing 3D mission and routing constraints in order to successfully re-plan, often under time pressure. Currently, there is significant research interest in supporting UAV operators through automation and improved visualizations. However, development and integration of these methods requires a careful understanding of the 3D spatial awareness challenges and requirements facing operators. To facilitate this understanding, here we report the design and validation of a synthetic task environment (STE) and testbed to study UAV re-planning. The STE is derived from a recent task analysis conducted with Navy UAV operators that focused on the key 3D spatial challenges entailed in re-planning. In an initial validation of the STE implemented in a re-planning testbed, several measures of re-planning performance were assessed for 36 participants working through controlled re-planning scenarios. The presence of mountainous terrain and the spatial overlap of mission constraints were parametrically varied. Performance was consistently worse in mountainous terrain, and in more highly-constrained conditions in mountainous terrain. In flat terrain, however, less constrained conditions resulted in paradoxically worse performance. Results have both basic and applied implications. Theoretically, the study provides a bridge between applied re-planning research and classic human problem solving work by allowing apparently simpler, unconstrained re-planning to be conceived of as less bounded search through re-planning problem space. For application, the results help constrain and define the requirements for future 3D visualization and automation support for UAV re-planning displays.
Techniques for Effective Collaborative Automation for Air Mission Replanning
Authors: Scott Ronald , Roth Emilie , Truxler Robert , Ostwald John , Wampler Jeffrey
Published: January 2012

We describe the most recent work-centered design for a military airlift organization. Earlier design cycles produced a set of coordinated visualizations to support synchronized air mission replanning. In this phase of the program automated planning support was incorporated to help C2 staff solve complex constraint problems across multiple missions and airfields. We describe our efforts at designing a replanning tool to work in collaboration with the human operator on complex replanning problems. A prototype was developed and used in an empirical evaluation comparing target user performance on complex constraint problems using either the visualizations alone or the visualizations with embedded automated support (collaborative planner). The collaborative planner significantly improved the speed and quality of dynamic replanning solutions. Post-test questionnaire ratings indicated users trusted the support provided by the automated aid. Design principles for effective collaborative automation are discussed.
Human Reliance on an Automated Combat ID System: Effects of Display Format
Authors: Neyedli Heather F. , Hollands Justin G. , Jamieson Greg A.
Published: January 2012

Informing users of reliability levels can engender more appropriate reliance on automated systems. In an experiment, reliability information was presented on a rifle-mounted interface for an automated combat identification (CID) system to participants in a first-person shooter simulation of a combat environment. Results showed two effects: First, a mesh display supported better discrimination of hostile and friendly targets than did a pie chart. Second, participants shown an integrated display were better able to adjust their reliance to the changing reliability level than participants shown separated displays. Providing reliability information changed participants' reliance strategies; however, display integration appears to play a role in how system reliability information is used.
Evaluating the Creation and Interpretation of Causal Influence Models
Authors: Cao Dapeng , Guarrera Theresa K. , Jenkins Michael , Pennathur Priyadarshini R. , Bisantz Ann M. , Stone Richard , Farry Michael , Pfautz Jonathan , Roth Emilie
Published: January 2012

Bayesian networks (BNs) are probabilistic models frequently used to capture domain knowledge for use in computational systems that can reason about states, causes, and effects. While BNs have many advantages, their complexity can hamper the process of knowledge elicitation and encoding. First, domain experts may not have expertise in artificial reasoning or probabilistic models, and that lack of understanding may complicate the elicitation of probabilities relevant to BN model structure. In addition, BNs require the definition of a priori, conditional probabilities: for complex models, this requires eliciting large numbers of complex probabilities. Multiple “canonical modeling” approaches, such as Causal Influence Models (CIMs), have been developed to address these complexities. However, little progress has been made towards human-in-the-loop evaluation of such approaches - specifically, their accessibility and usability, their related user interfaces, and how they enable a user to correctly create and interpret variables and probabilistic relationships. In this study, we evaluated the CIM approach (implemented in a software application) to determine the effect on user task performance. Results indicate that the model complexity has an adverse effect on performance when users are interpreting an existing model; that semantics of a model may impact performance; and that users were generally successful in creating new models of different situations.
Designing and Evaluating a Multimodal Interface for Soldier-Swarm Interaction
Authors: Haas Ellen , Hill Susan , Stachowiak Christopher , Fields Mary Anne
Published: January 2012

Traditional unmanned vehicle and robotic displays often use the visual modality alone to provide information and warnings. In previous studies we found that multimodal (auditory and/or tactile) cues that supplement visual displays, can increase user performance and decrease workload in a variety of settings. In this latest study, we examined the use of visual, spatial auditory, and tactile presentation of geospatial and warning information in a Soldier-robotic swarm interface. Sixteen male Marines with a mean age of 19 years from a Marine Detachment at Aberdeen Proving Ground, Maryland, acted as volunteer participants. Results showed that workload decreased and performance, as measured by reduced response time, increased with multimodal displays. These results are consistent with previous studies. The findings from this study have implications for the design of multimodal interfaces in complex, data-rich domains such as the human-swarm interface.
Eye Movements and Reliance on External Memory Aids Predict Team Success in a Military Planning Task
Authors: Lum Heather C. , Sims Valerie K. , Lagattuta Nicholas C. , Rosen Michael A. , Salas Eduardo
Published: January 2012

Participants completed a complex team exercise designed to mimic military planning operations. Each member of the three-person team was eye-tracked as they completed the group task. Members of successful teams had more fixations, were less reliant on external memory aids (push-pins), and created plans that were longer. Additionally, team members in key roles were more likely to experience decisional conflict and to have less confidence in their performance. Further examination of this finding showed that those who experienced greater decisional conflict also had fewer fixations. Low level eye movements may indicate high level team cognition.
Understanding Coordination Challenges in Urban Firefighting: A Study of Critical Incident Reports
Authors: Branlat Matthieu , Fern Lisa , Voshell Martin , Trent Stoney
Published: January 2012

This paper explores the central role played by coordination during fire incident response. Following preliminary investigations based on other methods, the authors analyzed a corpus of 29 critical incident reports produced by one fire department's safety services. Urban firefighting is a complex domain in which members' activities need to be highly synchronized in order to reach common operational and safety goals. As the work environment challenges the capacity of firefighters to coordinate efficiently, coordination breakdowns might occur, creating safety threats as role interdependencies become difficult to manage.
Current Concepts and Trends in Human-Automation Interaction
Authors: Bustamante Ernesto A. , Madhavan Poornima , Wickens Christopher D. , Parasuraman Raja , Manzey Dietrich , Bahner-Heyne J. Elin , Meyer Joachim , Bliss James P. , Lee John D. , Rice Stephen
Published: January 2012

The purpose of this panel was to provide a general overview and discussion of some of the most current and controversial concepts and trends in human-automation interaction. The panel was composed of eight researchers and practitioners. The panelists are well-known experts in the area and offered differing views on a variety of different human-automation topics. The range of concepts and trends discussed in this panel include: general taxonomies regarding stages and levels of automation and function allocation, individualized adaptive automation, automation-induced complacency, economic rationality and the use of automation, the potential utility of false alarms, the influence of different types of false alarms on trust and reliance, and a system-wide theory of trust in multiple automated aids.
Cognitive task analysis of power grid monitors
Authors: Close David , Babski-Reeves Kari , Younan Nick , Schulz Noel
Published: January 2012

Power system monitors (or operators) are responsible for viewing and synthesizing data collected from all aspects of the power grids infrastructure. Operators take appropriate action based on incoming data, ensuring that power is available to all entities within their region. Given the volume of information available to operators, it is no surprise that information overload and filtering are common practices. Cognitive task analysis (CTA) is a technique used to identify system aspects that impose large cognitive (mental) demands on the operator. The objective of this effort was to conduct a CTA for three desks within power utility companies in the southeast. Results illustrated that while there were similarities in the tasks and there is a strong interdependency between the desks, operator performance is variable with operators placing emphasis on different informational sources.
The Metrics Problem in the Study of Cognitive Work and a Proposal for a Family of Solutions
Authors: Hoffman Robert R. , Marx Morris , McDermott Patricia L. , Amin Raid
Published: January 2012

We present a measure called i-bar, which is the inverse of the mid-range derived from data on trials-to-criterion. We interpret this measure as a conjoint measurement scale, permitting evaluation of: (1) the sensitivity of the principal performance measure (which is used to set the metric for trials to criterion), (2) the learnability of the work method (i.e., the goodness of the software tool), and (3) the resilience of the work method. It is possible to mathematically model such order statistics, and derive methods for estimating likelihoods. This proposal involves novel ways of thinking about statistical analysis for discrete non-Gaussian distributions. The method we present should be applicable to the study of the effects of any form of training, and any form of intervention, whether to improve legacy work methods or create new cognitive work systems.
Human “Mis”-perceptions of Climate Change
Authors: Dutt Varun , Gonzalez Cleotilde
Published: January 2012

This research improves our understanding of the Stock-Flow (SF) Failure, found to be a robust problem in the perception of accumulation (Cronin, Gonzalez, & Sterman, 2009). We demonstrate the SF Failure with an interactive simulation in a relevant climate change context (Dynamic Climate Change Simulator (DCCS). In DCCS the climate change problem was simplified to an accumulation (stock), CO2 concentration; inflows, anthropogenic CO2 emissions; and outflows, CO2 absorptions from the atmosphere; using realistic climate models and their predictions. DCCS was used in a laboratory experiment to test participants' ability to control the CO2 concentration to a goal over 100 to 200 simulated years. Participants confronted one of four scenarios differing in emission decision frequency (every 2 years or 4 years) and rate of CO2 transfer from the atmosphere (1.2% or 1.6%, of CO2 concentration). Results show that performance in controlling CO2 concentration remained poor in all conditions of the task. An investigation of participant control strategies revealed misperceptions of feedback: participants brought CO2 concentration to the goal fastest for the condition where dynamics were slow and emission decisions were made less frequently, yet their stabilization after reaching the goal remained worst under the same conditions.
Resuming after Interruption: Exploring the Roles of Spatial and Goal Memory
Authors: Werner Nicole E. , Cades David M. , Boehm-Davis Deborah A. , Peterson Matthew S.
Published: January 2012

Interruptions research has generally focused on the factors that make interruptions more or less disruptive to primary task performance, the ways in which people engage the interruption as they disengage from a primary task, and the role of environmental context/cues in primary task resumption. However, little research has focused on investigating the processes by which a person reorients to and resumes the primary task following an interruption. This research explores the potential roles of spatial location and goal memory in the process of resumption. The experiment reported uses a new paradigm in which, following an interruption, a person can be returned to a different task and/or a different location. We found that both goal memory and spatial memory play a role in resuming the primary task following an interruption. However, there is still not a clear picture of how the two interact, and it may be that individual differences play an important role in how people deal with interruptions.
The Functional Resource Hypothesis as a Basis for Understanding Cognitive Workload in Immediate Interactive Behavior
Authors: Ralph Jason , Gray Wayne D. , Schoelles Michael J.
Published: January 2012

Understanding workload requires understanding the control of cognition at the 1/3 to 3s time span during which cognitive, perceptual, and motor operations become bound together into interactive routines. Interactive routines constitute unit tasks (3 to 30 s), and unit tasks constitute subtasks (30s to 3min). To reduce cognitive workload and overload, the Functional Resource Hypothesis maintains that an optimal allocation of interactive routines to task performance would be based on the functional resource of time not modality. Some of the implications of this hypothesis are investigated in an empirical study that varied memory load as well as the demands on the eyes, visual attention, auditory cognition, and motor operations. A microanalysis of the data revealed tradeoffs between groups in their pattern of resource allocation that were compatible with the Functional Resource Hypothesis.
Emotional Conversations in Command and Control: The Impact of Mood and Stress on Computer-Mediated Team Communication Behaviors
Authors: Pfaff Mark S.
Published: January 2012

Communication plays a critical role in team cognition along with other limited cognitive resources, such as attention, memory, and decision-making speed. Both mood and stress are known to have many interrelated effects upon cognition at the individual level, but there has been relatively little exploration of these two highly-related factors in the domain of team cognition in critical command and control environments. This paper presents research on the effects of mood and stress states on within-team communication behaviors in a simulated crisis management environment. Results show that the effects of mood and stress associated with individual cognitive functions also demonstrate analogous impacts upon team perspective and information sharing.
The Influence of Team Size and Communication Modality on Team Effectiveness with Unmanned Systems
Authors: Fincannon Thomas D. , Evans A. William , Phillips Elizabeth , Jentsch Florian , Keebler Joseph
Published: January 2012

This study examines the effects of team size (2 versus 3 operators) and communication modality (audio versus text) on team performance. Performance and workload measures from 112 undergraduate students from the University of Central Florida were used in this analysis. Results indicated that performance was optimal for teams of three operators using audio systems for distributed communication. Results with the NASA TLX showed patterns where workload was lower in the audio condition. Results with the Multiple Resources Questionnaire (MRQ) showed a reversed trend with a higher score in the audio condition, which was attributed to increases in items associated with audio processing.
Undergraduate Human Factors Curriculum at the United States Air Force Academy
Authors: Tidball Brian E. , Gibb Randall W. , Andre Terence S. , Tossell Chad C.
Published: January 2012

This paper shares one organization's journey to assess its human factors curriculum, develop improved course content to address current topics and accommodate the growing number of systems engineers in the human factors classroom.