bluuebunny/crossref_metadata_2025 huggingface dataset:
Knowledge of Pharmacokinetics and the Anesthesia Control Loop
Authors: Picciano Paul , Drews Frank , Syroid Noah , Westenskow Dwayne
Published: January 2012

Pharmacokinetics plays an important role in the delivery of anesthesia. Their complex nature creates a challenging control task for anesthesiologists while delivering anesthesia. The anesthesia domain confronts many known control difficulties such as non-linearity, oscillations, and sub-optimal feedback. A clinician's understanding of pharmacokinetics plays an important role in tracking performance. Information about anesthesiologists' knowledge of pharmacokinetics was collected and analyzed. Effects of expertise and considerable variability, even within groups, were observed in the collected data. Reducing variability and supporting the tracking task in the administration of anesthesia could lead to improved patient outcomes.
Validation Engineering Approaches for Reducing Medical Errors Viewing Medical Errors from a Context-of-Care Perspective
Authors: Bogner Marilyn Sue
Published: January 2012

The study of adverse incidents typically focuses on the person associated with the activity that precipitates the incident. This is despite the research and theory that indicates behavior is the product of the person interacting with the environment. This is changing somewhat — the term “systems” has become a buzzword for factors other than the person that contribute to error, particularly in addressing error in health care. This presentation describes the Artichoke Model, an evidence-based systems approach to understanding behavior. That model decomposes the context of an activity into 8 interacting hierarchal nested systems of factors. By analyzing an incident with respect to those systems, factors contributing to behavior that resulted in the incident can be identified and remedial activities instituted. Such activities can effectively reduce the likelihood of error because they are targeted to an identified rather than presumed contributor to error. Examples from the literature are discussed.
Validation Engineering in Ergonomics: Theoretical Perspectives
Authors: Samaras G. M.
Published: January 2012

A number of ergonomists have described or developed methodological models for the design, development, and evaluation of ergonomic products and processes. These models can be shown to be subsets of a classical methodological approach — well known in the hardware and systems professions, recently “discovered” by the software profession, and now beginning to be applied to ergonomics. This classical method — here called validation engineering (VE) — is a structured, systematic approach to business and technical risk reduction and user hazard mitigation. The VE lifecycle consists of a series of feedback and feedforward loops. The feedback loops consist of validation testing (implementation vs. requirements), verification testing (of requirements, specifications, and implementation), incremental hazard analyses, and post-deployment corrective and preventative actions. The feedforward loop consists of needs assessment, translation of needs to quantifiable requirements, translation of requirements to quantifiable engineering specifications, translation of specifications to implementation, and deployment of the product/process. Ergonomists can benefit both from using the VE approach and participating in efforts that use this approach
Observational Measures of Team Process and Performance in Healthcare
Authors: Seagull F. Jacob , Guerlain Stephanie
Published: January 2012

This symposium presents four research approaches that demonstrate a set of diverse tools and techniques for the study of team process and performance. Observational analysis is a cornerstone of human factors research, and analysis at the team level requires approaches tailored to the special considerations of group processes. In exploring these issues, we first present the advantages of video data as a medium in an ergonomic and task analysis of brief, risky beneficial procedures, and comparisons to traditional observational methodologies are made. Next, both qualitative and quantitative methods are used for describing notable events and performing content analysis with a software tool (“RATE”) that facilitates the coding and analysis of video records of surgical teams. Third, we explore a technique that uses the communication patterns of trauma teams as a measure of team processes, structure and function. Lastly, we present a validated behavioral marking system (“ANTS”) for individual anesthetists within the context of a team that includes the dimensions of team work, task management, situation awareness and decision making. These four techniques examine a range of valuable analytic tools demonstrated through empirical research.
Studying Communication Patterns during Surgery
Authors: Turrentine Beth , Calland J. Forrest , Adams Reid , Shin Thomas , Guerlain Stephanie
Published: January 2012

This paper describes the communication analyses performed from both live and post-hoc review of 48 surgery cases at an academic medical center. Team performance in the operating room is relatively understudied and non-standardized compared to other high-risk industries. Our research group has worked to evaluate interventions for improving team performance. In this study, we compared the use of a checklist by the senior surgeon to current practices (where no checklist is used), and evaluated teams based on technical errors and communication skills. Communication was measured quantitatively by dividing the procedure into specific events and scoring individual team members using a grading scale from 1 to 5. Using this measure, the intervention group had significantly higher scores in several communication categories. Next, a subset of team member quotes were qualitatively analyzed and divided into four phases: setting the course, gathering data, exchanging information, and tribulations. This qualitative data was used to modify our analysis tools for later studies to take advantage of the patterns we were seeing.
Rating Anaesthetists' Non-Technical Skills — The Ants System
Authors: Flin R. , Fletcher G. , McGeorge P. , Glavin R. , Maran N. , Patey R.
Published: January 2012

Non-technical skills are the cognitive and social skills required in any operational task involving decision making and team work, such as aviation or surgical medicine. This study identified the key non-technical skills required in anaesthesia, and developed a behavioural marker system (Anaesthetists' Non-Technical Skills (ANTS)) for their assessment in theatre, in the simulator or from video recordings. It comprises four skill categories (task management, team working, situation awareness and decision making) divided into fifteen elements, each with example behaviours. A first stage evaluation was conducted by asking 50 consultant anaesthetists to rate the behaviour of a target anaesthetist using the prototype ANTS system in eight videos of simulated anaesthetic scenarios. The system appeared to be complete, and the skills were observable, and could be rated with acceptable levels of agreement and accuracy. The second stage evaluation is now testing the usability of the behavioural rating system in the operating theatre environment.
Relationships between Job Stressors, Job Satisfaction, and Turnover Intent in the Assisted Living Sector of Long Term Care
Authors: Wagner Jennifer , Karsh Ben-Tzion , Sager Mark A. , Moberg D. Paul
Published: January 2012

Fundamental differences between assisted living facilities and nursing homes may prohibit the models of satisfaction and turnover developed in nursing home research from generalizing to assisted living facilities. The assisted living industry is growing rapidly, and many groups have voiced concerns about the staff turnover rate. As part of a training and education program, the Wisconsin Alzheimer's Institute collected data from the employees of assisted living facilities via self-administered questionnaires. Chi-square analyses were performed to determine if factors previously identified by nursing home literature had a significant relationship to job satisfaction. All of the factors examined showed a relationship to the job satisfaction item. In addition, employees who were not satisfied with their jobs were over 14 times more likely to report intentions to leave. These findings are used to suggest intervention strategies to reduce turnover.
Comprehension of Over-the-Counter Drug Label Warnings Concerning Consumption of Acetaminophen and Alcohol
Authors: Cheatham Deane B. , Wogalter Michael S.
Published: January 2012

This study compared several existing acetaminophen-containing product labels to a revised label with additional perceptual features and more explicit text regarding an alcohol-related hazard. The existing labels differed generally according to the amount and explicitness of alcohol-related warning information. Two-hundred sixty participants from a flea and farmer's markets in Raleigh, NC were shown one of the labels and a knowledge questionnaire was completed. Results indicated that responses regarding the combination of alcohol and acetaminophen were more accurate by participants having viewed the revised label compared to the existing labels. There are implications for the design of effective over-the-counter drug labels stemming from this study.
Role of Landmark for Spatial Mapping in Non-Rigid Environments
Authors: Cao C. G. L. , Waxberg S. L. , Smith E.
Published: January 2012

Spatial orientation in colonoscopy is difficult. Previous studies have shown that knowledge of shape information is more useful than direction or location information. However, the mechanism of spatial mapping in a non-rigid environment is unknown. It was hypothesized that visual landmarks were used as the primary cue for spatial orientation, as in rigid environments, even when other conflicting cues were available. An experiment was conducted to examine the role of visual landmarks in spatial mapping in a non-rigid environment. Simulated colonoscopy procedures were performed in colon models representing a compressed colon and a colon with missing landmarks. Preliminary results indicated that time, and not visual landmarks, were used as the dominant cue for spatial mapping. This may explain the conflict experienced by endoscopists who are aware of the stretchable nature of the colon, combined with the unreliable landmarks. Therefore, a useful navigational aid might be developed to encourage the use of a different strategy for spatial mapping in situations where the spatial relationship between landmarks is not constant, as in the colon.
Monitoring the Anesthetized Patient: An Analysis of Confusions in Vital Sign Reports
Authors: Crawford Jennifer , Savill Annyck , Sanderson Penelope
Published: January 2012

In the domain of anesthesia, auditory displays for respiratory monitoring have been suggested that could accompany the long-standing pulse oximetry system. However, research results to date suggest that participants' ability to identify physiological changes with respiratory sonification is not as great as it is for pulse oximetry. The reasons for this have not been established. Some possibilities are that respiratory parameters may be inherently more dynamic and may have greater intercorrelations, leading to greater confusability. In addition, there may be biasing factors specific to the various studies conducted that have led to slightly worse performance with respiratory sonification. In this paper we work through these possibilities and conclude that some are attributable to experimental design while others may be inevitable. The most important area of investigation in the future is to see whether the results are relevant to monitoring a synthesis of patient state.
Redundancy, Modality, and Priority in Dual Task Interference
Authors: Wickens Christopher D. , Gosney Jessica L.
Published: January 2012

This study examined the effects of several properties of a simulated in-vehicle-task (IVT) on interference with a concurrent tracking task, which simulated vehicle control. We compared auditory, visual and redundant delivery of IVT information, under conditions when the visual display was close and separated from the tracking task. In the first experiment we varied whether the tracking or the IVT was emphasized, and in the second experiment we added instruction in the use of redundant displays. IVT messages varied in length. The results from 20 participants in each experiment revealed (a) an effect of priority on the tracking task only, suggesting that separate resources were used for each task, (b) an advantage for auditory over visual delivery only when the visual display was separated, suggesting that visual costs relate to peripheral, not central resources, (c) no benefit and sometimes noticeable costs for the redundant display, compared to the single modality displays in experiment 1, and (d) an improvement in performance with redundant displays when training was given in experiment 2. The results have a positive bearing on the use of head-up (adjacent) displays for complex information.
A Sensitivity Study of Factors Influencing Real-Virtual Object Alignment Performance in Stereoscopic Augmented Reality Environments
Authors: Hou Ming , Milgram Paul
Published: January 2012

A sensitivity study involving a real-virtual object alignment task was performed in a stereoscopic augmented reality environment, in which the known conflict between binocular fusion and object interposition cues was expected to play a major role. The object was to evaluate subjects' sensitivity to visual texture of a real hemisphere surface and to target position at designated probe points on that surface. Consistent with earlier experiments, the results indicate that: a) both surface texture and target position had significant effects both on real-virtual object alignment and on the estimate of surface normal direction; b) fusion breakdown caused by the conflict between occlusion and binocular disparity could have been used as an extra depth cue to detect virtual and real object interactions. In addition, a practical solution to improving remote 3D measurement accuracy is proposed.
Judgments of Proportion with Graphs: Object-Based Advantages
Authors: St-Cyr Olivier , Hollands Justin G.
Published: January 2012

This study investigated whether a stacked bar's vertical arrangement or single-object properties underlie its accuracy for proportion judgments. We hypothesized that observers would be less accurate when stacked bars were separated than when they formed a single object, according to the object-based theory of attention (Duncan, 1984). Thirty participants judged proportions with three different graph types: bars, stacked bars, and staggered stacked bars. Stacked bars produced smaller error than staggered stacked bars, while bars produced the greatest error. The results show an object-based advantage for stacked bars, but a vertical arrangement advantage for staggered stacked bars over bars was also evident.
Application of Fuzzy Signal Detection Theory to Vigilance: The Effect of Criterion Shifts
Authors: Stafford Shawn C. , Szalma James L. , Hancock Peter A. , Mouloua Mustapha
Published: January 2012

A recent advance on Signal Detection Theory (SDT) promises to enhance measurement of performance in complex real world domains. This development, Fuzzy Signal Detection Theory (FSDT), combines traditional SDT with Fuzzy Set Theory to extend signal detection analysis beyond the traditional crisp, categorical model. FSDT permits events to simultaneously be in more than one state category (e.g. signal and non-signal), so that the stimulus and response dimensions can be continuous rather than categorical. Consequently, FSDT can be employed in settings where the degree to which an event is a signal for detection may vary. This study is an initial test of application of FSDT to vigilance, a domain in which SDT has been widely applied. Results indicate that manipulations of stimulus probability impacts response bias in a fuzzy vigilance task, but that these effects differ somewhat from tasks employing traditional signal detection.
Development of a Warning for Truck Bedliners to Avoid Gas Can Fueling Fires
Authors: Mortimer Rudolf G.
Published: January 2012

The objective was to develop a warning label for the bedliners of pickup trucks as a means of countering the fires, damage, and injuries that have occurred when portable containers are filled with gasoline in the beds of pickups. Refueling incidents were reviewed to discern the elements that were present. Seven items of information or instruction were found to be needed by consumers. Prototype warning labels were developed and tested with a total of 178 drivers in four tests involving recall after 10 seconds exposure, subject determined time of exposure, and when looking at the warning label. Drivers took more time with labels having more content. Recall and recognition of safety items improved with additional review. A label having 6 safety items was selected and should provide relevant information about the hazard and how to avoid it to over 90% of those who see and read it.
The Effectiveness of Warning Information in Dietary Supplement Product Labels
Authors: Laughery Kenneth R. , Paige Danielle L.
Published: January 2012

A study was carried out to assess the potential effectiveness of warnings on dietary supplement labels. The warnings are intended to convey contraindication and side effect information to potential users. Fifty-three participants completed a survey consisting of questions about the warnings. Two characteristics of potential users in a 25–40 age range were manipulated as variables; gender and amount overweight (25 lbs and 75 lbs). Participants judged women (M = 40%) as more likely than men (M = 26%) to read the entire label. A significant effect showed 33% of those 25 lbs overweight were expected to use a supplement, while 55% of those 75 lbs overweight would be users. Estimates of the number of users who would stop use if experiencing nausea (49%) or irregular heartbeat (44%>) seems to reflect an underestimate of the risks associated with dietary supplements. Participants estimated that 31.4% of people who took the supplement and read the label would understand the information. Overall, warnings on the labels of the dietary supplement products may not be effective in addressing the contraindication and side effects issues.
A Hidden Stepladder Hazard (Excessive Twist Flexibility)
Authors: Obert R.M. , Seluga K.J. , Ojalvo I.U.
Published: January 2012

This paper presents research concerning a specific, but common, hazard associated with excessive stepladder twist flexibility. Serious injury can result when, unbeknownst to a climber, only three of the ladder's four legs are in contact with the ground and there is a weight shift that causes the raised leg to suddenly impact the ground and dislodge the user. Test and analysis results are presented which show subtle causes of this hazard, as well as design improvements to reduce the possibility of their occurrence. The adequacy of existing stepladder safety standards to protect users from this type of accident is also questioned.
Failure Explanations in Amusement Ride Accident Reports
Authors: Woodcock Kathryn , Williams Kelly
Published: January 2012

A failure framework was used to code a sample of 100 recent amusement rides reported in the media and public record. Conventional analysis captures little data about amusement ride accidents; media reports include more. The paper describes the coding of the media dataset on the failure framework, and summarizes the factors mentioned in the sample of accident reports. Accident reports were seen to concentrate on a small number of factors mainly focused on consequences and categories of event rather than on detailed consideration of precursors on the causal chain. Investigations do not explain how rider or operator error was produced or why it was not intercepted, nor do they consider human performance as a precursor of device failure. Future research will include interventions using the framework to increase awareness of human factors principles as accident precursors, and to aid investigators to capturing greater depth of information about the failure sequences.
Hierarchical Task Analysis for Teams: Devleoping a Method to Charcterize Railroad Yard Switching
Authors: Acton Sarah A. , Reinach Stephen J.
Published: January 2012

The Federal Railroad Administration initiated research to collect data on remote control technology used in railroad yard-switching operations. This data will be used to conduct a risk assessment comparing conventional yard-switching operations with remote-control switching operations. A Hierarchical Task Analysis was chosen as the method to collect and organize the data for the risk assessment. Traditional task analyses are designed to record individual performance rather than teams working together to complete a task. The Hierarchical Task Analysis was modified to capture communication and coordination of team performance. The methods of developing the Hierarchical Task Analysis for Teams and data collection procedures are described, and an example of the results of the Hierarchical Task Analysis for Teams is presented and discussed.
A Failure Framework to Enhance Learning from Amusement Ride Accidents
Authors: Woodcock Kathryn
Published: January 2012

A research program addressing amusement ride safety required a means to study and compare investigations and inspections. A model was needed that could apply to both inspection and investigation, focusing on the failure made possible by the hazard(s) and explaining the actual or potential device failure or error. A “failure framework” was developed that incorporates elements of both deviation/aberration accident models and normal accident models. The framework has been used to study reports of amusement ride accidents, and will be used to develop interventions such as job aids and training to aid both inspection and investigations.
Guidelines for Developing a Safety Culture to Support the Implementation and Use of Technology
Authors: Wilson-Donnelly Katherine A. , Priest Heather A. , Salas Eduardo , Burke C. Shawn
Published: January 2012

Research suggests that human error contributes to unsafe practices and accidents more than two-thirds of the time in technologically advanced industries, such as aviation. Therefore, we sought to determine the factors that contribute to unsafe practices in these industries by reviewing the available literature regarding safety and safety culture. We found an overwhelming number of studies that suggest that a poor organizational safety culture is a significant contributor to errors and accidents. We also found that there was a lack of consistency between what the literature prescribes in terms of promoting safety and what organizations actually practice. As organizations are using more complex technologies, the need to develop a safety culture that encourages the safe implementation and use of technologies is apparent. As such, we developed guidelines to assist in the development of a safety culture that encourages safe practices at all levels of the organizations. We hope that the information provided will help organizations to improve safety within their organization.
Getting Started in the Right Direction: Expert Advice for Preparing for Your Professional Career
Authors: Shapiro Ronald G. , Andre Anthony D. , Beith Barry H. , Entin Eileen B. , Legan Brian M.
Published: January 2012

Welcome to the tenth annual Human Factors and Ergonomics Society Career Panel. The questions answered by this panel address many of the issues that graduate students and recent graduates have about entering the Human Factors field. The goal of this panel is to help individuals interested in becoming Human Factors professionals prepare for their career. This year the panel members each prepared a brief paper to help individuals plan for, prepare for, and commence their careers. During the HFES meeting panel session, the panel will focus on questions from the audience.
The Influence of Spatial Abilities and Age in Using Telephone Menu Systems
Authors: Pak Richard , Sharit Joseph , Czaja Sara J. , Rogers Wendy A.
Published: January 2012

Previous research has demonstrated the importance of spatial abilities in the performance of computer-based tasks, most of which involve menu navigation. This has been found among younger and older adults. Spatial abilities are usually thought to be composed of two distinct sub-factors: spatial visualization and spatial orientation. Various spatial abilities have been shown to exhibit normative declines with age suggesting that older adults may have trouble using computer-based technologies. The current research aims to examine the role of the different types of spatial abilities in the successful use of telephone menu systems.
The Presentation of Reference Information to Facilitate Search, Retrieval and Utilization
Authors: Garrett Sandra K.
Published: January 2012

Reference knowledge is very important for both personal expertise development and the development and viability of an organization. For reference material to be utilized effectively however, it must be organized and displayed in a way that facilitates the task goals of the user. Due to the complex interactions of the human-task-context relationship, evaluation of reference knowledge displays must involve studying how its effectiveness changes as these parameters are varied. As the Internet becomes a more prevalent way of providing reference information to the general public, great care must be used to ensure that the website structure facilitates the different information retrieval goals of the various users. This paper discusses an ongoing study that investigates the efficiency of information retrieval for two different types of task goals in two different website structures.
The Effects of Head-Up Display Clutter and In-Vehicle Display Separation on Concurrent Driving Performance
Authors: Horrey William J. , Wickens Christopher D. , Alexander Amy L.
Published: January 2012

The introduction of new in-vehicle technologies (IVTs) in automobiles may have important implications for driver safety, especially to the extent that these devices interfere with the primary driving task. Two experiments explored the effects of IVTs on vehicle control and hazard awareness: specifically, we were interested in the impact of visual clutter from head-up display (HUD) overlay as well as the impact of display separation. In experiment 1, twenty-five drivers in a wrap-around simulator drove urban and rural routes while performing a phone number read-back task. Visual displays were located either in a HUD overlaid on the horizon, a HUD positioned 7° below the horizon, or on a head-down display (HDD) located near the mid-console. Experiment 2 attempted to replicate some of the key findings in Experiment 1 with more challenging driving conditions (i.e., curved roads, varying fog densities). In general, the results suggested that drivers protected the vehicle control task, however there were costs in hazard response time and side task performance with the HDD. We suggest that effective hazard detection requires more focal visual resources whereas vehicle control may utilize ambient resources. The practical and theoretical significance of these findings are discussed.
Performance and Usability Evaluation of an Automated Task Management Concept Prototype Design
Authors: Hildebrand Gregory A. , Pharmer James A. , Weaver Melissa D.
Published: January 2012

A performance and usability evaluation was conducted on an automated task management concept (ATMC) user interface prototype design developed for an Air Defense Warfare (ADW) environment. With the Navy's reduced manning objectives, available advanced technologies, and increasingly complex mission areas, research and development of advanced user interface concepts is becoming a high priority. Testing was conducted at the Integrated Command Environment (ICE) facility at the Naval Surface Warfare Center Dahlgren VA Human Performance Laboratory. Team performance, situational awareness, and workload data were collected on six intact fleet ADW teams performing a realistic tactical scenario and supported by an ATMC prototype. These data were compared to data collected from six ADW teams performing the same scenario on advanced consoles without ATMC capability. Although it was expected that the teams with the ATMC interface would perform substantially better than the teams without it, the performance data did not completely support this hypothesis. Results indicated that ATMC may benefit the tasks of some operators and that some aspects of workload may be reduced using this concept. The results of a usability analysis and warfighter feedback also indicate that task management concepts may have some potential to reduce the need for verbal communication between team members.
Finding Information Needs in Military Command and Control Systems Using Exploratory Tools for Communication Analysis
Authors: Albinsson Pär-Anders , Morin Magnus , Fransson Johan
Published: January 2012

Communication is a rich source for analysis of complex socio-technical systems such as command and control. Although observable, often accessible, and multidimensional, communication data give rise to demanding analyses. In addition, these analyses must support keeping the context available, considering the situated nature of command and control activities. This paper presents methods and tools for exploratory analysis of communication. We report communication analysis results from military exercises, where the tools were used to explore commanders' information needs as a step in an ongoing development of a command and control support system.
How to Improve Error Analysis and Classification System
Authors: Yemelyanov Alexander M.
Published: January 2012

An existing system for human error analysis and classification is discussed. The lack of a comprehensive model of human error for this system decreases the quality of human error investigation and, as a result, the quality of recommendations that addressed safety-related deficiencies. The model suggested in the present paper is based on theory of frames, modal logic and psychological experiments and permitted the construction of meaningful description for error-provocative situation. The database for such situations gives the opportunity to find the most frequent causes, and therefore to mitigate the deficiencies. On the basis of the described model, the new decision support system for analysis and classification of error is proposed. This system provides both the data collecting for human error investigation and analyzing the most frequent causes through the database. The suggested system demonstrated a higher performance level than the existing classification system in analyzing the most frequent causes of error, and could enhance either accident investigating or incident reporting systems in aviation.
Field Assessment of Cognitive Performance under Stress
Authors: Harris Wayne C. , Hancock Peter A.
Published: January 2012

Performance decrements have frequently been reported in combat but it has been difficult to demonstrate the specific causal source of cognitive degradation sufficient to disrupt performance during military operations. In the present study, seventeen infantrymen were assessed during both a one-week simulated combat exercise and a pre-dawn assault. Significant change did not occur during the one week exercise, however simple reaction time did increase following the assault. One planned field assessment occurred at the moment following a potentially serious medical event. A soldier perceived that he was experiencing heatstroke but medical evaluation indicated that he was still “fit for duty”. Cognitive evaluation of his failing state was characterized by slow Simple Response Time and rapid and inaccurate responding on more complex response tasks. Fortunately, the soldier could return to duty but his scores slowly recovered, such that he returned to baseline levels two days later. The present infantry operational environment did not produce significant-information processing change in infantrymen. However, significant performance cognitive decrements followed the specific acute event of assault that was perceived as life-threatening. As we demonstrate, increased reaction time after the assault is consistent with increased fatigue following an extended period in the infantry operating environment.
The Usability Fitness Function
Authors: McGrew John F.
Published: January 2012

The usability fitness function (UFF) is a scale for evaluating user interface designs early in the design lifecycle when it is inexpensive to make changes. The UFF is part of the facilitated genetic algorithm (FGA) design method. The FGA uses a team of designers to generate and evaluate multiple designs in parallel. The evaluation is done by the UFF. The UFF is constructed from evaluation criteria produced by stakeholders in the user interface design (users, human factors and usability engineers, software/hardware engineers, marketing, and project management). The UFF can contain objective, heuristic, and subjective items. The UFF can be scored by either a Likert scale or by magnitude estimation. The Likert scale can order the designs. Magnitude estimation can indicate how many times better or worse a design is than an existing design. The UFF does not replace user testing but prunes bad designs early in the development life cycle thereby saving design cost and resources. This increases the efficiency of user testing, a notoriously resource intensive activity.
Proportionally Reducing Sample-Size Requirements by Increasing Dependent-Variable Reliability
Authors: Bittner Alvah C. , Winn Frank J. , Morrissey Stephen J.
Published: January 2012

Increasing dependent-variable reliability ρ(y,y) proportionally reduces both sample-size requirements and costs of independent-groups studies. This result is analytically considered in terms of the classical Z-test comparison of two means representing independent samples of size ( N). Analysis reveals that the dependent-variable reliability directly trades-off with sample-size in its impacts on sensitivity, so that constant statistical-power is maintained by reducing sample-size with a proportionally increased ρ(y,y). Two illustrations (reflecting sample-size and associated cost reductions of up to 50% or more) are presented of the value of systematic efforts to enhance reliability: (a) Integrating performance measures in evaluation of worker exposure-effects, and (b) Quality and preferences in new-product development. Test-Retest Reliability analyses are recommended as means to evaluate (1) Potential for enhancing statistical-power via increases in ρ(y,y) and (2) Impacts of attempts to increase statistical-power via increases in dependent-variable reliability (ρ(y,y)).
The Effects of a PC Simulation Added to Digital Military Training
Authors: Holmquist John P.
Published: January 2012

This paper asks the question: What advantages and disadvantages will be gained from adding a video game to the training and retention regime of a US Army computer-based report and command system. The core response to this question is not found in simply better training but in more a realistic workload, more realistic timeline, and more engaging training environment. The addition of these variables was not reported to speed-up or retain the knowledge longer, but it did increase the users desire to train and increase the users preparation for using the training in a real world environment.
Head Tracking Latency in Virtual Environments: Psychophysics and a Model
Authors: Adelstein Bernard D. , Lee Thomas G. , Ellis Stephen R.
Published: January 2012

Quantification of perceptual sensitivity to latency in virtual environments (VEs) and elucidation of the mechanism by which latency is perceived is essential for development of countermeasures by VE designers. We test the hypothesis that observers use “image slip” (i.e., motion of the VE scene caused by system time lags) to detect the consequences of latency rather than explicitly detecting time delay. Our presumption is that forcing observers to change from constant rate to randomly paced head motion will disrupt their ability to discriminate latency based on perceived image slip. This study indicates that the disruption in motion pattern causes a shift in latency detection criteria and a minor degradation in discrimination ability. It is likely therefore that observers make at least some use of image slip in discriminating VE latency. It can also be inferred that when observers learn to discriminate latency, their Just Noticeable Difference (JND) remains below 17 ms.
Generative Visualization System for Subject Matter Experts
Authors: Brannon Nathan , Lippitt Carl , Stiles Randy
Published: January 2012

Subject matter experts are often faced with the need to make decisions based on dynamic and complex data. In fields such as program management and intelligence analysis, the decision maker may not have the time or background to use computational tools to assist their analysis. Background research associated with genetic algorithms is reviewed leading to the need to apply cognitive modeling technology to improve the usability of interactive genetic algorithms. This work details a system applied to support missile defense mission planning referred to as the Generative Visualization System. The tool integrates an interactive genetic algorithm and a computational model of cognition with virtual reality modeling language based visualizations.
Performance Evaluation of a Wearable Vibrotactile Glove for Telemanipulation
Authors: Murray Anne M.
Published: January 2012

This presentation discusses two controlled experiments conducted to measure objectively the ability of a vibrotactile glove to convey discriminable finger touch forces to an operator performing telemanipulation tasks. In the first experiment, the user performs a pick-and-place task with objects of known relative weight under the added constraint that he/she maintains grip forces within a controlled force range. Using measures such as the mean and variance of grip forces, this work demonstrates that proportional touch feedback allows the user to better regulate his/her grip forces with proportional touch feedback over no-feedback or binary touch feedback. In the second experiment, which is a reverse of the first experiment, the user sorts objects by relative weight. This second experiment shows that the vibrotactile glove allows the user to discriminate relative object features, such as weight.
Improving the Usability of an Automated Tool for the Recording, Coordination, and Communication of Traffic Management Initiatives
Authors: Brickman Bart , Yuditsky Tanya
Published: January 2012

The current processes for recording, coordinating, and communicating traffic management initiatives in Air Traffic Control (ATC) are inefficient, workload intensive, and time consuming. The National Traffic Management Log (NTML) is an automated tool that will enhance and streamline these processes. We used an iterative design methodology with a multidisciplinary design team to develop solutions to existing design problems, and to design new system capabilities. The design team included Human Factors specialists, hardware and software engineers, and ATC domain experts. The design challenges faced by the team included addressing the unique needs of the various ATC domains while providing a usable human-computer interface. The application of the iterative design methodology and the benefits of using a multidisciplinary design team will be discussed.
Supporting Taxiing for General Aviation Pilots through Dynamic Message Signs: Simulation Evaluation and Implications for the Prevention of Runway Incursions
Authors: Moertl Peter M. , Niehus Gregory , McGarry Kathleen , Racine Nicole S. , Parasuraman Raja , Rehmann Albert
Published: January 2012

The potential of dynamic message signs to update pilots' expectations about airport surface characteristics was investigated in a simulation experiment. Signs were placed at simulated high-hazard airport intersections to inform pilots about uncommon surface characteristics and it was investigated if and how general aviation pilots could use such signs to update their expectations during taxiing. The results of the simulation study indicate that about two thirds of the pilots without prior experience with dynamic message signs noticed and processed the sign information. About two thirds of those pilots adjusted their taxiing according to the sign information. On average, pilots who were more likely to notice the message sign also reported higher levels of situation awareness (Taylor 1990) than pilots who were less likely to notice the sign. It was found that dynamic message signs did not reduce the risk of violating hold-short instructions if pilots were not familiar with the dynamic message signs. Specific procedural and standardization recommendations are given to improve sign benefits.
The Effect of Audio Attitude Symbology on Unusual Attitude Recovery for General Aviation Pilots
Authors: Liggett Kristen K. , Venero Peter , Anesgart Martin N.
Published: January 2012

Eight general aviation pilots participated in a series of unusual attitude recovery tasks to determine the effect of the addition of audio symbology to visual symbology on performance. Two audio symbology sets were tested including a non-localized set of recovery commands, and a set of localized “fly-to” cues. Results showed that there was no significant difference in performance among the visual only condition, the visual plus non-localized audio commands, and the visual plus localized cues. There were, however, significant differences in performance based on the initial climb/dive angle condition of the unusual attitudes.
Effects of Reliable and Unreliable Automation on Subjective Measures of Mental Workload, Situation Awareness, Trust and Confidence in a Dynamic Flight Task
Authors: Brown Rebecca D. , Galster Scott M.
Published: January 2012

Eight military pilots completed a study of human-interaction with reliable and unreliable automation in a complex air-to-ground search and destroy mission. Each mission consisted of four distinct stages. Automation was available in three of the four stages to aid the pilot in completing the required tasks. Automation reliability level was manipulated and combined factorially with two levels of workload, resulting in sixteen mission scenarios. Subjective measures of mental workload, situation awareness, trust, confidence, and judgments of the automation reliability were recorded after each mission. An analysis of the subjective measure ratings by mission workload level and the reliability of the first stage automation was performed. The results indicated that pilot trust in the automation was higher when the workload level was low and that there was a significant difference in confidence ratings between high and low workload levels, but only when the automation was unreliable. Design implications are discussed.
Investigating Issues of Display Content vs. Clutter during Air-to-Ground Targeting Missions
Authors: Lohrenz Maura C. , Hansman R. John
Published: January 2012

This paper investigates competing influences of display content and clutter on pilot performance during flight guidance and target acquisition phases of air-to-ground targeting missions. Based on interviews with F/A-18 pilots, a cognitive process model is presented to help understand how pilots use and transition between internal and external sources of information to support decision-making and aircraft control. Experiments were conducted in which subjects flew targeting missions using a flight simulator connected to the Navy's FalconView moving-map. In one experiment, subjects referred to three versions of the display: 1) a detailed map overlaid with critical mission symbology, 2) the map only, and 3) mission overlays only. Flight guidance and target acquisition performances were best with the overlays-only display. Performance was comparable or worse with the combination display and significantly worse with the map only, suggesting that the distraction of map clutter countered the benefits of map content.
Improving Inspector's Performance and Reducing Errors - General Aviation Inspection Training Systems (GAITS)
Authors: Jacob Raja J. , Raina Satyen , Regunath Saravanan , Subramanian Ravikumar C. , Gramopadhye Anand K
Published: January 2012

Inspection is an important step in ensuring product quality especially in aircraft industry where safety is the highest priority. Since safety is involved, effective strategies need to be set to improve quality and reliability of aircraft inspection/maintenance and for reducing errors. Humans play a critical role in visual inspection of airframe structures. Major advancements have been made in aircraft inspection, but General Aviation (GA) lags behind. Strategies that lead to improvement in inspection processes with GA environment will ensure reliability of the overall air transportation system. Training is one such strategy where advanced technology can be used for inspection training and reducing errors. A hierarchical task analytic (HTA) approach was used to systematically record and analyze the aircraft inspection/maintenance systems in geographically dispersed GA facilities. Using the task analytic approach a computer based training system (GAITS: General Aviation Inspection Training System) was developed for aircraft inspection that is anticipated to standardize and systematize the inspection process in GA. This paper documents the work involved in the development of General Aviation Inspection Training Systems.
Error Management on Modern Flight Decks: How Pilots Explain and Recover from Unintended Actions and Outcomes
Authors: Nikolic Mark I. , Sarter Nadine B.
Published: January 2012

Errors are a fundamental aspect of human adaptation in complex systems. Efforts to reduce and/or eliminate errors through training and design have met with only limited success. Therefore, it is critical to invest also in effective support for error management (the detection, explanation, and recovery from errors) to mitigate their negative consequences. To date, most research on error management has focused on the first step in this process – error detection. Instead, this paper presents a subset of results from a recent simulator study that examined the role of error explanation and the nature and effectiveness of error recovery strategies. Process tracing was used to analyze error management activities of pilots on highly automated flight decks. Our findings suggest that incomplete mental models of automation function limit error explanation and often lead to recovery strategies that rely on either “resetting” the system or serendipitous error evasion prior to negative consequences, or reverting to lower levels of automation when immediate corrective actions become necessary. These findings will be discussed in terms of their implications for training and design.
Verbal Protocol Analysis of Pilots' Cardinal Direction Judgments
Authors: Brooks Johnell O. , Gugerty Leo
Published: January 2012

This study investigated the types of strategies experienced navigators use to make cardinal direction judgments. While these judgments are important and necessary in navigation, people are generally poor at this task. Verbal protocol analysis revealed the strategies used by pilots in making cardinal direction judgments. These strategies were then compared to those previously identified using less experienced, non-pilot navigators (Gugerty & Brooks, 2001). Prior research on navigation tasks has pointed to mental rotation as the most common primary strategy. Our protocol analysis revealed a strategy not previously identified for other navigational tasks, heading referencing, suggesting that people often use a strategy involving little mental rotation for cardinal direction judgments. Individual participants used one of three patterns of primary strategies: mental rotation only, heading referencing only, or a combination of mental rotation and heading referencing. The novices relied equally on mental rotation and heading referencing while the pilots' primary strategy was heading referencing.