bluuebunny/crossref_metadata_2025 huggingface dataset:
Does One Bad Machine Spoil the Bunch?: A Review of Trust in Multiple-Component Systems
Authors: Lopez Jeremy , Pak Richard
Published: February 2021

Human-automation interactions are rapidly transitioning from single-component automated systems to multiple-component systems. The human-automation literature has yet to adequately explore trust within multiple-component systems. A currently unanswered question is whether one faulty component causes an operator to lose trust in that one component (Component-Specific Trust; CST) or in every component in the system (System-Wide Trust; SWT). The goals of this paper were to 1) summarize the current work on trust in multiple-component systems, and 2) identify any trends that emerge during the literature review. We reviewed 17 experimental studies that tested whether operators tend to adopt CST or SWT under different conditions. Overall, most studies suggest that operators adopt SWT. However, studies that provided the operator with high decisional freedom and more time with the automated systems suggest that CST is the dominant strategy. Future work should explicitly test these and other variables that may promote users to adopt CST.
Spatial Ability Stress Test for Screening and Selection: The Development of SCOUT-R
Authors: Brown Noelle L. , Sibley Ciara , Foroughi Cyrus K. , Coyne Joseph T. , Herdener Nathan , Phillips Henry , King Kenneth
Published: February 2021

Spatial abilities are often predictive of occupational success. Specifically, they are thought to play a role in aviator success and thus, are evaluated in Naval and Air Force aviation selection. However, the selection process only includes a single assessment of spatial ability which recent findings have called into question its validity. The creation of a speeded spatial ability stress test with face validity for the Navy and Marine Corps aviation community was investigated. We developed SCOUT-R, a multitask environment where participants quickly discriminated target objects from distractors, all of which could appear in any 90° orientation. The results showed the speeded presentation affected subjective workload and task strategy; however, target discrimination improved as the speed of presentation increased. The implications for SCOUT-R as a spatial ability selection test are considered.
Observations on the Field of UX Research
Authors: Edwards Rochelle , Huber Bridget , Kramarova Olga
Published: February 2021

Five observations on human factors and ergonomics are compared to user experience (UX) research. This paper highlights similarities and differences to the original reflections made by Salas (2008) and goes deeper into where user experience research as a field has room to grow, particularly, by maintaining a closer connection to its roots in psychology and human factors. This is important as applied user experience researchers work to make an impact and grow their careers through credibility and rigor of work. User experience researchers of varying tenure and those considering entering the field may benefit from reflecting on where they find such patterns in their own roles and what solutions should be proposed (whether internalized, institutional, or systemic).
Embedded Versus Horizontal UX Research Teams: Which May Best Suit You?
Authors: Kramarova Olga , Scribner Ryle , Tefera Yodit , Huber Bridget , Tseng Tina , Edwards Rochelle
Published: February 2021

This paper explores the two most common user experience research team structures found in industry. The first is a horizontal research team that operates like an internal consultancy to support research across the organization. This structure is great for researchers that are looking to work with a strong community of researchers, have exposure to multiple methodologies, and impact the broader organization. Alternatively, an embedded research team model consists of a researcher supporting a specific product or feature. This model is great for researchers looking to work across the product lifecycle and build closer relationships with cross-functional stakeholders.
Measuring Driver’s Perceived Workload Using Fractal Dimension of Pupil Dilation
Authors: Kim Jung Hyup , Yang Xiaonan
Published: February 2021

Many physiological measures have been proposed for quantifying the workload in a driving environment. Among them, pupillary response has been identified as an effective workload indicator that can be measured less intrusively and without disrupting the worker’s ongoing activities. The purpose of this study is to investigate the fractal dimension of pupil dilation (FDPD) to measure perceived workload in a driving simulation environment. For the experiment, two different driving scenarios were developed and tested by using the OpenDS driving simulator. The results demonstrate that one of the scenarios shows a significant negative correlation between FDPD and the perceived workload outcome from NASA-Task Load Index (TLX) questionnaires.
Method to Create Perceptually Uniform Color Gradients with Optimized Color Differences between each Step for Data Visualization
Authors: Millard Derek , Davis Bradley M. , Gillmore Samineh C.
Published: February 2021

This paper presents an original method to create optimized color differences between each step of a CIELAB perceptually uniform color gradient. The relevant equations for the necessary color space transformations are discussed, along with the procedure to determine and optimize the color differences between each gradient step. A specific implementation for perceptually uniform color gradients is discussed for safe terrain clearance in manned aviation during a degraded visual environment.
Fitting Regression Lines to Scatterplots: The Role of Perceptual Heuristics
Authors: Gillan Douglas J.
Published: February 2021

Relations in data are described and analyzed by fitting a regression line to the data. The graphical equivalent is a line fit to a scatterplot, typically via the least squares fit. How do people visually fit a line or recognize the best fitting line for a scatterplot? The present research proposes that people use a set of perceptual heuristics – point capture, early point, balancing points and balancing distances. Experiments 1 and 2A found that participants with no training in regression drew a line and chose the best fitting line, respectively, using those heuristics, especially balancing points. The application of the heuristics was sensitive to the structure of the graphs and influenced the error in drawing the regression line. Participants in Experiment 2B who had received formal training in regression were less likely to apply the heuristics and more likely to choose a line based on the least squares fit. The discussion focuses on the value of cognitive/perceptual analyses of graph reading and proposes methods to help people overcome biases produced by the application of these perceptual heuristics.
A Framework for Analyzing Residential Fire Outcomes in Homes with Operative Smoke Alarms
Authors: Motta-Mena Natalie V. , Cloninger Christy , Nauhaus Genevieve M.
Published: February 2021

Operative smoke alarms have been shown to be effective in reducing home-fire fatalities, but there remain incidents in which injuries and death occur despite the presence of a working smoke alarm. The present work presents a scientifically-guided framework for evaluating the outcomes of such incidents from the perspective of human factors and, specifically, the warnings communication process. It considers the roles of environmental, individual, and situational factors in occupants’ detection, noticing, and processing of smoke alarms, as well as the behaviors produced in response. Such factors include the acoustic environment in which the alarm sounds, the occupants’ cognitive state and focus of attention, the occupants’ developmental and physical abilities, and the situational circumstances in which a response is chosen and executed. The synthesis of these findings provides one methodology for understanding real-world outcomes of fires, as well as informing development and evaluation of countermeasures for improving residential fire fatality rates.
Safety Enhancement by Automated Driving: What are the Relevant Scenarios?
Authors: Grabbe Niklas , Höcher Michael , Thanos Alexander , Bengler Klaus
Published: February 2021

Automated driving offers great possibilities in traffic safety advancement. However, evidence of safety cannot be provided by current validation methods. One promising solution to overcome the approval trap (Winner, 2015) could be the scenario-based approach. Unfortunately, this approach still results in a huge number of test cases. One possible way out is to show the current, incorrect path in the argumentation and strategy of vehicle automation, and focus on the systemic mechanisms of road traffic safety. This paper therefore argues the case for defining relevant scenarios and analysing them systemically in order to ultimately reduce the test cases. The relevant scenarios are based on the strengths and weaknesses, in terms of the driving task, for both the human driver and automation. Finally, scenarios as criteria for exclusion are being proposed in order to systemically assess the contribution of the human driver and automation to road safety.
Comparing Paper and Digital Procedure Formats: Different Attitudes, Quality Perceptions and Deviations
Authors: Hendricks Joseph W. , Camille Peres S. , Parker Trent F.
Published: February 2021

Operating procedures are an integral part of the high-risk industries such as the Oil & Gas industry. Workers need them as a tool to help complete tasks effectively, efficiently, and safely and in the intended manner (Amyotte et al, 2007). Often, the assumption in the process safety domain is that procedures are very high quality, if not perfect, and therefore workers must follow them rigidly. What is all too often the case is that workers encounter a number of issues with procedure quality (e.g., inaccurate information, outdated steps; Hendricks & Peres, under review; Sasangohar et al., 2018). These quality issues have been shown to be associated with more deviations (Hendricks & Peres, under review). Now that many in the industry are starting to move toward digital procedures (hand-held, interactive, not .pdfs), there needs to be an examination of not only these issues, but also attitudes regarding procedure compliance and utility since these are related to deviations and also procedure use (Hendricks & Peres, under review).

Accordingly, this study sought to answer the question—are workers’ perceptions of quality, attitudes, and deviation behavior different based on procedure format (digital vs. paper)? Our study consisted of 32 chemical processing and logistics workers at a large, multi-national corporation. Half of the participants ( n = 16) were already using digital procedures and the other half had not experienced a digital procedure roll-out. We were able to make both within and between- subject comparisons with the data since those digital users also still used paper for other tasks. For the within-subjects level of analysis (LOA), workers had significantly poorer quality perceptions of paper format procedures than digital procedures. Although not significantly different, workers reported more deviations for paper procedures. For the between- subjects LOA, procedure quality perceptions were significantly worse for paper procedures (paper only group) when compared to digital procedures in the digital rollout group. Deviations, utility attitude, and compliance attitude were not significantly different for the two formats (better attitudes regarding utility, poorer attitudes regarding compliance, fewer deviations for digital) and the effect sizes were at or above medium. We think it is important to start this line of research in the process safety industries because if the transition to digital procedures is already occurring, we need evidence that it is justifiable by demonstrating—especially at different LOAs—that we can expect improvements in these critical procedure-related variables. We need to expand this line of research to other companies, and to multiple sites with larger samples. Indeed, one of the challenges is gaining access to such important workers, but we see a large benefit to organizations who ultimately will be investing many resources into these types of changes.
A Video Survey on Minimal Risk Maneuvers and Conditions
Authors: Karakaya Burak , Kalb Luis , Bengler Klaus
Published: February 2021

Known issues at higher automation levels are hoped to be solved by the systems capability to automatically perform maneuvers in order to achieve a so-called minimal risk condition. In this paper, we contribute to this developing research field and emphasize the driver’s perspective. We have conducted a video survey with 49 participants showing different forms of maneuvers. The results show that drivers favor evasive maneuvers over coming to standstills and maneuvers to the left over right. However, the desired condition to be achieved is mainly the standstill on a shoulder lane. These conflicts should be considered for designing such systems and further investigated with different methodologies, such as driving simulators.
Incidents in the Great Outdoors: A systems approach to understanding and preventing led outdoor accidents
Authors: McLean Scott , Finch Caroline , Coventon Lauren , Salmon Paul M.
Published: February 2021

Adverse incidents during Led Outdoor Activities (LOA) remains an ongoing concern worldwide. This paper provides a systems analysis of adverse incidents in the Australian Led Outdoor Activity (LOA) sector between 2018-2019. Incidents were reported by 18 LOA organisations via the LOA specific Understanding and Preventing Led Outdoor Accident Data System (UPLOADS). UPLOADS is underpinned by Rassmusen’s risk management framework and associated AcciMap method. In total, 2,457 incidents from 357,691 LOA program participation days were reported, with an incident rate of 6.9 incidents per 1000 program participation days. AcciMap analyses of the incidents revealed that there was a total of 5,442 contributory factors with 3,259 relationships between them, from all levels of the LOA system spanning the activity environment to regulatory and government levels. This paper demonstrates that incidents in LOA are systems issues and that prevention of LOA incidents should focus on removing the network of interacting contributory factors.
Rancor Hybrid Energy System Microworld
Authors: Lew Roger , Ulrich Thomas A. , Boring Ronald L.
Published: February 2021

Transitioning from fossil fuels to renewable energy sources will require a diverse energy portfolio to ensure a reliable and resilient electrical grid. Renewable sources are proliferating but are intermittent and low periods of low production must be offset by other energy generators. When renewable demand is high baseload generators must scale back or utilize energy for other sources such as hydrogen production. Hybrid energy systems such as nuclear thermolysis hydrogen production could play a critical role for our energy future. Hydrogen is critical for manufacturing fertilizer as well as other industrial processes. Here we describe the development of a human system interface for a micro-reactor thermal storage hydrogen production system. The development of the interface parallels the engineering of a physical test-loop known as the Thermal Energy Delivery System (TEDS) at Idaho National Laboratory.
A Heuristic Evaluative Framework for Self-Regulated Learning Design
Authors: Roscoe Rod D. , McNicol Stephanie , Raghav Bhat K. , Craig Scotty D.
Published: February 2021

Researchers and educators have explored a variety of technologies to facilitate self-regulated learning (SRL). Drawing from contemporary perspectives on SRL, this paper articulates two fundamental design principles for SRL-promoting technologies: the platform principle and the support principle. This paper then discusses how usability inspection methods, such as heuristic evaluations and cognitive walkthroughs, can readily assess whether and how these needs are met. This framework can assist researchers and educators in evaluating technologies to make strategic design and implementation decisions aligned with self-regulation.
Leveling Up: Using the Tracer Method to Address Training Needs for Esports Players
Authors: Roose Kaitlyn M. , Veinott Elizabeth S.
Published: February 2021

This paper describes a new method, the Tracer Method, that maps multiple types of decision-making activities to visual search behaviors to improve the acquisition of expertise. The method combines Critical Decision Method (CDM) with eye tracking to identify expert strategies for performance in interface-based tasks. The Tracer Method uses a network analysis of eye movement data, contingent on the critical decisions, to produce new information that neither method alone can generate. Twenty-five experienced Over-watch players were eye-tracked while playing a competitive game, followed by a CDM interview. Three types of decisions: sensemaking, uncertainty management, and coordination resulted in different eye-movement network diagrams of transitional probabilities. These different strategies can inform Esport team training. Although we demonstrate the usefulness of the Tracer Method in an Esports context, the method could apply in other human factors domains.
Balance-Of-Plant Computerized Operator Support System Implementation
Authors: Mortenson Torrey , Ulrich Thomas , Boring Ronald Laurids , Lew Roger
Published: February 2021

A Computerized Operator Support System (COSS) is an operator assistive technology suite that aids operators in monitoring processes to detect off-normal conditions, diagnose plant faults, predict future plant states, recommend mitigation alternatives, and select appropriate mitigative actions. A COSS human-machine interface (HMI) was developed at Idaho National Laboratory (INL) in collaboration with an advanced prognostics engine called PRO-AID, developed at Argonne National Laboratory (ANL). The front-end HMI coupled with the back-end prognostics provide fault prediction to inform operators of plant faults before they occur. Historically, COSS has been focused within the control room, representing systems that are monitored and controlled solely from a centralized location. This project, however, is focused on applying the principles of previous COSS efforts to a system outside the control room, namely the boric acid concentrator and liquid radwaste (BAC/LRW) system. This effort demonstrates the applicability and usability of a COSS system in a balance-of-plant environment, and offers next steps in the development of operator support and advanced overview interfaces in existing nuclear power-generating stations, and the future advanced reactor systems.
Does Long-Term Exposure To Robots Affect Mind Perception? An Exploratory Study
Authors: Kim Min Ji , Kohn Spencer , Shaw Tyler
Published: February 2021

From cleaning houses to assisting airport passengers, robots are rapidly becoming an integral part of society. As they transition into a facet of the everyday environment, it’s important to understand how beliefs and behavior concerning these robots will change over time. While human-robot interaction research is common, there is a significant literature gap concerning long-term interaction with these agents. The current study seeks to better understand how exposure over a time-scale of months changes mind perception towards robots. This area of research is especially critical given that mind perception has been shown to influence behavior. A fortuitous deployment of robots across the authors’ university campus provided an unprecedented opportunity to study this interaction via a naturalistic experiment.
Blink Rate as a Measure of Driver Workload during Simulated Driving
Authors: Yahoodik Sarah , Tahami Hesamoddin , Unverricht James , Yamani Yusuke , Handley Holly , Thompson Deborah
Published: February 2021

Cognitive distraction has been identified as a critical factor for automobile crashes in the United States. Previous research indicates that cognitive tasks such as phone conversations may take attention away from the driving task, degrading driving performance. One continuing issue with cognitive distraction research is establishing a reliable, continuous, online measure of driver workload. Blink rate is a potential candidate for such a measure. The present driving simulator experiment examines whether blink rate is sensitive to variations of driver workload while controlling the vehicle. Participants will navigate simulated environments while performing the auditory 0-and 2-back task with their blink and driving performance data continuously recorded during the drive. Blink and performance data will be compared not only between the different workload conditions, but also to predictions of a human driver performance workload model based on the Improved Performance Research Integration Tool (IMPRINT), developed by the US Army Research Laboratory.
Examining frustration and performance when priming user expectations and providing a technology malfunction
Authors: Ferreri Nina , Mayhorn Christopher B.
Published: February 2021

As digital technology develops, users create expectations for performance that may be violated when malfunctions occur. This project examined how priming expectations of technology performance (high v. low v. no) and experiences of technology malfunction (present v. not present) can influence feelings of frustration and performance on a task. A preliminary sample of 42 undergraduate participants completed a QR code scavenger hunt using the augmented reality mobile app, ARIS. Following the task, participants reported what they found for each scavenger hunt clue, their responses to failures in digital technology, and technology acceptance attitudes. Several factorial ANOVAs revealed a main effect for expectation on adaptive items of the RFDT scale and a main effect for malfunction on performance level. This suggests a potential contradiction between attitudes and behaviors when considering a common scenario involving technology.
Gamification Theory: Implications for General Aviation Weather Training
Authors: McSorley Jacqueline , Kleber John , Blickensderfer Beth
Published: February 2021

Weather-related accidents have one of the highest accident and fatality rates in General Aviation. Weather training is highly variable depending on the source of instruction, and it is essential to emphasize the importance of weather training and identify strategies to engage GA pilots in improving their weather knowledge. Gamification, the use of game elements in a non-gaming context, exists as a tool that could aid in the improvement of aviation weather training. This paper provides background on gamification theory including the motivations, user types, and specific gamification elements used in training. It also emphasizes the relevance of the theories in the realm of aviation weather training. Furthermore, this paper recommends aspects of gamification most relevant to GA pilot training. With further testing, the implementation of gamification in aviation weather instruction may yield improved outcomes in training.
Dynamic Information Needs Analysis: Understanding User Information Needs in Subterranean Warfare
Authors: Zaman Farakh , Rife Jason , Intriligator James , Hannon Daniel
Published: February 2021

In this practice-oriented paper for human factors research, we describe our experiences piloting an exercise to understand how a moment-by-moment input device can be utilized to help understand soldiers information needs while conducting subterranean (sub-t) warfare and facilitate development of Augmented Reality (AR) displays for sub-t use. We created a sub-t environment using the Unity game engine and utilized students as subjects to facilitate experiment setup and validation. Little research is being done on what information soldiers need in a subterranean environment. Here we begin to investigate these information needs.
Comparing the Importance of the Factors on Drivers’ Response Time to Lead Vehicle’s Braking
Authors: Lin Brian T. W. , Funkhouser Dillon S. , Sayer James R. , Sherony Rini
Published: February 2021

During car-following, drivers respond to the braking or deceleration of a leading vehicle based on their perceived threshold for gap, relative speed, change of the gap, time-to-collision, etc. These measures are widely used to estimate drivers’ response time to the braking of a vehicle ahead. However, it is not clear if their response is driven only by absolute thresholds or also through a comparison of the current situation with any baseline situation to which they have just been exposed. This research explored drivers’ braking response to a lead vehicle’s braking using naturalistic driving data. Two hundred and ninety-six braking events were analyzed. It was found that measures adjusted from a baseline (when the lead vehicle’s brake lights were illuminated) were more important for estimating drivers’ response time than the measures on the absolute thresholds. Predictors adjusted according to the baselines are suggested for better prediction of drivers’ response time.
The Temporal Dynamics By Which Drivers Become Aware of Bicyclists Who Use Taillights In Daytime
Authors: Edewaard Darlene E. , Tyrrell Richard A. , Rosopa Patrick J. , Duchowski Andrew T. , Szubski Ellen C. , King Savana L.
Published: February 2021

Bicyclists risk being involved in collisions with motor vehicles, even during daytime. Thus, bicyclists who ride in daylight must enhance their conspicuity. This study assessed the daytime conspicuity benefits of bicycle taillights using eye tracking technology. Participants were driven along an open-road route while wearing an eye tracker and pressed buttons when they detected and recognized a test bicyclist. Participants encountered the bicyclist displaying one of four taillight configurations, and the distances from which they responded to the test bicyclist were recorded. The results revealed that, after participants first glanced at the bicyclist, a significant amount of time was needed to detect and recognize the bicyclist. Further, seat post-mounted lights displayed with or without lights mounted to the heels of the rider’s shoes provided the greatest conspicuity advantage in terms of recognition. This experiment offers useful insights into the optimal light placement options for bicyclists to enhance their daytime conspicuity.
Objective Assessment Metrics for Central Line Simulators: An Exploration of Causal Factors
Authors: Gonzalez-Vargas Jessica M. , Brown Dailen C. , Moore Jason Z. , Han David C. , Sinz Elizabeth H. , Sonntag Cheyenne C. , Miller Scarlett R.
Published: February 2021

The Dynamic Haptic Robotic Trainer (DHRT) was developed to minimize the up to 39% of adverse effects experienced by patients during Central Venous Catheterization (CVC) by standardizing CVC training, and provide automated assessments of performance. Specifically, this system was developed to replace manikin trainers that only simulate one patient anatomy and require a trained preceptor to evaluate the trainees’ performance. While the DHRT system provides automated feedback, the utility of this system with real-world scenarios and expertise has yet to be thoroughly investigated. Thus, the current study was developed to determine the validity of the current objective assessment metrics incorporated in the DHRT system through expert interviews. The main findings from this study are that experts do agree on perceptions of patient case difficulty, and that characterizations of patient case difficulty is based on anatomical characteristics, multiple needle insertions, and prior catheterization.
Using Relevant Time Clock Refresher Training for Improvement In Identifying Aviation Traffic
Authors: Dattel Andrew R. , Wang Hui , Padilla Cristhian , Gao Peiheng , Song Kwangsik , Zhang Zihao , Henry Andrew P. , Zhang Tianxin , Agha Rahim D.
Published: February 2021

It is common for Air Traffic Control to alert pilots of aircraft traffic using an analog clock metaphor (e.g., Traffic 1 o’clock). This study compared analog refresher training group to a digital refresher training group. Sixty private pilots were assigned to either an analog group or a digital group. Each of these groups were assigned to a Top of the hour refresher training condition or a Quarter of the hour refresher training condition. Participants flew a pretest flight scenario where they identified traffic, took the refresher training, then flew a posttest flight scenario. No differences were found between the analog refresher training group and the digital refresher training group. However, pilots who received Top of the hour clock refresher training identified traffic faster than pilots who received Quarter of the hour clock refresher training.
A Mirror-in-the-Sky Navigation Aid: Summary of Qualitative Feedback from Soldier and Civilian Users
Authors: Vasquez Holland M. , Reiner Adam J. , Jamieson Greg A. , Hollands Justin G.
Published: February 2021

We tested the efficacy of a novel augmented reality navigation aid, called SkyMap, which presents survey navigation information in the sky, above the user. Soldier and civilian users completed a route following task using Mirror-in-the-Sky (a virtual reality prototype of the SkyMap concept), a north-up map, and a track-up map. In this paper, we analyzed and presented a summary of qualitative user feedback and compare feedback from soldier and civilian users. Specifically we used affinity diagrams to categorize verbal qualitative feedback, which led us to identify six themes: 1) an interest in MitS as an innovative navigation display, 2) challenges with identifying turns and orienting, 3) learning MitS over time, 4) the position of MitS in the field of view, 5) customizability and flexibility and 6) ) use in the context of a military operation. We discuss these themes and highlight areas for design improvements.
Evaluating the Usability of University Waste-Sorting Systems
Authors: Dumessa Nathan , Lucaites Katie , Solini Hannah , Lopez Jeremy , Lawton Paige , Ahire Suyash
Published: February 2021

Recycling is a widely adopted practice that can reduce waste in landfills and increase profits for companies, corporations, and universities, such as Clemson, that sell recyclable materials. For these materials to be sold at a competitive price, however, they must be uncontaminated. This is a considerable barrier for Clemson University because users’ knowledge and experience with recycling do not align with Clemson University’s expected recycling practices. In an effort to bridge this gap, we followed human-centered design practices to generate and test prototypes of new system signage. We found that users were more accurate and confident in their sorting behavior when interacting with the new signage. Users also perceived the new signage as more usable than the old signage. In addition to these findings, the results of this research include a user testing methodology and experimental protocol that can be implemented in other contexts where large populations sort waste.
A User-centered Decision-aiding Process for Selecting Power Analysis Tools
Authors: Hung Ya-Hsin , Choi Jeong Yun , Willis Mairéad , Proctor Robert W. , Hennes Erin P. , Lane Sean P.
Published: February 2021

A priori power analyses have become increasingly popular in scientific communities, but the practice has not been widely discussed by HFE researchers. Given the complexity of conducting such analyses, software tools are essential. We review the emergence and current state of power analysis software tools, and use the concept of User-Centered Design as an analytical lens for examining the relationship between researchers’ needs and power analysis tools’ characteristics. Centering on users’ wants and needs, we propose a decision-aiding process to assist researchers in identifying appropriate power analysis tools. This process consists of five user-centered considerations – two functional criteria (software input; software output) and three usability heuristics (learnability; ease of use; accessibility) – which are organized into a workflow. These criteria and heuristics are translated into questions that researchers should go through during the decision process. We illustrate use of the decision-aiding process with three example scenarios and lay out implications for researchers.
Using User Experience Scales to Predict Video Game Play and Purchasing Intent
Authors: Shelstad William J. , Hosein Ameer A. , Keebler Joseph R. , Chaparro Barbara S.
Published: February 2021

The current study investigated three user experience scales, the GUESS-24, the ENJOY, and the UEQ-S scale, as well as their relationship to gameplay continuance and purchasing intention for six popular online games. Results indicated that each of the three scales (GUESS-24, ENJOY, UEQ-S) could be used to predict continuance and purchase intention in the games of interest. The ENJOY and GUESS-24 performed better in predicting continuance intention than the UEQ-S. The GUESS-24 performed the best in terms of predicting purchase intention.
Sentiment Analysis of Participant Comments in a User Centered Design Study for Degraded Visual Environment Sensor Visualization
Authors: Davis Bradley M. , Gillmore Samineh C. , Millard Derek
Published: February 2021

Several methodologies in user centered research lead to the collection of large amounts of comments about a product or system. The growth of social media research has led to the development of sentiment analysis algorithms that computationally analyze the meaning of text. This paper utilized the Valence Aware Dictionary for sEntiment Reasoning (VADER) sentiment analysis technique to assess comments from a user centered design study for a rotorcraft degraded visual environment mitigation system. The sentiment analysis findings mirror results from the other measures of the user centered design study. This paper supports the use of sentiment analysis for large volumes of comment data from user centered design studies.
“We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments
Authors: Derby Jessyca L. , Rickel Emily A. , Harris Kelly J. , Lovell Jade A. , Chaparro Barbara S.
Published: February 2021

The Microsoft HoloLens, a mixed reality head-mounted display (HMD), has been demonstrated in domains such as medicine, engineering, and manufacturing. In order to interact with the device, voice input may be required. Given this range of environments, it is necessary to understand the impact of noise on voice dictation speed and accuracy. In this study, we evaluated the dictation feature of the HoloLens through speed (WPM), accuracy (WER), perceived workload, and perceived usability at three different noise levels: 40 dB, 55 dB, and 70 dB. No differences were found across noise levels in speed (67-75 WPM), or perceived workload. Accuracy and perceived usability worsened in the 70 dB noise condition. Only 37.5% of participants were able to successfully dictate in the 70 dB condition. This study shows that if the HoloLens is to be accepted in environments with high noise levels, improvements to dictation need to be made.
Predicting User Performance in Augmented Reality User Interfaces with Image Analysis Algorithms
Authors: Flittner* Jonathan , Luksas John , Gabbard Joseph L.
Published: February 2021

This study determines how to apply existing image analysis measures of visual clutter to augmented reality user interfaces, in conjunction with other factors that may affect performance such as the percentage of virtual objects compared to real objects in an interface, and the type of object a user is searching for (real or virtual). Image analysis measures of clutter were specifically chosen as they can be applied to complex and naturalistic images as is common to experience while using an AR UI. The end goal of this research is to develop an algorithm capable of predicting user performance for a given AR UI. In this experiment, twelve participants performed a visual search task of locating a target object in an array of objects where some objects were virtual, and some were real. Participants completed this task under three different clutter levels (low, medium, high) against five different levels of virtual object percentage (0%, 25%, 50%, 75%, 100%) and two types of targets (real, virtual) with repetition. Task performance was measured through response time. Results show significant differences in response time between clutter levels and between virtual object percentage, but not target type. Participants consistently had more difficulty finding objects in more cluttered scenes, where clutter was determined through image analysis methods, and had more difficulty in finding objects when the virtual of objects was at 50% as opposed to other scenarios. Response time positively correlated to measures of combined clutter (virtual and real) arrays but not for measures of clutter taken of the individual array components (virtual or real), and positively correlated with the clutter scores of the target objects themselves.
Virtual Reality, Augmented Reality, and Virtual Environments: Demonstrations of Current Technologies and Future Directions
Authors: Beadle Sarah , Spain Randall , Goldberg Benjamin , Ebnali Mahdi , Bailey Shannon , Ciccone Brendan , Wilson Ragan , Rubensky Summer , Carroll Meredith , Bennett Winston , Hu Xueyu , Reiner Adam , Vasquez Holland , Wooldridge Abigail , Lee Lydia , Verma Parth , Jeong Heejin , Goldberg Benjamin , Gisick Logan , French Jon , Keebler Joseph
Published: February 2021

Virtual environments and immersive technologies are growing in popularity for human factors purposes. Whether it is training in a low-risk environment or using simulated environments for testing future automated vehicles, virtual environments show promise for the future of our field. The purpose of this session is to have current human factors practitioners and researchers demonstrate their immersive technologies. This is the eighth iteration of the “Me and My VE” interactive session. Presenters in this session will provide a brief introduction of their virtual reality, augmented reality, or virtual environment work before engaging with attendees in an interactive demonstration period. During this period, the presenters will each have a multimedia display of their immersive technology as well as discuss their work and development efforts. The selected demonstrations cover issues of designing immersive interfaces, military and medical training, and using simulation to better understand complex tasks. This includes a mix of government, industry, and academic-based work. Attendees will be virtually immersed in the technologies and research presented allowing for interaction with the work being done in this field.
Population-level estimation of timing, duration and quality of sleep in Canada: A smart thermostat based exploratory study
Authors: Sahu Kirti Sundar , Oetomo Arlene , Jalali Niloofar , Morita Plinio
Published: February 2021

Sleep is essential for the health and well-being. Less overall sleep, as well as reduced sleep duration and poor quality of sleep leads to chronic disease, including mental health issues. Measurements of sleep include subjective and objective methods. Population level measurement of sleep indicators is a challenging task for public health officials. Alternative to traditional data collection by survey method, data from smart homes including Internet of Things have the potential to reveal many insights about sleep. Our objective was to calculate sleep duration, quality and effect of geographical location on the sleep parameters. In this project, Donate Your Data, a data sharing program for research from ecobee was utilized for calculating population level health indicators. Using data from two pilot studies and Donate Your Data, this project analyzed and measured population level health indicators for sleep in Canada. The Spearman’s Correlation coefficient between Fitbit steps and total number of motion sensors activated was 0.8 with p<0.0001. Average duration of sleep hours for Canada measured as 7.2 hours at the individual level and 7.9 hours at the household level, compared to 7.3 hours from the Public Health Agency of Canada’s PASS indicator. This project also calculated proportion of population bedtime, wake up time, amount of disturbed sleep, time trend, as well as geographical variation across Canada.
Quantitative imaging decision support (QIDSTM) tool consistency evaluation and radiomic analysis by means of 594 metrics in lung carcinoma on chest CT scan
Authors: Fusco Roberta , Granata Vincenza , Mazzei Maria Antonietta , Di Meglio Nunzia , Del Roscio Davide , Moroni Chiara , Monti Riccardo , Cappabianca Carlotta , Picone Carmine , Neri Emanuele , Coppola Francesca , Montanino Agnese , Grassi Roberta , Petrillo Antonella , Miele Vittorio
Published: February 2021

Objective:

To evaluate the consistency of the quantitative imaging decision support (QIDSTM) tool and radiomic analysis using 594 metrics in lung carcinoma on chest CT scan.

Materials and Methods:

We included, retrospectively, 150 patients with histologically confirmed lung cancer who underwent chemotherapy and baseline and follow-ups CT scans. Using the QIDSTM platform, 3 radiologists segmented each lesion and automatically collected the longest diameter and the density mean value. Inter-observer variability, Bland Altman analysis and Spearman’s correlation coefficient were performed. QIDSTM tool consistency was assessed in terms of agreement rate in the treatment response classification. Kruskal Wallis test and the least absolute shrinkage and selection operator (LASSO) method with 10-fold cross validation were used to identify radiomic metrics correlated with lesion size change.

Results:

Good and significant correlation was obtained between the measurements of largest diameter and of density among the QIDSTM tool and the radiologists measurements. Inter-observer variability values were over 0.85. HealthMyne QIDSTM tool quantitative volumetric delineation was consistent and matched with each radiologist measurement considering the RECIST classification (80-84%) while a lower concordance among QIDSTM and the radiologists CHOI classification was observed (58-63%). Among 594 extracted metrics, significant and robust predictors of RECIST response were energy, histogram entropy and uniformity, Kurtosis, coronal long axis, longest planar diameter, surface, Neighborhood Grey-Level Different Matrix (NGLDM) dependence nonuniformity and low dependence emphasis as Volume, entropy of Log(2.5 mm), wavelet energy, deviation and root man squared.

Conclusion:

In conclusion, we demonstrated that HealthMyne quantitative volumetric delineation was consistent and that several radiomic metrics extracted by QIDSTM were significant and robust predictors of RECIST response.
Health Services: A Mixed Methods Assessment of Canadian Cancer Patient Education Materials Related to the 2019 Novel Coronavirus
Authors: van Ballegooie Courtney , Hoang Peter
Published: February 2021

The 2019 novel coronavirus (COVID-19) pandemic has prompted the reorganization in the scheduling and method of care for many patients, including patients diagnosed with cancer. Cancer patients, who have an immunocompromised status, may be at a higher risk of severe symptoms from infection with COVID-19. While information is rapidly evolving regarding COVID-19, Canada, both nationally and provincially, has been conveying new information to patients online. We assessed the content and readability of COVID-19-related online Canadian patient education material (PEM) for cancer patients to determine if the content of the material was written at a grade reading level that the majority of Canadians can understand. PEMs were extracted from provincial cancer agencies and the national Canadian Cancer Society, evaluated using 10 readability scales, qualitatively analyzed to identify their themes and difficult word content. Thirty-eight PEMs from both national and provincial cancers associations were, on average, written above the recommended 7th grade level. Each of the associations’ average grade levels were: BC Cancer (11.00 95% confidence interval [CI] 8.27-13.38), CancerControl Alberta (10.46 95% CI 8.29-12.62), Saskatchewan Cancer Agency (11.08 95% CI 9.37-12.80), Cancer Care Manitoba (9.55 95% CI 6.02-13.01), Cancer Care Ontario (9.35 95% CI 6.80-11.90), Cancer Care Nova Scotia (10.95 95% CI 9.86-12.04), Cancer Care Eastern Health Newfoundland and Labrador (10.14 95% CI 6.87-13.41), and the Canadian Cancer Society (10.06 95% CI 8.07-12.05). Thematic analysis identified 4 themes: public health strategy, information about COVID-19, patient instructions during COVID-19, and resources. Fifty-three percent of the complex words identified were medical jargon. This represents an opportunity to improve PEM readability, to allow for greater comprehension amongst a wider target audience.
Inflammatory Mechanisms in Parkinson’s Disease: From Pathogenesis to Targeted Therapies
Authors: Lee Stellina Y. H. , Yates Nathanael J. , Tye Susannah J.
Published: February 2021

Inflammation is a critical factor contributing to the progressive neurodegenerative process observed in Parkinson’s disease (PD). Microglia, the immune cells of the central nervous system, are activated early in PD pathogenesis and can both trigger and propagate early disease processes via innate and adaptive immune mechanisms such as upregulated immune cells and antibody-mediated inflammation. Downstream cytokines and gene regulators such as microRNA (miRNA) coordinate later disease course and mediate disease progression. Biomarkers signifying the inflammatory and neurodegenerative processes at play within the central nervous system are of increasing interest to clinical teams. To be effective, such biomarkers must achieve the highest sensitivity and specificity for predicting PD risk, confirming diagnosis, or monitoring disease severity. The aim of this review was to summarize the current preclinical and clinical evidence that suggests that inflammatory processes contribute to the initiation and progression of neurodegenerative processes in PD. In this article, we further summarize the data about main inflammatory biomarkers described in PD to date and their potential for regulation as a novel target for disease-modifying pharmacological strategies.
Device-Induced Hemostatic Disorders in Mechanically Assisted Circulation
Authors: Wang Shigang , Griffith Bartley P. , Wu Zhongjun J.
Published: February 2021

Mechanically assisted circulation (MAC) sustains the blood circulation in the body of a patients undergoing cardiac surgery with cardiopulmonary bypass (CPB) or on ventricular assistance with a ventricular assist device (VAD) or on extracorporeal membrane oxygenation (ECMO) with a pump-oxygenator system. While MAC provides short-term (days to weeks) support and long-term (months to years) for the heart and/or lungs, the blood is inevitably exposed to non-physiological shear stress (NPSS) due to mechanical pumping action and in contact with artificial surfaces. NPSS is well known to cause blood damage and functional alterations of blood cells. In this review, we discussed shear-induced platelet adhesion, platelet aggregation, platelet receptor shedding, and platelet apoptosis, shear-induced acquired von Willebrand syndrome (AVWS), shear-induced hemolysis and microparticle formation during MAC. These alterations are associated with perioperative bleeding and thrombotic events, morbidity and mortality, and quality of life in MCS patients. Understanding the mechanism of shear-induce hemostatic disorders will help us develop low-shear-stress devices and select more effective treatments for better clinical outcomes.