bluuebunny/crossref_metadata_2025 huggingface dataset:
Formation of Data Science Teams based on Scenario Characteristics
Authors: Handley Holly A. H. , Eshelman-Haynes Candace
Published: November 2021

The objective of this research was to identify a set of attributes to characterize data science scenarios to assists in the formation of an accompanying data science team. The six scenario characteristics were developed in consultation with a Subject Matter Expert (SME) to identify the important aspects of a data science endeavor. Concurrently, a generalizable role by task matrix was developed that captures the high-level data science functions and potential team member roles. This matrix was based on the NATO data science process function definitions, linked to the U.S. Department of Labor social science work activities, and data science role definitions. The mapping of the characteristics to the role by task matrix results in guidelines for forming a data science team; an example scenario with its characteristics and proposed team design is described. This work suggests methods to customize team information for specific data science needs based on scenario attributes.
Individual Differences in Frustration and Performance with Online Shopping Activities
Authors: Ferreri Nina , Mayhorn Christopher B.
Published: November 2021

Individual differences in user responses and interactions with technology are important to consider when examining frustration and expectations for technology performance. This research expanded on Ferreri and Mayhorn (2021) and Hadlington and Scase (2018) by examining individual differences in responses to failures in digital technology (RFDT) when exposed to a malfunction (present vs. absent) and given an expectation (no vs. low vs. high) about the technology capabilities. A preliminary sample of 30 undergraduate students was obtained to complete an online shopping task. Following the task, participants reported the items they were asked to purchase, as well as their responses to failures in digital technology, technology acceptance attitudes, personality dimensions, and current mood (pre vs. post). Several correlations revealed consistent findings with previous research and indicate potentially significant findings with the full dataset. It is anticipated that those with low expectation and scoring high in neuroticism will report the most frustration.
The Effects of Practice on Navigation Performance and Mental Workload with a Mirror-In-The-Sky Map
Authors: Vasquez Holland M. , Hollands Justin G. , Jamieson Greg A.
Published: November 2021

Some previous research using a new augmented reality map display called Mirror-in-the-Sky (MitS) showed that performance was worse and mental workload (MWL) greater with MitS relative to a track-up map for navigation and wayfinding tasks. The purpose of the current study was to determine—for both MitS and track-up map—how much performance improves and MWL decreases with practice in a simple navigation task. We conducted a three-session experiment in which twenty participants completed a route following task in a virtual environment. Task completion times and collisions decreased, subjective MWL decreased, and secondary task performance improved with practice. The NASA-TLX Global ratings and Detection Response Task Hit Rates showed a larger decrease in MWL with MitS than the track-up map. Additionally, means for performance and workload measures showed that differences between the MitS and track-up map decreased in the first session. In later sessions the differences between the MitS and track-up map were negligible. As such, with practice performance and MWL may be comparable to a traditional track-up map.
A Decision Support Tool for Assessing Trust in an Enterprise Data Sharing Partner
Authors: St. John Mark F. , Dustin Young M.
Published: November 2021

Enterprises need to trust that data they share with other enterprises is not exploited maliciously and cause harm. We describe the development and evaluation of a decision support tool for assessing trust in a partner enterprise. The tool is composed of ten statements spanning four well-established organizational trust factors: ability, integrity, benevolence, and vulnerability. Users rate the statements about a partner enterprise and then rate their trust in the partner enterprise. The tool focuses users on these trust factors and mentally prepares them to make the trust rating. As a first evaluation of the tool, participants read 25 statements each about enterprises in three fictional countries and rated their trust without the tool, using only their intuitions. Then they rated three more enterprises while using the tool. The tool led to trust ratings that were significantly closer to the constructed, expected ratings, and participants rated the tool as useful.
A Single-Camera Computer Vision-Based Method for 3D L5/S1 MomentEstimation During Lifting Tasks
Authors: Wang Hanwen , Xie Ziyang , Lu Lu , Li Li , Xu Xu , Fitts Edward P.
Published: November 2021

Excessive low back joint loading during material handling tasks is considered a critical risk factor of musculoskeletal disorders (MSD). Therefore, it is necessary to understand the low-back joint loading during manual material handling to prevent low-back injuries. Recently, computer vision-based pose reconstruction methods have shown the potential in human kinematics and kinetics analysis. This study performed L5/S1 joint moment estimation by combining VideoPose3D, an open-source pose reconstruction library, and a biomechanical model. Twelve participants lifting a 10 kg plastic crate from the floor to a knuckle-height shelf were captured by a camera and a laboratory-based motion tracking system. The L5/S1 joint moments obtained from the camera video were compared with those obtained from the motion tracking system. The comparison results indicate that estimated total peak L5/S1 moments during lifting tasks were positively correlated to the reference L5/S1 joint moment, and the percentage error is 7.7%.
Biomechanical Evaluation of Back-Support Exoskeletons during Patient Transfers
Authors: Hwang Jaejin , Yerriboina Venkata Naveen Kumar , Ari Hemateja , Kim Jeong Ho
Published: November 2021

The purpose of this study was to investigate the effects of three back-support exoskeletons (FLx ErgoSkeleton, V22 ErgoSkeleton, Laevo V2.5) and patient transfer methods (Squat pivot, stand pivot, scoot) on the musculoskeletal loading and self-reported usability measures during patient transfers between a bed and a wheelchair. In a repeated-measures laboratory study, 20 experienced caregivers (17 females and 3 males) performed a series of 24 bed-to-wheelchair transfer tasks (2 directions × 4 exoskeleton conditions × 3 patient transfer methods). The trunk flexion and lateral flexion angles, bilateral hand pull forces, and muscle activities of the erector spinae were significantly different by exoskeleton conditions and patient transfer methods (p’s < 0.01). The usability measures were significantly affected by exoskeleton designs (p’s < 0.01). There were significant two-way interaction effects on the trunk flexion and lateral flexion angles and muscle activities of the erector spinae (p’s < 0.01). For the squat pivot method, three back-support exoskeletons showed the largest reduction of erector spinae muscle activities (47.4 to 83.5% reference voluntary contractions) compared to no exoskeleton. This indicated the effects of exoskeleton conditions on the trunk postures and erector spinae muscle activities depended on the patient transfer method. More research could be needed to improve the trunk postures and usability of back-support exoskeletons suitable for patient handling.
Influence of Cumulative Risk Priming on Security Update Decision Making
Authors: Shieh Michael , Rajivan Prashanth
Published: November 2021

Installing security updates is one of the important security actions individuals can take to prevent potential cybersecurity threats. The cumulative risk of delaying the installation of security updates over an extended period can be substantial, and yet, people often choose to delay such actions. Past research suggests that people neglect to update because the majority overestimate the cost (e.g., time) of an update and underestimate an attack risk. Utilizing the repeated protective decision paradigm, we conducted a laboratory experiment to examine whether priming people about the cumulative risk of not updating could influence their update speed. Results from our experiment show that communicating cumulative risk would only have a momentary eﬀect on peoples’ update decisions and that people would quickly learn from experience to delay or neglect to update. Our ﬁndings highlight the importance of augmenting user habits to improve update decision-making.
Error recovery training literature review: Implications for emergency field medicine
Authors: Militello Laura G. , Wagner Eli , Winner Jennifer , Sushereba Christen , McCool Jessica
Published: November 2021

Training focused on recognizing when a medical procedure has not been implemented effectively may reduce preventable battlefield deaths. Although important research has been conducted about a range of error recovery training strategies, few studies have been conducted in the context of training for high stakes, dynamic domains such as combat medic training. We conducted a literature review to examine how error recovery training has been designed in other contexts, with the intent of abstracting recommendations for designing error recovery training to support military personnel providing emergency field medicine. Implications for combat medic training include: 1) a focus on error management rather than error avoidance, 2) a didactic training component may support training engagement and mental model development, 3) an experiential component may be designed to support perceptual skill development and anomaly detection, and 4) feedback should focus on allowing learners to make errors and encouraging them to learn from errors.
Advancing Equitable and Just Practices in Human Factors and Ergonomics
Authors: Lusebrink Rory , Wooldridge Abigail R. , Spiwak Mia
Published: November 2021

Marginalized people are disproportionately harmed by systemic social inequities; human factors and ergonomics (HF/E) professionals can address these systemic issues by developing and implementing equitable and just practices. To identify practical steps to transform ergonomic practice, we thematically analyzed two group discussions from a session focused on diversity, inclusion, and justice at the 2019 Annual Meeting of the Human Factors and Ergonomics Society (HFES). We identified 36 recommendations to advance equitable and just practices in HF/E, for both practitioners and academics. HF/E professionals should be particularly mindful about historical harm when engaging with vulnerable populations and take appropriate steps to ensure the safety and well-being of all people. HF/E professionals can do so by building relations with and empowering community members as well as learning methods of engagement from other fields.
Risk Assessment In The Military: A Work/Rest Schedule-Based Tool For The Usn Surface Fleet
Authors: Badua Ana Veronica Y. , Lewis Shattuck Nita , Matsangas Panagiotis
Published: November 2021

Long working hours, 24/7 shift work, restricted sleep opportunities, and circadian misalignment all lead to degraded human performance and impairments in decision making. After several mishaps involving U.S. Navy warships in 2017, renewed attention was devoted to optimizing warfighter performance and reducing safety risks associated with crew endurance and fatigue issues. This paper summarizes the development and initial evaluation of the Scheduling Management Aid for Risk Tracking (SMART) prototype. SMART is a human performance risk assessment tool designed to help the U.S. Navy systematically assess and mitigate risk due to crew fatigue during in port and at-sea operations. The heuristics underlying the prototype are selected to identify and quantify human performance risk based on a Sailor’s work and rest patterns. The results are designed to enable data-driven crew resource management decisions, take targeted fatigue mitigation actions, and rapidly calculate human performance risks.
Trust in Automation: The Effects of System Certainty on Decision-Making
Authors: Luster Maya S. , Pitts Brandon J.
Published: November 2021

In the field of Human Factors, the concept of trust in automation can help to explain how and why users interact with particular systems. One way to examine trust is through task performance and/or behavioral observations. Previous work has identified several system-related moderators of trust in automation, such as reliability and complexity. However, the effects of system certainty, i.e., the knowledge that a machine has regarding its own decision-making abilities, on trust remains unclear. The goal of this study was to examine the extent to which system certainty affects perceived trust. Participants performed a partially simulated flight task and decided what action to take in response to targets in the environment detected by the aircraft’s automation. The automation’s certainty levels in recognizing targets were 30%, 50%, and 80%. Overall, participants accepted the system’s recommendation regardless of the certainty level and trust in the system increased as the system’s certainty level increased. Results may help to inform the development of future autonomous systems.
Watch For Failing Objects: What Inappropriate Compliance Reveals About Shared Mental Models In Autonomous Cars
Authors: Razin Yosef S. , Gale Jack , Fan Jiaojiao , Smith Jaznae’ , Feigh Karen M.
Published: November 2021

This paper evaluates Banks et al.’s Human-AI Shared Mental Model theory by examining how a self-driving vehicle’s hazard assessment facilitates shared mental models. Participants were asked to affirm the vehicle’s assessment of road objects as either hazards or mistakes in real-time as behavioral and subjective measures were collected. The baseline performance of the AI was purposefully low (<50%) to examine how the human’s shared mental model might lead to inappropriate compliance. Results indicated that while the participant true positive rate was high, overall performance was reduced by the large false positive rate, indicating that participants were indeed being influenced by the Al’s faulty assessments, despite full transparency as to the ground-truth. Both performance and compliance were directly affected by frustration, mental, and even physical demands. Dispositional factors such as faith in other people’s cooperativeness and in technology companies were also significant. Thus, our findings strongly supported the theory that shared mental models play a measurable role in performance and compliance, in a complex interplay with trust.
Effects of Light Conditions and Falls Concerns on Older Adults’ Gait Characteristics: A Preliminary Study
Authors: Luo Yue , Lu Xiaojie , Grimaldi Nicolas S , Ahrentzen Sherry , Hu Boyi
Published: November 2021

Falls are one of the main safety concerns for the aging population, possibly caused by the difficulty in maintaining the gait and balance during walking. Vision and psychological effects are reported to be major factors affecting human gait and balance. However, only a few studies have collectively investigated the effects of vision and psychological status on gait characteristics. Therefore, this study aimed to compare the gait characteristics of older adults with different falls concerns under usual ambient and visual-guided light conditions. Twelve community-dwelling adults (five males and seven females, seven with eye diseases, all over 75 years old, 164.5 ± 9.1 cm in stature) were recruited. Participants were instructed to walk from their bed to the bathroom with their normal walking speed four times (two light conditions x two repetitions). Participants’ gait characteristics, including the walking performance, posture, and stability measures, were compared using mixed analyses of variance with light conditions as the within-subject factor, and falls concerns as the between-subject factor. The study found: (1) When compared to the usual ambient night light condition, the lighting with a visual-based guiding prompted participants to have a lower maximum value of right hip flexion and a higher maximum value of trunk accelerometry. Higher confidence in walking and increased numbers of walking direction corrections might contribute to the changes under the visual-guided light conditions. (2) When compared to older adults with low fall concerns, those with high fall concerns demonstrated a slower walking speed as well as a reduction in motion smoothness.
Correlation between workload and teamwork among residents in DIEP Flap surgery
Authors: Norasi Hamid , Wang Tianke , Law Katherine E. , Harless Christin , Susan Hallbeck M. , Nguyen Minh-Doan
Published: November 2021

The goal of this study was to evaluate residents’ workload and teamwork and the correlation between their workload and teamwork subscales during deep inferior epigastric perforator (DIEP) flap surgery. Ten residents who assisted during DIEP flap procedures completed an electronic survey following each DIEP flap procedure from July 2019 to August 2020. The survey contained items from the NASA-TLX and SURG-TLX and questions to measure teamwork subscales. Across 29 surgical cases, 38 surveys were recorded. Overall, the means of workload subscales were mostly greater than 10 and less than 15 (range=020) and the means of all teamwork subscales were greater than 15 (range=0-20). Good teamwork was correlated with lower distractions (Rs= -0.36 to -0.48) and better performance (Rs=0.35 to 0.52). Also, all the teamwork subscales were highly correlated (Rs= 0.59 to 0.92). Our findings suggest that good teamwork, low distractions, and successful performance are generally observed together; however, a causative relationship could not be established based on these results.
Reflexive Response of Neck Muscle to Sudden Perturbation after Prolonged Smartphone Use
Authors: Kim Eunjee , Song Donghyun , Park Dasom , Kim Hyorim , Shin Gwanseob
Published: November 2021

Prolonged smartphone use induces passive stretch of neck tissues and muscle fatigue, affecting spinal stability and pain. It is necessary to evaluate the effect of smartphone use on the reflexive response to detect the changes in neck tissues and head stability. A laboratory experiment (n=10) was conducted to investigate the reflexive response of neck muscle to perturbation after 30 minutes of smartphone use. Neck extensor muscle activation and its activation timing to perturbation were investigated before and after smartphone use. Head angle and muscle activation level were collected during smartphone use. During smartphone use, muscle activation gradually increased. After smartphone use, neck muscles showed a higher activation level and significantly delayed onset to perturbation. Smartphone use changed the reflexive response of the neck muscle. Further study is needed to investigate the association between smartphone use and neuromuscular changes to the tissues of the cervical spine.
Advanced vehicle technology: Mapping mental model accuracy and system exposure to driver behavior
Authors: Benson Aaron , But Joanne , Gaspar John , Carney Cher , Horrey William J.
Published: November 2021

Advanced driver assistance systems have potential to increase safety and comfort for drivers; however, drivers need to understand the capabilities and limitations of these systems to use them appropriately. This study sought to explore how the quality (accuracy) of drivers’ mental models of adaptive cruise control (ACC) impacted their behavior and interactions while using the system. Seventy-eight participants drove in a high-fidelity driving simulator while operating an ACC system, in normal conditions and while interacting with the system interface. Participants with stronger (more accurate) mental models glanced to the road ahead more often during normal conditions early on compared to drivers were less accurate mental models; however, these differences diminished with increased system exposure. Glance behavior while interacting with the system and time to complete the interactions were less effected by the strength of the participant’s mental model. Results are discussed in the context of driver education and training.
Patient Safety Risks during On-Demand Telehealth Referrals and Implications for Human Factors Research
Authors: Gomes Kylie M. , Adams Katharine T. , Booker Ethan , Ratwani Raj M.
Published: November 2021

The COVID-19 pandemic has rapidly accelerated the adoptionof on-demand telehealth as a way to keep patients and providers safe from viral transmission. However, theconstrained timelines and challenging conditions under which telehealth was implemented along with the factthat many patientsand providers are interacting in a new modality raisesconcerns about the potential for unintended patient safety risks that have yet to be fully understood. With the surge in telehealth patient volumeduringthe pandemic,on demand telehealth has served as a way to triageand refer patients who need additional in-person evaluation and treatment. One safety concern is whether patients who are referred are successfully following through on in-person care referrals as thefailure to seekin-person care may lead to increased risk of delayed or missed diagnosis. This study aimsto evaluate whether patientsare successfully fulfilling their in -person referralsfollowingareferralfromon-demandtelehealth through retrospective analysis of a subset of telehealth referral datafrom a large healthcare system. Of the 911 on-demand telehealth visitswith a referral to in-person care, only 689showed anin-person care encounter following the telehealthvisit and only 75-85% ofmore immediate urgency in-person referrals were fulfilled within the recommended time period of 24 hours. This preliminary data highlights theneed for amore comprehensiveanalysisof the telehealth referral processand the application of human factors methodsto understand and address barriers and risks associated with telehealth referrals and successful follow up.
A novel approach for usability evaluation of mobile applications
Authors: Park Junho , Zahabi Maryam
Published: November 2021

Mobile applications (apps) have been massively developed and released in recent years. In this competitive market, the users’ adoption of the app or satisfaction greatly depends on its usability. Therefore, tech companies and app developers are looking for quick and easy approaches to evaluate the usability of their products early in the design cycle. The objective of this study was to introduce a novel approach combining the capabilities of the gesture-level model (GLM) and heuristic evaluation to assess the usability of mobile apps in early stages of the design cycle and without the need for costly and time-consuming user testing. The approach can be run on a graphical user interface and includes uncertainties regarding user skill level and distraction. Preliminary results suggested that this approach can be used for usability evaluation of mobile apps; however, its validity and generalizability to other domains need to be validated in the future with human-subject experiments.
Usability Testing of a VR Flight Training Program
Authors: Fussell Stephanie G. , Hight Michelle P.
Published: November 2021

Virtual reality (VR) flight training programs are being developed as a low-cost, highly realistic training option and tested to ensure user expectations for skills mastery are met. A usability pilot study was conducted in two experimental courses comparing the training effectiveness of 2D and VR simulation for flight training at a university in the Southwestern United States. The results indicated that system usability was significantly higher in the VR group. There was no significant difference between groups for perceived workload nor user experience. Although both groups reported low symptoms of simulator sickness, users in the VR group reported significantly higher levels of eye strain. Both groups found the simulations to be enjoyable and several users stated that the simulations were beneficial for learning flight maneuvers. The results of the pilot study demonstrated that overall, VR simulation is similar to 2D simulation for flight training in terms of usability and user satisfaction.
Movement Strategies in Virtual Reality: Exploring the Influence of 3D Endpoint Variability
Authors: Clark Logan D. , Riggs Sara L.
Published: November 2021

Research using a kinematic approach has revealed that users often exhibit strategic biases in their movement behavior to minimize the effort required to reach a target. However, a recent exploration of these effects in a virtual reality (VR) environment yielded conflicting results, calling into question whether strategic patterns observed in movements to physical targets can be expected to generalize to VR environments. In the present study, we re-analyze the data from Clark and Riggs (2020) using principal component analysis (PCA) to empirically distinguish between alternative explanations for the unexpected results. Our findings clarify the source of these results for downward versus upward movements and provide a preliminary look at how adaptations to manage perception- and execution-related motor variability may impact users’ movement strategies in VR.
Studying Robot Vacuums Using Online Retailer Reviews to Understand Human-Automation Interaction
Authors: Carames Kenan , Mui Kinting , Azad Amin , Giang* Wayne C.W.
Published: November 2021

Robot vacuums are a type of every-day automation and may serve as a possible domain for studying human-automation interactions. Online reviews of four models of autonomous robot vacuums, representing different levels of price and automation, were collected from multiple retailers to understand user interactions and issues encountered. Using a thematic analysis, reviews were categorized into three themes: prior experience with robot vacuums, navigation, and mapping, and troubleshooting issues. The results suggested that new users were more satisfied with their robots than experienced users. Furthermore, price and brand name may influence users’ mental models of their vacuums. Owners of more expensive vacuums appeared less willing to change their behavior to accommodate the vacuum’s limitations. These findings suggest that robot vacuums may be a useful gateway domain for understanding everyday-users’ interactions with automation, and that online reviews are a potential source of information on user experiences.
An Investigation of Team Inputs, Processes, And Emergent States on Performance in a Spaceship Bridge Simulation
Authors: Simonson Richard J. , Keebler Joseph R. , Wallace Ryan J. , Griggs Andrew C.
Published: November 2021

This investigation serves to provide evidence on the effects of various input variables on intact teams through repeated team performance sessions in a team spaceship bridge simulation (i.e. Artemis). The Input Mediator/Moderator Output Input (IMOI) model provides a systems engineering an approach to understand various team and individual input variables contribution to the development of team processes and emergent states, ultimately leading to a team’s ability to perform together. While various prior research initiatives have served to contribute to the pool of evidence of which input variables are most highly predictive of a team’s overall performance, the need for further and recursive input to output investigations is needed. Our results indicate perceived team effectiveness and cohesion are significant predictors in team performance and that skill and knowledge of a simulated environment may overshadow team-specific effectiveness indicators as the team gains experience.
Effect of Illumination on Human Drone Interaction Tasks: An Exploratory Study
Authors: Ozkan Yerebakan Mustafa , Hao Shuai , Xu Kun , Gheisari Masoud , Jeelani Idris , Hu Boyi
Published: November 2021

With recent changes by the Federal Aviation Administration (FAA) opening the possibility of more areas for drones to be used, such as delivery, there will be increasingly more intera ctions between humans and drones soon. Although current human drone interaction (HDI) investigate what factors are necessary for safe interactions, very few has focused on drone illumination. Therefore, in this study, we explored how illumination affects users’ perception of the drone through a distance perception task. Data analysis did not indicate any significant effects in the normal distance estimation task for illumination or distance conditions. However, most participants underestimated the distance in the normal distance estimation task and indicated that the LED drone was closer when it wa s illuminated during the relative distance estimation task, even though the drones were equidistant. In future studies, factors such as the weather conditions, lighting patterns, and height of the drone will be explored.
User Experience Design for Human-Machine Teaming in Commanding a Distributed Constellation of Unmanned Assets in Search and Rescue
Authors: Anderson T. , Fogarty K. , Kenkel H. , Raisigel J. , Zhou S. , Reggia L. M. , Manizade S. G. , Lesniak D. R. , Gerling G. J.
Published: November 2021

Search and rescue missions are time-sensitive, with their duration impacting survivability. Unmanned aerial vehicles (UAVs) are increasingly shortening response time, accelerating area coverage, and informing resource allocation. However, interactions of UAVs and human operators pose challenges, for example, related to understandability and trust in automation. This work seeks to facilitate human-machine teaming in designing an on-the-loop user experience with a constellation of UAVs as they narrow search areas by locating and triangulating mobile phone signals using dynamic co-fields autonomy. First, an abstraction-decomposition hierarchy is built to represent underlying values and requirements of the domain. Second, user interfaces are designed to reduce UAV and phone positional uncertainty over time, monitor power, communications, and other information per asset, and empower the operator to influence drone behavior. Their design includes spatiotemporal representations of search areas, UAV positions, communications signals, as well as notifications. Finally, user evaluation was conducted with domain and usability experts.
A Kinematic Evaluation of Linear and Parabolic Pointing in Virtual Reality
Authors: Sermarini John , Kider Joseph T. , LaViola Joseph J. , McConnell Daniel S.
Published: November 2021

We present the results of a study investigating the influence of task and effector constraints on the kinematics of pointing movements performed in immersive virtual environments. We compared the effect of target width, as a task constraint, to the effect of movement distance, as an effector constraint, in terms of overall effect on movement time in a pointing task. We also compared a linear ray-cast pointing technique to a parabolic pointing technique to understand how interaction style may be understood in the context of task and effector constraints. The effect of target width as an information constraint on pointing performance was amplified in VR. Pointing technique acted as an effector constraint, with linear ray-cast pointing resulting in faster performance than parabolic pointers.
Turning HART into HEART: Human Emotional AI/Robot Teaming
Authors: Jeon Myounghoon
Published: November 2021

The advancement of technology requires a new teaming dynamic between humans and AI/robots. As emotions and affect are critical in forming human-human relationships, they are also expected to have a significant impact on human-AI/robot team dynamics. However, little research has been conducted on the effects of emotions on this relationship and team performance. In this perspective paper, I propose turning HART (human-AI/robot teaming) into HEART (human-emotional AI/robot teaming) and demonstrate its potential effects. To this end, existing frameworks on emotion research are introduced, followed by a brief literature survey on emotional AI/robot research and its potential applications to HART. Finally, further considerations are discussed. I hope this paper can spark lively discussions on a new legitimate framework, HEART, to more accurately understand and predict human behavior and team performance in HART settings.
Relationships between cognitive factors and gait strategy during exoskeleton-augmented walking
Authors: Gupta Aditi , McKindles Ryan , Stirling Leia
Published: November 2021

Individual variation in exoskeleton-augmented gait strategy may arise from differences in cognitive factors, e.g., ability to respond quickly to stimuli or complete tasks under divided attention. Gait strategy is defined as different approaches to achieving gait priorities (e.g., walking without falling) and is observed via changes in gait characteristics like normalized stride length or width. Changes indicate shifting priorities like increasing stability or coordination with an exoskeleton. Relationships between cognitive factors and exoskeleton gait characteristics were assessed. Cognitive factors were quantified using a modified Simon task and a speed achievement task on a self-paced treadmill with and without a secondary go/no-go task. Individuals with faster reaction times and decreased ability to maintain a given speed tended to prioritize coordination with an exoskeleton over gait stability. These correlations indicate relationships between cognitive factors and individual exoskeleton-augmented gait strategy that should be further investigated to understand variation in exoskeleton use.
Human Factors Considerations for Teaming between Construction Workersand Voice-based Intelligent Virtual Agent (VIVA)
Authors: Rahimi Movassagh Maryam , Roofigari-Esfahan Nazila , Won Lee Sang , Evia Carlos , Hicks David , Jeon Myounghoon
Published: November 2021

Construction sites experience low productivity due to particular characteristics such as unique designs in each project, sporadic arrival of projects, and complexity of the process. Another contributing factor to low productivity is poor communication among workers, supervisors, and a site’s centralized knowledge hub. Research shows that introducing advanced artificial intelligence (AI) technology in construction can tackle these problems. In this paper, we analyzed human factors considerations–user, task, environment, and technology and identified their characteristics and challenges to design an interactive AI system to facilitate communication between workers and other stakeholders. Based on the analysis, we propose a voice-based intelligent virtual agent (VIVA) as a multi-purpose AI system on construction sites with a further research agenda. We hope that this effort can guide the design of construction-specific AI systems and that this worker-AI teaming can improve overall work processes, enhance productivity, and promote safety in construction.
Drivers Glance Like Lizards during Cell Phone Distraction in Assisted Driving
Authors: Yang Shiyan , Shiferaw Brook , Roady Trey , Kuo Jonny , Lenné Michael G.
Published: November 2021

Head pose has been proposed as a surrogate for eye movement to predict areas of interest (AOIs) where drivers allocate their attention. However, head pose may disassociate with AOIs in glance behavior involving zero or subtle head movements, commonly known as “lizard” glance pattern. In contrast, “owl” glance pattern is used to describe glance behavior along with larger head movements. It remains unclear which glance pattern is prevalent during driver cell phone distraction and what are appropriate metrics to detect such distraction. To address this gap, we analyzed the gaze direction and head pose of 36 participants who completed an email-sorting task using a cell phone while driving a Tesla on the test track in Autopilot mode. The dispersion-threshold algorithm identified driver gaze fixations and synchronized them with head movements. The results showed that when using a cell phone either near the lap or behind the steering wheel, participants exhibited a dominant lizard-type glance pattern with minimal shift in head position. As a result, head pose alone may not provide sufficient information for cell phone distraction detection, and gaze metrics should be involved in enhancing this application.
A Mini Review of Presence and Immersion in Virtual Reality
Authors: Wilkinson Michael , Brantley Sean , Feng Jing
Published: November 2021

Virtual reality technology is constantly improving such that a virtual environment is more like a physical one. However, some research evidence suggest that certain virtual reality scenarios are less real than others to human observers (e.g., experience of falling from a high place) leading to potential limitations of using virtual reality as a research tool for certain tasks. Moreover, since the inception of VR research the terms presence and immersion have been somewhat convoluted and at times, even used interchangeably. Using a thematic content analysis based on seventeen articles, a theme for each term emerged. Presence is an experiential quality in virtual environments and immersion is associated with the technical aspects of a virtual system that aide the user in feeling a sense of presence. Several new technologies, as well as more traditional approaches are discussed as potential methods to improve of immersion, and therefore presence, in virtual reality.
Nodes Afford Connection: A Pilot Study Examining the Design and Use of a Graphical Modeling Language
Authors: Pugh Zachary H. , Gillan Douglas J.
Published: November 2021

External representations such as diagrams facilitate reasoning. Many diagramming systems and notations are amenable to manipulation by actual or imagined intervention (e.g., transposing terms in an equation). Such manipulation is constrained by user-enforced constraints, including rules of syntax and semantics which help preserve the representation’s validity. We argue that the concepts of affordances and signifiers can be applied to understand such representations, and we suggest the term graphical affordance to refer to rule-constrained syntactic manipulation of an external representation. Following this argument, we examine a graphical modeling language in terms of these graphical affordances, and we present a pilot study examining how participants interact with the modeling language. Preliminary results suggest that using the modeling language, as opposed to prose representation, influences user behavior in a manner aligned with the graphical affordances and signifiers of the modeling language.
A Pilot Study on Extending the SUS Survey: Early Results
Authors: Harper Samantha B. , Dorton Stephen L.
Published: November 2021

The System Usability Scale (SUS) is a popular method to measure the subjective usability of a system, due largely to the simplicity and rapidity of both collecting and analyzing data. A drawback is that the SUS generates a single unidimensional usability score from 0-100. Several researchers have amassed larger datasets across multiple projects to allow for analysis on additional methods to glean insights from the SUS survey. Along these lines, we investigate the practical value of extending the SUS survey with additional items such as open text responses, and test underlying assumptions of how SUS results are interpreted. We found that while a lower SUS score does generally correlate to a stronger desire to modify the system, people generally want to make modifications to a system regardless of its usability. Further, we found that the amount of user feedback related to modifications to a system provided predicted subjective usability ratings.
Tele-Technology Evaluation and User Testing with Persons Aging with Long-Term Mobility Disabilities
Authors: Wu Xian , Mitzner Tracy L. , Thomas Rebecca C. , Drobina Emma C. , Rogers Wendy A. , Beer Jenay M.
Published: November 2021

Persons aging with mobility disabilities are at risk of social isolation, which is associated with negative health outcomes. Tele-technology is well-suited for supporting social connectedness by facilitating communication using two-way audio/video. However, the software and hardware requirements of tele-technology for this population are not well understood. The goal of this research was to 1) assess the usability of teletechnologies for this population, and 2) identify design recommendations for improving their usability of tele-technology. We conducted two studies: a heuristic evaluation to compare tele-technology design to usability standards, and a usability study with persons aging with long-term mobility disabilities. The following usability issues emerged: hardware limitations related to the size of technology and height adjustability; interface issues, such as system navigation; and network and privacy concerns. We conclude that there is a need for design improvement and design recommendations were proposed.
Qualitative Assessment of General Aviation Pilots’ Perceptions of Preflight Weather Briefings
Authors: McSorley Jacqueline , Kleber John , Domingo Cassandra , Castano Gianna , Blickensderfer Beth
Published: November 2021

Prior to departing on a flight, General Aviation pilots complete a preflight planning process to ensure the safety of their flight. One aspect of the preflight planning process is obtaining a briefing on the weather conditions that the pilot might encounter along their flight route. Traditionally pilots have utilized a phone-in service, run by Flight Services, to aid in their assessment of weather conditions; however, research indicates that pilots are increasingly reliant on conducting self- briefing using online resources. The purpose of this study is to determine pilot perceptions of obtaining a phone-in brief in comparison to self-briefing.
Patterns of Eye Movement Influenced by Multitasking Workload: A Clustering Analysis
Authors: Sun Tianchen , Hamza Shakur Ameer , Johnson Madison , Huang Shuai , Ji-Eun Kim
Published: November 2021

Although multitasking has been studied in the past few decades, there has been a lack of investigation on how individuals’ multitasking performance can be predicted using eye movement data. To address this gap, this study proposed an exploratory approach to understand the manifestation of eye movement patterns that could provide diagnostic and predictive information of multitasking performance. Nineteen participants completed Multi-Attribute Task Battery (MATB-II) experiments under both low and high workloads and their eye movement and MATB-II task performance were collected. We applied a hierarchical clustering method that classified the participants into three clusters – clusters with small, medium, and large number of fixations. Then, we compared the MATB-II performance of the three clusters. The results s howed significant differences in average reaction time to stimuli and average error count among the three clusters. Our study showed that hierarchical clustering of eye fixations can effectively predict multitasking performance.
Analyzing Spatial Memory in a Virtual Reality-Based Subterranean Scenario: Implication for Military Augmented Reality Systems
Authors: Zaman Farakh , Roeca Gillian , Lupascu Ioana , Gardony Dr. Aaron , Natick MA , Rife Dr. Jason , Intriligator Dr. James
Published: November 2021

Utilizing virtual reality (VR) has allowed the testing of new technology for military missions not available previously, such as using head-mounted augmented reality (AR) to support complicated subterranean (sub-t) missions. Additionally, due to advances in wearable technology, the military will soon offer Soldiers the ability to wear AR head-mounted displays while conducting missions (Freedberg, 2019). Therefore, it is essential to understand how this technology will impact Soldiers’ spatial memory for sub-t environments. This paper describes the methods and preliminary results of in-progress work that uses VR and the Gardony Map Drawing Analyzer (Gardony et al., 2016) to analyze spatial memory following navigation in sub-t missions. Subjects completed a series of tasks in VR while utilizing simulated AR displays that provided navigation aid, such as a compass and an inertial navigation system (bird’s eye trace). After each mission, subjects sketched a diagram of the tunnel system they just explored. We use these sketches to measure how well subjects understood their environment and their recall and ability to recreate the environment for future intelligence purposes.
Broadening Diversity and Inclusivity in Human Factors and Ergonomics
Authors: Spiwak Mia , Wooldridge Abigail R. , Lusebrink Rory
Published: November 2021

Diversity and inclusivity are important, with demonstrated impact on numerous outcomes, including breadth, creativity, and innovation of work as well as satisfaction and commitment to organizations. The Human Factors and Ergonomics Society (HFES) Diversity and Inclusion Committee is charged with increasing diversity and inclusiveness within the society and, by extension, within the Human Factors and Ergonomics (HF/E) profession. We conducted a thematic analysis of an alternative format session at the HFES 2019 Annual Meeting, focusing on a breakout session where attendees discussed “Broadening Participation in HF/E.” Participants reported current levels of diversity and inclusion in the HF/E profession are lacking due to a limited early knowledge about the field compounded by resource barriers, which ultimately prevents involvement in outreach activities intended to increase participation. Thoughtfully designed outreach activities and partnerships with relevant organizations and individuals could mitigate these factors, provided outreach activities are designed to be accessible to all.
The Relationship Between Personality, Recalled Cybersickness Severity, and Recalled Cybersickness Recovery Time
Authors: Jasper Angelica , Doty Taylor , Sepich Nathan , Dorneich Michael C. , Gilbert Stephen B. , Kelly Jonathan W.
Published: November 2021

Characteristics of a virtual reality user are known to affect cybersickness, but the specific role of individual differences, such as personality, is largely unknown. This study addressed this gap through examination of subjective recall survey data relating to experiences in virtual reality, including severity of cybersickness symptoms, cybersickness recovery time, and personality. Mediational structural equation modeling on data from 203 participants who used virtual reality at least once per month indicated that extraversion, agreeableness, and conscientiousness were associated with cybersickness severity and that severity was associated with cybersickness recovery time. Further, cybersickness severity fully mediated the relationship between personality and recovery time. These findings highlight the potential relationship between individual differences in personality and suggest further investigation into cybersickness with experimental data and validated measures.
University Implementation of TEACHActive – An Automated Classroom Feedback System and Dashboard
Authors: Kelley Jameel , AlZoubi Dana , Gilbert Stephen B. , Baran Evrim , Karabulut-Ilgu Aliye , Jiang Shan
Published: November 2021

Computer vision has the potential to play a significant role in capacity building for classroom instructors via automated feedback. This paper describes the implementation of an automated sensing and feedback system, TEACHActive. The results of this paper can enable other campuses to replicate a similar system using open-source software and consumer-grade hardware. Some of the challenges discussed include faculty recruitment, IRB procedures, camera-based classroom footage privacy, hardware setup, software setup, and IT support. The design and implementation of the TEACHActive system is being carried out at Iowa State University and is being tested with faculty in classrooms pilots. Preliminary interviews with instructors show a desire to include more active learning methods in their classrooms and overall interest in a system that can perform automated feedback. The primary results of this paper include lessons learned from the institutional implementation process.