Administrative Dashboard for Monitoring Use of a Web-Based Parent Training Intervention: Usability Study (Preprint)
Authors: Breitenstein Susan M , Berteletti Julia , Smoske Shea , Barger Charles , Tipps Kyrie , Helsabeck Nathan P 
Published: October 2023

BACKGROUND

Web-based parent training (PT) programs can strengthen parent-child relationships by equipping caregivers with knowledge and evidence-based strategies to manage behavior. Hybrid facilitation of PT includes facilitator interaction paired with self-administered and web-based PT. Web-based administrative dashboards provide users (eg, administrators, facilitators, and researchers) with an integrated platform to monitor parent progress and activities within a PT program or website. Despite the utility and prevalence of administrative dashboards for web-based behavioral interventions, to our knowledge, no research studies have explored the perspectives and insights of dashboard users to enhance user experience and program delivery.

OBJECTIVE

The purpose of this study is to evaluate the usability of the administrative dashboard (<i>ez</i>Dashboard) for the <i>ez</i>Parent program, a 6-module web-based PT program for parents of children aged 2-5 years.

METHODS

This study used a descriptive, single-group design with administrators who were overseeing the implementation of the <i>ez</i>Parent program and trained facilitators for hybrid <i>ez</i>Parent delivery. Participants spent at least 30 minutes reviewing and evaluating the <i>ez</i>Dashboard and then completed a survey of their experience with the dashboard. The survey included the validated 10-item System Usability Scale and open-ended questions focusing on user performance, navigation ease, and overall usefulness of the <i>ez</i>Dashboard.

RESULTS

Participants (N=15) indicated high usability of the <i>ez</i>Dashboard with System Usability Scale scoring a total mean score of 83.5 (SD 16.3). Most participants (n=13, 87%) rated the overall user-friendliness of the <i>ez</i>Dashboard as <i>good</i> (n=3, 20%), <i>excellent</i> (n=9, 60%), or <i>best imaginable</i> (n=1, 7%). Open-ended questions revealed the <i>ez</i>Dashboard is or would be useful to monitor parent progress and trends in engagement (n=8, 53%) and for reviewing topics for discussion and communicating with parents (n=5, 33%). <i>ez</i>Parent administrators (n=4) identified that real-time data for <i>ez</i>Parent use helps overall management of program uptake. Suggestions for features to add to the <i>ez</i>Dashboard included the ability to track partial progress of program modules (4/14, 29%), total time spent per module (2/14, 14%), and exportable reports (4/14, 29%). Other ideas for improvement included direct messaging capabilities, videoconferencing platform integration, and being able to modify participant account and contact information.

CONCLUSIONS

Results indicate that the <i>ez</i>Dashboard is easy to use and provides functional information to facilitators and administrators in delivering <i>ez</i>Parent. Qualitative results indicate that integrating suggested features into the <i>ez</i>Dashboard may help provide a smoother experience for facilitators, administrators, and ultimately the parents using the program. Providing resources for facilitators and administrators in real time to monitor intervention participants’ progress in a program can be helpful in tracking progress and providing facilitated support in tailoring program content and program completion.