User-Centered Design and Usability of Voxe as a Pediatric Electronic Patient-Reported Outcome Measure Platform: Mixed Methods Evaluation Study
Authors: Anthony Samantha J , Pol Sarah J , Selkirk Enid K , Matthiesen Amarens , Klaassen Robert J , Manase Dorin , Silva Amanda , Barwick Melanie , Stinson Jennifer N , Damer Alameen , Ayibiowu Mowa , Dong Selina X , Oreskovich Stephan , Brudno Michael 
Published: September 2024

Background
Electronic patient-reported outcome measures (ePROMs) are standardized digital instruments integrated into clinical care to collect subjective data regarding patients’ health-related quality of life, functional status, and symptoms. In documenting patient-reported progress, ePROMs can guide treatment decisions and encourage measurement-based care practices. Voxe is a pediatric and user-centered ePROM platform for patients with chronic health conditions.

Objective
We aimed to describe the user-centered design approach involving feedback from end users and usability testing of Voxe’s platform features to support implementation in a pediatric health care setting.

Methods
Purposive sampling was used to recruit patients aged 8-17 years from 2 chronic illness populations in 2 pediatric hospitals in Canada. Patients’ health care team members were also purposively recruited. One-on-one iterative testing sessions were conducted digitally by research team members with participants to obtain feedback on the appearance and functionalities of the Voxe platform prototype. Patients and health care providers (HCPs) completed Voxe-related task-based activities. International Organization for Standardization key performance indicators were tracked during HCP task-based activities. HCPs also completed the System Usability Scale. To test platform usability, the think-aloud technique was used by participants during the completion of structured tasks. After completing all task-based activities, patient participants selected 5 words from the Microsoft Desirability Toolkit to describe their overall impression and experience with the Voxe platform. Qualitative data about likes, dislikes, and ease of use were collected through semistructured interviews. Feedback testing sessions were conducted with patients and HCPs until Voxe was acceptable to participating end users, with no further refinements identified. Quantitative and qualitative data analysis were completed using descriptive statistics and content analysis.

Results
A total of 49 patients and 38 HCPs were recruited. Patients were positive about Voxe’s child-centered design characteristics and notification settings. HCPs rated Voxe as user-friendly and efficient, with the time to complete tasks decreasing over time. HCPs were satisfied with the Voxe platform functionalities and identified the value of Voxe’s system notifications, summarized display of ePROM results, and its capacity to integrate with electronic medical records. Patients’ and HCPs’ high satisfaction rates with the Voxe prototype highlight the importance of being responsive to user suggestions from the inception of eHealth platform developments to ensure their efficient and effective design.

Conclusions
This paper describes the user-centered creation and usability testing of Voxe as an ePROM platform for implementation into clinical care for pediatric patients with chronic health conditions. As a patient-facing platform that can be integrated into electronic medical records, Voxe aligns with measurement-based care practices to foster quality patient-centered approaches to care. End users’ positive feedback and evaluation of the platform’s user-friendliness and efficiency suggest that Voxe represents a valuable and promising solution to systematically integrate patient-related outcome (PRO) data into complex and dynamic clinical health care settings.

International Registered Report Identifier (IRRID)
RR2-10.1136/bmjopen-2021-053119