scholarly journals Web-Based Module for the Collection of Electronic Patient-Reported Outcomes in People Living With HIV in Nouvelle Aquitaine, France: Usability Evaluation

10.2196/15013 ◽  
2019 ◽  
Vol 3 (4) ◽  
pp. e15013 ◽  
Author(s):  
Diana Barger ◽  
Olivier Leleux ◽  
Valérie Conte ◽  
Vincent Sapparrart ◽  
Marie Gapillout ◽  
...  
Keyword(s):  
Patient Reported Outcomes ◽  
Usability Testing ◽  
Target Population ◽  
Ease Of Use ◽  
People Living With Hiv ◽  
Research Staff ◽  
Web Based ◽  
System Usability Scale ◽  
Patient Reported ◽  
Living With Hiv

Background Patient-reported outcomes (PROs) can be of great value for both research and chronic disease management. We developed a new module of the ANRS CO3 Aquitaine cohort study’s Web-based data capture and visualization solution (APPEGE 2.0) for the collection of electronic PROs among people living with HIV cared for in Nouvelle Aquitaine, France. Objective This study aimed to evaluate the usability of 2 successively developed prototypes of ARPEGE 2.0’s electronic PROs module before launching a pilot study, owing to the novelty of the proposed data collection method for our setting and specific characteristics of the target population. Methods A total of 2 sequential rounds of empirical, task-based usability evaluations were conducted, involving 8 research staff and then 7 people living with HIV. Evaluators provided written feedback during round 1 and oral feedback during round 2. Evaluators who completed the full set of tasks responded to the System Usability Scale (SUS). We assessed changes in SUS scores between rounds and concluded usability testing when SUS scores reached a ceiling effect, defining good usability a priori as a usability score of 70. Results Insights were generated regarding the visibility of system status and the match between the system and the real world that improved the module’s usability. Research staff evaluators reported mean SUS scores of 65 (SD 18.87) and patient evaluators reported mean SUS scores of 85 (SD 5.4; P=.032). Conclusions Software modifications, informed by successive rounds of usability testing, resulted in sufficient gains in usability to undertake piloting. Insights generated during evaluations prompted us to find the appropriate balance between optimal security and ease of use. Trial Registration ClinicalTrials.gov NCT03296202; https://clinicaltrials.gov/ct2/show/NCT03296202 International Registered Report Identifier (IRRID) RR2-10.2196/10.2196/resprot.9439

scholarly journals Usability testing of a Web-based solution for the collection of electronic patient-reported outcomes in people living with HIV in Nouvelle Aquitaine, France (Preprint)

2019 ◽  
Author(s):  
Diana Barger ◽  
Olivier Leleux ◽  
Valérie Conte ◽  
Vincent Sapparrart ◽  
Marie Gapillout ◽  
...  
Keyword(s):  
Patient Reported Outcomes ◽  
Usability Testing ◽  
Target Population ◽  
Ease Of Use ◽  
Hiv Care ◽  
People Living With Hiv ◽  
Web Based ◽  
Visualization System ◽  
Patient Reported ◽  
Living With Hiv

BACKGROUND Collecting patient-reported outcomes can be of great value for both research and chronic diseases management. We endeavoured to develop a new facet of the ANRS CO3 Aquitaine cohort study’s web-based data capture and visualization system (APPEGE ® 2.0) for the collection of electronic patient-reported outcomes in people living with HIV care for in Aquitaine, France. OBJECTIVE Given the novelty of the proposed data collection method for our setting and specific characteristics of the target population, we sought to evaluate the initial usability of a prototype of an electronic patient-reported outcomes (ePRO) information system (ARPEGE® 2.0). METHODS Two successive rounds of empirical, task-based, usability testing were conducted, involving eight “experts” and then six people living with HIV. Evaluators provided written feedback during round 1 and oral feedback during round 2. Evaluators who completed the full set of tasks responded to the Systems Usability Scale. We assessed changes in SUS scores between rounds and concluded usability testing when SUS scores reached a ceiling effect, defining “good” usability a priori as a usability score of 70. RESULTS Insights were generated regarding the visibility of system status and the match between the system and the real world that improved the solution’s usability markedly. Experts reported mean SUS scores of 65 +- 18.87 and patients reported mean SUS scores of 85 +- 5.4 (p=0.032). CONCLUSIONS Software modifications, informed by successive rounds of usability testing, resulted in sufficient gains in usability to undertake piloting. Usability testing also prompted us to find the appropriate balance between optimal security and ease of use. CLINICALTRIAL https://clinicaltrials.gov/ct2/show/NCT03296202 (Archived by WebCite at http://www.webcitation.org/6zgOBArps)

Usability testing of the PRO-CTCAE measurement system in patients with cancer.

2013 ◽  
Vol 31 (15_suppl) ◽  
pp. e17560-e17560 ◽  
Author(s):  
Maria R. Fawzy ◽  
Amy Pickar Abernethy ◽  
Martin W. Schoen ◽  
Lauren J. Rogak ◽  
Tito R. Mendoza ◽  
...  
Keyword(s):  
Adverse Events ◽  
Measurement System ◽  
Patient Reported Outcomes ◽  
Interactive Voice Response ◽  
Usability Testing ◽  
Ease Of Use ◽  
Cooperative Groups ◽  
Web Based ◽  
Oncology Research ◽  
Patient Reported

e17560 Background: Use of electronic Patient-Reported Outcomes (ePROs) are increasingly employed in patient care and oncology research. However, these systems can be difficult to use, preventing adoption and deployment. The objective is to evaluate the patient usability of the National Cancer Institute’s (NCI) Patient Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) Measurement System. Methods: PRO-CTCAE is an item bank of 124 questions evaluating 78 symptomatic adverse events, as well as a software system that includes a web-based and interactive voice response system [IVRS] to administer these items to patients, and electronic features to customize survey creation, schedule survey administration, export data, and generate alerts and reports. A protocol was developed for two rounds of usability testing to evaluate understanding and ease of navigation reported by patients undergoing cancer treatment. Software was refined between rounds and retested. Patients were asked to login and complete PRO-CTCAE items either in clinic or at home, then were immediately debriefed (semi-scripted) by a trained interviewer. Results: 173 patients at 3 cancer centers and affiliated community network sites were enrolled in the study between 1/11-5/12 (45% male; 32% non-white; 26% high school or less). Usability issues identified in Round 1 (N=37) included difficulty in using radio buttons, absence of survey progress indicators, and problems with system login. Modifications included increasing size of buttons, improving the progress bar feature, and simplifying the interface to focus users on survey questions. In Round 2 (N=136), remaining issues were related to general difficulty with Internet use, such as navigating to the URL. IVRS testing indicated high scores of ease of use and completion of items, but users had difficulty adding unique symptoms to the system. Conclusions: Iterative usability testing identified improvements to web-based and IVRS for patient self-reporting and achieved a more favorable user experience. The feasibility of integrating PRO-CTCAE into trials to gather symptomatic adverse events directly from patients is currently being evaluated in the cancer cooperative groups.

scholarly journals Integrating Electronic Patient-Reported Outcome Measures into Routine HIV Care and the ANRS CO3 Aquitaine Cohort�s Data Capture and Visualization System (QuAliV): Protocol for a Formative Research Study (Preprint)

2017 ◽  
Author(s):  
Diana Barger ◽  
Olivier Leleux ◽  
Valérie Conte ◽  
Vincent Sapparrart ◽  
Marie Gapillout ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Patient Reported Outcomes ◽  
Patient Reported Outcome ◽  
Hiv Care ◽  
People Living With Hiv ◽  
Web Based ◽  
Visualization System ◽  
Patient Reported ◽  
Living With Hiv

BACKGROUND Effective antiretroviral therapy has greatly reduced HIV-related morbidity and mortality, dramatically changing the demographics of the population of people living with HIV. The majority of people living with HIV in France are well cared for insofar as their HIV infection is concerned but remain at risk for age-associated comorbidities. Their long-term, potentially complex, and growing care needs make the routine, longitudinal assessment of health-related quality of life and other patient-reported outcomes of relevance in the current treatment era. OBJECTIVE We aim to describe the development of a Web-based electronic patient-reported outcomes system for people living with HIV linked to the ANRS CO3 Aquitaine cohort’s data capture and visualization system (ARPEGE) and designed to facilitate the electronic collection of patient-reported data and ultimately promote better patient-physician communication and quality of care (both patient satisfaction and health outcomes). METHODS Participants who meet the eligibility criteria will be invited to engage with the Web-based electronic patient-reported outcomes system and provided with the information necessary to create a personal patient account. They will then be able to access the electronic patient-reported outcomes system and complete a set of standardized validated questionnaires covering health-related quality of life (World Health Organization's Quality of Life Instrument in HIV infection, named WHOQOL-HIV BREF) and other patient-reported outcomes. The information provided via questionnaires will ultimately be presented in a summary format for clinicians, together with the patient’s HIV care history. RESULTS The prototype of the Web-based electronic patient-reported outcome system will be finalized and the first 2 formative research phases of the study (prototyping and usability testing) will be conducted from December 2017 to May 2018. We describe the sequential processes planned to ensure that the proposed electronic patient-reported outcome system is ready for formal pilot testing, referred to herein as phases 1a and 1b. We also describe the planned pilot-testing designed to evaluate the acceptability and use of the system from the patient’s perspective (phase 2). CONCLUSIONS As the underlying information technology solution, ARPEGE, has being developed in-house, should the feasibility study presented here yield promising results, the panel of services provided via the proposed portal could ultimately be expanded and used to experiment with health-promoting interventions in aging people living with HIV in hospital-based care or adapted for use in other patient populations. CLINICALTRIAL ClinicalTrials.gov NCT03296202; https://clinicaltrials.gov/ct2/show/NCT03296202 (Archived by WebCite at http://www.webcitation.org/6zgOBArps) REGISTERED REPORT IDENTIFIER RR1-10.2196/9439

scholarly journals 1259. Household Income and Its Relationship with Patient-Reported Outcomes Among Older People Living with HIV

2019 ◽  
Vol 6 (Supplement_2) ◽  
pp. S453-S454
Author(s):  
Peter Mazonson ◽  
Jeff Berko ◽  
Theoren Loo ◽  
Lynsay MacLaren ◽  
Erik S Lowman
Keyword(s):  
Health Outcomes ◽  
Household Income ◽  
Patient Reported Outcomes ◽  
Income Group ◽  
People Living With Hiv ◽  
Annual Household Income ◽  
Patient Reported ◽  
Part Time ◽  
Living With Hiv ◽  
The Relationship

Abstract Background Socioeconomic factors have been identified as a root cause of a wide range of health outcomes. However, there are no studies that describe the impact of these factors on patient-reported outcomes (PROs) among older (age 50+) people living with HIV (PLWH). This study examines the relationship between annual household income, sociodemographic factors, and several PROs among older PLWH. Methods A cross-sectional analysis examined the relationships between self-reported annual household income, sociodemographic information, and validated PROs. Statistical differences within sociodemographic groups were determined using chi-squared tests, and within PROs using bivariate risk ratios. Results Of 922 participants, the median age was 58 years (range: 50–88). The majority of participants were male (89%), gay (79%), and white (70%). Fifty-five percent reported an annual household income of less than $50,000 per year and 45% reported a household income of $50,000 or greater. Among people in the lower-income group, 33% were working full or part time, 24% were retired, and 43% were disabled, whereas among people in the higher income group, 76% were working full or part time, 19% were retired, and 5% were disabled (Table 1). Bivariate analysis showed that while there was not a significant relationship between age and income, income was significantly associated with work status, race, gender, education, relationship status, sexual orientation, and having enough money to meet basic needs. People with lower household income were significantly more likely to be depressed, anxious, and lonely, and to have 4 or more comorbid conditions (Table 2). They were also less likely to have high resilience, high social well-being, and high quality of life. Conclusion To the best of our knowledge, this is the first examination of the relationship between self-reported annual household income and PROs among older PLWH. In these bivariate analyses, income was positively associated with desirable PROs, and negatively associated with undesirable PROs. To be successful, programs designed to improve health outcomes for older PLWH must take into account the economic challenges faced by many in this group. Disclosures All authors: No reported disclosures.

scholarly journals AO Patient Outcomes Center: Design, Implementation, and Evaluation of a Software Application for the Collection of Patient-Reported Outcome Measures in Orthopedic Outpatient Clinics (Preprint)

2018 ◽  
Author(s):  
Nan E Rothrock ◽  
Michael Bass ◽  
Andrea Blumenthal ◽  
Richard C Gershon ◽  
Beate Hanson ◽  
...  
Keyword(s):  
Patient Outcomes ◽  
User Satisfaction ◽  
Patient Reported Outcomes ◽  
Clinical Care ◽  
Patient Reported Outcome ◽  
Ease Of Use ◽  
Measurement Information ◽  
Web Based ◽  
Software Application ◽  
Patient Reported

BACKGROUND Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. OBJECTIVE Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. METHODS AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. RESULTS Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement. CONCLUSION AOPOC was demonstrated to be an easy-to-learn and easy-to-use software application for patients and clinicians that can be integrated into orthopedic clinical care. The workflow disruption in integrating any type of PRO collection must be addressed if patients’ voices are to be better integrated in clinical care.

scholarly journals Software for Administering the National Cancer Institute�s Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events: Usability Study (Preprint)

2018 ◽  
Author(s):  
Martin W Schoen ◽  
Ethan Basch ◽  
Lori L Hudson ◽  
Arlene E Chung ◽  
Tito R Mendoza ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Adverse Events ◽  
National Cancer Institute ◽  
Patient Reported Outcomes ◽  
Task Completion ◽  
Heuristic Evaluation ◽  
Web Based ◽  
System Usability Scale ◽  
Patient Reported ◽  
The Common

BACKGROUND The US National Cancer Institute (NCI) developed software to gather symptomatic adverse events directly from patients participating in clinical trials. The software administers surveys to patients using items from the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) through Web-based or automated telephone interfaces and facilitates the management of survey administration and the resultant data by professionals (clinicians and research associates). OBJECTIVE The purpose of this study was to iteratively evaluate and improve the usability of the PRO-CTCAE software. METHODS Heuristic evaluation of the software functionality was followed by semiscripted, think-aloud protocols in two consecutive rounds of usability testing among patients with cancer, clinicians, and research associates at 3 cancer centers. We conducted testing with patients both in clinics and at home (remotely) for both Web-based and telephone interfaces. Furthermore, we refined the software between rounds and retested. RESULTS Heuristic evaluation identified deviations from the best practices across 10 standardized categories, which informed initial software improvement. Subsequently, we conducted user-based testing among 169 patients and 47 professionals. Software modifications between rounds addressed identified issues, including difficulty using radio buttons, absence of survey progress indicators, and login problems (for patients) as well as scheduling of patient surveys (for professionals). The initial System Usability Scale (SUS) score for the patient Web-based interface was 86 and 82 (P=.22) before and after modifications, respectively, whereas the task completion score was 4.47, which improved to 4.58 (P=.39) after modifications. Following modifications for professional users, the SUS scores improved from 71 to 75 (P=.47), and the mean task performance improved significantly (4.40 vs 4.02; P=.001). CONCLUSIONS Software modifications, informed by rigorous assessment, rendered a usable system, which is currently used in multiple NCI-sponsored multicenter cancer clinical trials. CLINICALTRIAL ClinicalTrials.gov NCT01031641; https://clinicaltrials.gov/ct2/show/NCT01031641 (Archived by WebCite at http://www.webcitation.org/708hTjlTl)

scholarly journals Prevalence of pain in women living with HIV aged 45–60: associated factors and impact on patient-reported outcomes

AIDS Care ◽  
2021 ◽  
pp. 1-10
Author(s):  
Caroline A. Sabin ◽  
Hajra Okhai ◽  
Rageshri Dhairyawan ◽  
Katharina Haag ◽  
Fiona Burns ◽  
...  
Keyword(s):  
Associated Factors ◽  
Patient Reported Outcomes ◽  
Women Living With Hiv ◽  
Patient Reported ◽  
Prevalence Of Pain ◽  
Living With Hiv

scholarly journals Web-Based Patient-Reported Outcome Measures for Personalized Treatment and Care (PROMPT-Care): Multicenter Pragmatic Nonrandomized Trial

10.2196/19685 ◽  
2020 ◽  
Vol 22 (10) ◽  
pp. e19685
Author(s):  
Afaf Girgis ◽  
Ivana Durcinoska ◽  
Anthony Arnold ◽  
Joseph Descallar ◽  
Nasreen Kaadan ◽  
...  
Keyword(s):  
Emergency Department ◽  
Patient Reported Outcomes ◽  
Well Being ◽  
Patient Reported Outcome Measures ◽  
Patient Reported Outcome ◽  
Self Management ◽  
Diverse Population ◽  
Web Based ◽  
Patients With Cancer ◽  
Patient Reported

Background Despite the acceptability and efficacy of e–patient-reported outcome (ePRO) systems, implementation in routine clinical care remains challenging. Objective This pragmatic trial implemented the PROMPT-Care (Patient Reported Outcome Measures for Personalized Treatment and Care) web-based system into existing clinical workflows and evaluated its effectiveness among a diverse population of patients with cancer. Methods Adult patients with solid tumors receiving active treatment or follow-up care in four cancer centers were enrolled. The PROMPT-Care intervention supported patient management through (1) monthly off-site electronic PRO physical symptom and psychosocial well-being assessments, (2) automated electronic clinical alerts notifying the care team of unresolved clinical issues following two consecutive assessments, and (3) tailored online patient self-management resources. Propensity score matching was used to match controls with intervention patients in a 4:1 ratio for patient age, sex, and treatment status. The primary outcome was a reduction in emergency department presentations. Secondary outcomes were time spent on chemotherapy and the number of allied health service referrals. Results From April 2016 to October 2018, 328 patients from four public hospitals received the intervention. Matched controls (n=1312) comprised the general population of patients with cancer, seen at the participating hospitals during the study period. Emergency department visits were significantly reduced by 33% (P=.02) among patients receiving the intervention compared with patients in the matched controls. No significant associations were found in allied health referrals or time to end of chemotherapy. At baseline, the most common patient reported outcomes (above-threshold) were fatigue (39%), tiredness (38.4%), worry (32.9%), general wellbeing (32.9%), and sleep (24.1%), aligning with the most frequently accessed self-management domain pages of physical well-being (36%) and emotional well-being (23%). The majority of clinical feedback reports were reviewed by nursing staff (729/893, 82%), largely in response to the automated clinical alerts (n=877). Conclusions Algorithm-supported web-based systems utilizing patient reported outcomes in clinical practice reduced emergency department presentations among a diverse population of patients with cancer. This study also highlighted the importance of (1) automated triggers for reviewing above-threshold results in patient reports, rather than passive manual review of patient records; (2) the instrumental role nurses play in managing alerts; and (3) providing patients with resources to support guided self-management, where appropriate. Together, these factors will inform the integration of web-based PRO systems into future models of routine cancer care. Trial Registration Australian New Zealand Clinical Trials Registry ACTRN12616000615482; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=370633 International Registered Report Identifier (IRRID) RR2-10.1186/s12885-018-4729-3

Patient Adoption and Utilization of a Web-Based and Mobile-Based Portal for Collecting Outcomes After Elective Orthopedic Surgery

2018 ◽  
Vol 33 (6) ◽  
pp. 649-656 ◽  
Author(s):  
Kerri Bell ◽  
Eugene Warnick ◽  
Kristen Nicholson ◽  
Sarah Ulcoq ◽  
Seong Jin Kim ◽  
...  
Keyword(s):  
Health Care ◽  
Orthopedic Surgery ◽  
Patient Reported Outcomes ◽  
Elective Surgery ◽  
Mobile App ◽  
Data Capture ◽  
Completion Rates ◽  
Web Based ◽  
Online Portal ◽  
Patient Reported

Health care increasingly collects patient-reported outcomes (PROs) via web-based platforms. The purpose of this study was to evaluate how patient age influences portal engagement. Patients undergoing elective surgery at a single multispecialty orthopedic practice from September 2014 to February 2017 had access to an online portal to complete PROs, message the clinic, and view physical therapy instructions. A mobile app was optionally available. Age, sex, log-in frequency, PRO completion rates, and number of messages sent were reviewed retrospectively. Message frequency, log-in rates, and PRO compliance were highest for patients aged 41 to 50, 51 to 60, and 61 to 70, respectively. Mobile app use decreased with age ( P = .002); yet, at all ages, the mobile app group was more engaged. In particular, for patients aged 18 to 30 years, log-in frequency increased 2.5-fold and PRO compliance improved 44% ( P < .001) in the mobile app group. This study demonstrates that portal interaction varies by age and that data capture is highest in patients who choose the mobile app.

Sign in / Sign up

Export Citation Format

Share Document