scholarly journals Usability Evaluation of an Offline Electronic Data Capture App in a Prospective Multicenter Dementia Registry – digiDEM Bayern: a Mixed Method Study (Preprint)

10.2196/31649 ◽  
2021 ◽  
Author(s):  
Michael Reichold ◽  
Miriam Hess ◽  
Peter L. Kolominsky-Rabas ◽  
Elmar Gräßel ◽  
Hans-Ulrich Prokosch
Keyword(s):  
Mixed Method ◽  
Usability Evaluation ◽  
Data Capture ◽  
Mixed Method Study ◽  
Electronic Data Capture ◽  
Electronic Data ◽  
Dementia Registry

scholarly journals 238. Novel Way to Evaluate Antibiotic Use Appropriateness: Moving Towards the “Never Event” Classification by Electronic Algorithm

2020 ◽  
Vol 7 (Supplement_1) ◽  
pp. S119-S120
Author(s):  
Twisha S Patel ◽  
Lindsay A Petty ◽  
Jiajun Liu ◽  
Marc H Scheetz ◽  
Nicholas Mercuro ◽  
...  
Keyword(s):  
Urine Culture ◽  
Asymptomatic Bacteriuria ◽  
Antibiotic Use ◽  
Data Capture ◽  
Electronic Data Capture ◽  
Electronic Data ◽  
False Positivity ◽  
Never Event ◽  
Manual Review

Abstract Background Antibiotic use is commonly tracked electronically by antimicrobial stewardship programs (ASPs). Traditionally, evaluating the appropriateness of antibiotic use requires time- and labor-intensive manual review of each drug order. A drug-specific “appropriateness” algorithm applied electronically would improve the efficiency of ASPs. We thus created an antibiotic “never event” (NE) algorithm to evaluate vancomycin use, and sought to determine the performance characteristics of the electronic data capture strategy. Methods An antibiotic NE algorithm was developed to characterize vancomycin use (Figure) at a large academic institution (1/2016–8/2019). Patients were electronically classified according to the NE algorithm using data abstracted from their electronic health record. Type 1 NEs, defined as continued use of vancomycin after a vancomycin non-susceptible pathogen was identified, were the focus of this analysis. Type 1 NEs identified by automated data capture were reviewed manually for accuracy by either an infectious diseases (ID) physician or an ID pharmacist. The positive predictive value (PPV) of the electronic data capture was determined. Antibiotic Never Event (NE) Algorithm to Characterize Vancomycin Use Results A total of 38,774 unique cases of vancomycin use were available for screening. Of these, 0.6% (n=225) had a vancomycin non-susceptible pathogen identified, and 12.4% (28/225) were classified as a Type 1 NE by automated data capture. All 28 cases included vancomycin-resistant Enterococcus spp (VRE). Upon manual review, 11 cases were determined to be true positives resulting in a PPV of 39.3%. Reasons for the 17 false positives are given in Table 1. Asymptomatic bacteriuria (ASB) due to VRE in scenarios where vancomycin was being appropriately used to treat a concomitant vancomycin-susceptible infection was the most common reason for false positivity, accounting for 64.7% of false positive cases. After removing urine culture source (n=15) from the algorithm, PPV improved to 53.8%. Conclusion An automated vancomycin NE algorithm identified 28 Type 1 NEs with a PPV of 39%. ASB was the most common cause of false positivity and removing urine culture as a source from the algorithm improved PPV. Future directions include evaluating Type 2 NEs (Figure) and prospective, real-time application of the algorithm. Disclosures Marc H. Scheetz, PharmD, MSc, Merck and Co. (Grant/Research Support)

scholarly journals Usability Evaluation for User Interface Design of Student Support System: Mixed Method Study

2020 ◽  
Vol 803 ◽  
pp. 012038
Author(s):  
Ahmed AL-sa’di Rasmus ◽  
Rasmus Bugge Skammelsen ◽  
Qiang Ji Yufeng Xiang ◽  
Bhogadi Aakarsh ◽  
Sathishkumar Kuppusamy
Keyword(s):  
User Interface ◽  
Support System ◽  
Mixed Method ◽  
Interface Design ◽  
Student Support ◽  
User Interface Design ◽  
Usability Evaluation ◽  
Mixed Method Study

How Did a Multi-Institutional Trial Show Feasibility of Electronic Data Capture in Older Patients With Cancer? Results From a Multi-Institutional Qualitative Study (Alliance A171902)

2021 ◽  
pp. 442-449
Author(s):  
Nichole A. Martin ◽  
Elizabeth S. Harlos ◽  
Kathryn D. Cook ◽  
Jennifer M. O'Connor ◽  
Andrew Dodge ◽  
...  
Keyword(s):  
Older Patients ◽  
Electronic Devices ◽  
Data Entry ◽  
Data Capture ◽  
Data Availability ◽  
Electronic Data Capture ◽  
Wireless Internet ◽  
Electronic Data ◽  
Patients With Cancer ◽  
Patient Reported

PURPOSE New technology might pose problems for older patients with cancer. This study sought to understand how a trial in older patients with cancer (Alliance A171603) was successful in capturing electronic patient-reported data. METHODS Study personnel were invited via e-mail to participate in semistructured phone interviews, which were audio-recorded and qualitatively analyzed. RESULTS Twenty-four study personnel from the 10 sites were interviewed; three themes emerged. The first was that successful patient-reported electronic data capture shifted work toward patients and toward study personnel at the beginning of the study. One interviewee explained, “I mean it kind of lost all advantages…by being extremely laborious.” Study personnel described how they ensured electronic devices were charged, wireless internet access was up and running, and login codes were available. The second theme was related to the first and dealt with data filtering. Study personnel described high involvement in data gathering; for example, one interviewee described, “I answered on the iPad, whatever they said. They didn't even want to use it at all.” A third theme dealt with advantages of electronic data entry, such as prompt data availability at study completion. Surprisingly, some remarks described how electronic devices brought people together, “Some of the patients, you know, it just gave them a chance to kinda talk about, you know, what was going on.” CONCLUSION High rates of capture of patient-reported electronic data were viewed favorably but occurred in exchange for increased effort from patients and study personnel and in exchange for data that were not always patient-reported in the strictest sense.

Usability Evaluation of an Offline Electronic Data Capture App in a Prospective Multicentre Dementia Registry – digiDEM Bayern: a Mixed Method Study (Preprint)

2021 ◽  
Author(s):  
Michael Reichold ◽  
Miriam Hess ◽  
Peter L. Kolominsky-Rabas ◽  
Elmar Gräßel ◽  
Hans-Ulrich Prokosch
Keyword(s):  
Data Collection ◽  
Technology Acceptance ◽  
Mobile Devices ◽  
Mixed Method ◽  
User Group ◽  
Electronic Data ◽  
Thinking Aloud ◽  
Electronic Data Collection ◽  
Usability Problems ◽  
Dementia Registry

BACKGROUND Digital registries have shown to provide an efficient way better to understand the clinical complexity and long-term progression of diseases. The paperless way of electronic data collection during a patient interview saves both: time and resources. In the prospective multicenter 'Digital Dementia Registry Bavaria - digiDEM Bayern', interviews are also conducted on-site in rural areas with unreliable internet connectivity. It must be ensured that electronic data collection can still be performed there, and it is no need to fall back on paper-based questionnaires. Therefore, the EDC system REDCap offers, in addition to a web-based data collection solution, the option to collect data offline via an app and synchronize it afterward. OBJECTIVE This study evaluates the usability of the REDCap app as an offline electronic data collection option for a lay user group and examines the necessary technology acceptance using mobile devices for data collection. Thereby, the feasibility of the app-based offline data collection in the dementia registry project was evaluated before going live. METHODS The study was conducted with an exploratory mixed-method in the form of an on-site usability test with the 'Thinking Aloud' method combined with a tailored semi-standardized online questionnaire including System Usability Score (SUS). The acceptance of mobile devices for the data collection was surveyed based on the technology acceptance model (TAM) with five categories. RESULTS Using the Thinking Aloud method, usability problems were identified and solutions were derived therefore. The evaluation of the REDCap app resulted in a SUS score of 74, which represents 'good' usability. After evaluating the technology acceptance questionnaire, it can be stated that the lay user group is open to mobile devices as interview tools. CONCLUSIONS The usability evaluation results show that a lay user group like the data collecting partners in the digiDEM project can handle the REDCap app well overall. The usability test provided statements about positive aspects and was able to identify usability problems of the REDCap app. In addition, the current technology acceptance in the sample showed that heterogeneous groups of different ages with different experiences in handling mobile devices are also ready for the use of app-based EDC systems. Based on the results, it can be assumed that the offline use of an app-based EDC system on mobile devices is a viable solution to collect data in a registry-based research project.

Sign in / Sign up

Export Citation Format

Share Document