Evaluation of Web Based Behavioral Interventions Using Spoken Tutorials

Background Between 1.6 and 3.8 million sports- and recreation-related concussions occur in the United States annually. Reports indicate that a significant number of athletes who have experienced symptoms of a potential sport-related concussion did not disclose their symptoms. Aims The purpose of this study was to investigate the impact of coach communication about concussion disclosure on student-athlete intentions to disclose symptoms of a concussion and encourage another student-athlete to disclose their concussion symptoms. Methods A total of 2881 student-athletes completed a web-based survey during Fall of 2016. Multiple linear regression was conducted to primarily investigate the relationship between coach communication and intentions to disclose concussion symptoms. Secondarily, biological sex, year in school, athletic division, and sport category was also assessed. Results Coach communication predicted greater intentions to disclose symptoms to their coach, athletic trainer/sports medicine sports medicine staff member and encourage another athlete to disclose their symptoms of a concussion. Biological sex and sport category also predicted intentions to disclose concussion symptoms. Discussion Findings from this study provide support for the important role coaches play in an athlete’s regarding concussion safety and introduces preliminary evidence suggesting the impact of coach communication on athlete intentions to disclose concussion symptoms to a coach or athletic trainer/sports medicine staff member. Conclusion Future studies and behavioral interventions ought to consider the inclusion of coach communication or other coach-related variables when exploring concussion disclosure among athletes.

Download Full-text

Evaluating use of web-based interventions: an example of a Dutch sexual health intervention

10.31234/osf.io/zhj86 ◽

2021 ◽

Author(s):

Gido Metz ◽

Hanneke Roosjen ◽

Wessel Zweers ◽

Rik Crutzen

Keyword(s):

Sexual Health ◽

Behavior Change ◽

Behavioral Interventions ◽

Real Life ◽

Health Intervention ◽

Web Analytics ◽

Current Increase ◽

Web Based ◽

Actual Use ◽

Intended Use

With the current increase in web-based interventions, the question of how to measure, and consequently improve engagement in such interventions is gaining more importance. Modern day web analytics tools make it easy to monitor use of web-based interventions. However, in this article, we propose that it would be more meaningful to first examine how the developers envisioned the use of the intervention to establish behavior change (i.e. intended use), before looking into how the intervention is ultimately used with web analytics (i.e. actual use). Such an approach responds to the regularly expressed concern that behavioral interventions are often poorly described, leading to less meaningful evaluations as it is not clear what exactly is being evaluated. Using data from a Dutch sexual health intervention (sense.info), we demonstrate the value of acyclic behavior change diagrams (ABCDs) as a method to visualize intended use of an intervention. ABCDs show at a glance how behavior change principles are applied in an intervention and target determinants of behavior. Based on this ABCD, we look into actual use of the intervention, using the web analytics tool Matomo. This real-life example demonstrates the potential of combining ABCDs and Matomo as methods to gain insight into use of web- based interventions.

Download Full-text

The Model of Gamification Principles for Digital Health Interventions: Evaluation of Validity and Potential Utility (Preprint)

10.2196/preprints.16506 ◽

2019 ◽

Author(s):

Mark Floryan ◽

Philip I Chow ◽

Stephen M Schueller ◽

Lee M Ritterband

Keyword(s):

Behavioral Interventions ◽

Rating Scale ◽

Digital Health ◽

Empirical Studies ◽

Mobile App ◽

Health Interventions ◽

Potential Utility ◽

Validity And Reliability ◽

Web Based ◽

App Store

BACKGROUND Although gamification continues to be a popular approach to increase engagement, motivation, and adherence to behavioral interventions, empirical studies have rarely focused on this topic. There is a need to empirically evaluate gamification models to increase the understanding of how to integrate gamification into interventions. OBJECTIVE The model of gamification principles for digital health interventions proposes a set of five independent yet interrelated gamification principles. This study aimed to examine the validity and reliability of this model to inform its use in Web- and mobile-based apps. METHODS A total of 17 digital health interventions were selected from a curated website of mobile- and Web-based apps (PsyberGuide), which makes independent and unbiased ratings on various metrics. A total of 133 independent raters trained in gamification evaluation techniques were instructed to evaluate the apps and rate the degree to which gamification principles are present. Multiple ratings (n≥20) were collected for each of the five gamification principles within each app. Existing measures, including the PsyberGuide credibility score, mobile app rating scale (MARS), and the app store rating of each app were collected, and their relationship with the gamification principle scores was investigated. RESULTS Apps varied widely in the degree of gamification implemented (ie, the mean gamification rating ranged from 0.17≤m≤4.65 out of 5). Inter-rater reliability of gamification scores for each app was acceptable (κ≥0.5). There was no significant correlation between any of the five gamification principles and the PsyberGuide credibility score (<i>P</i>≥.49 in all cases). Three gamification principles (supporting player archetypes, feedback, and visibility) were significantly correlated with the MARS score, whereas three principles (meaningful purpose, meaningful choice, and supporting player archetypes) were significantly correlated with the app store rating. One gamification principle was statistically significant with both the MARS and the app store rating (supporting player archetypes). CONCLUSIONS Overall, the results support the validity and potential utility of the model of gamification principles for digital health interventions. As expected, there was some overlap between several gamification principles and existing app measures (eg, MARS). However, the results indicate that the gamification principles are not redundant with existing measures and highlight the potential utility of a 5-factor gamification model structure in digital behavioral health interventions. These gamification principles may be used to improve user experience and enhance engagement with digital health programs.

Download Full-text

Web-Based Behavioral Interventions for the Management of Chronic Pain

Current Rheumatology Reports ◽

10.1007/s11926-011-0212-8 ◽

2011 ◽

Vol 13 (6) ◽

pp. 543-549 ◽

Cited By ~ 16

Author(s):

David A. Williams

Keyword(s):

Chronic Pain ◽

Behavioral Interventions ◽

Web Based

Download Full-text

A novel method for assessing design fidelity in web-based behavioral interventions.

Health Psychology ◽

10.1037/hea0001046 ◽

2021 ◽

Vol 40 (3) ◽

pp. 217-225

Author(s):

Jeffrey D. Lambert ◽

Lewis R. Elliott ◽

Adrian H. Taylor ◽

Paul Farrand ◽

Anne M. Haase ◽

...

Keyword(s):

Behavioral Interventions ◽

Web Based ◽

Novel Method

Download Full-text

The Model of Gamification Principles for Digital Health Interventions: Evaluation of Validity and Potential Utility

Journal of Medical Internet Research ◽

10.2196/16506 ◽

2020 ◽

Vol 22 (6) ◽

pp. e16506

Author(s):

Mark Floryan ◽

Philip I Chow ◽

Stephen M Schueller ◽

Lee M Ritterband

Keyword(s):

Behavioral Interventions ◽

Rating Scale ◽

Digital Health ◽

Empirical Studies ◽

Mobile App ◽

Health Interventions ◽

Potential Utility ◽

Validity And Reliability ◽

Web Based ◽

App Store

Background Although gamification continues to be a popular approach to increase engagement, motivation, and adherence to behavioral interventions, empirical studies have rarely focused on this topic. There is a need to empirically evaluate gamification models to increase the understanding of how to integrate gamification into interventions. Objective The model of gamification principles for digital health interventions proposes a set of five independent yet interrelated gamification principles. This study aimed to examine the validity and reliability of this model to inform its use in Web- and mobile-based apps. Methods A total of 17 digital health interventions were selected from a curated website of mobile- and Web-based apps (PsyberGuide), which makes independent and unbiased ratings on various metrics. A total of 133 independent raters trained in gamification evaluation techniques were instructed to evaluate the apps and rate the degree to which gamification principles are present. Multiple ratings (n≥20) were collected for each of the five gamification principles within each app. Existing measures, including the PsyberGuide credibility score, mobile app rating scale (MARS), and the app store rating of each app were collected, and their relationship with the gamification principle scores was investigated. Results Apps varied widely in the degree of gamification implemented (ie, the mean gamification rating ranged from 0.17≤m≤4.65 out of 5). Inter-rater reliability of gamification scores for each app was acceptable (κ≥0.5). There was no significant correlation between any of the five gamification principles and the PsyberGuide credibility score (P≥.49 in all cases). Three gamification principles (supporting player archetypes, feedback, and visibility) were significantly correlated with the MARS score, whereas three principles (meaningful purpose, meaningful choice, and supporting player archetypes) were significantly correlated with the app store rating. One gamification principle was statistically significant with both the MARS and the app store rating (supporting player archetypes). Conclusions Overall, the results support the validity and potential utility of the model of gamification principles for digital health interventions. As expected, there was some overlap between several gamification principles and existing app measures (eg, MARS). However, the results indicate that the gamification principles are not redundant with existing measures and highlight the potential utility of a 5-factor gamification model structure in digital behavioral health interventions. These gamification principles may be used to improve user experience and enhance engagement with digital health programs.

Download Full-text