scholarly journals Characteristics, Outcomes, and Statistical Solutions of Missing Cases in Web-Based Psychotherapy: A methodological replication and elaboration (Preprint)

2020 ◽  
Author(s):  
Eyal Karin ◽  
Monique Francis Crane ◽  
Blake Farran Dear ◽  
Olav Nielssen ◽  
Gillian Ziona Heller ◽  
...  

BACKGROUND Missing cases present a challenge to our ability to evaluate the effects of web-based psychotherapy trials. As missing cases are often lost to follow up, less is known about their characteristics, their likely clinical outcomes, or the likely effect of the treatment being trialled. OBJECTIVE To explore the characteristics of missing cases, their likely treatment outcomes, and the ability of different statistical models to approximate missing post-treatment data. METHODS A sample of internet-delivered cognitive behavioural therapy participants, in routine care (n = 6701 with 36% missing cases at post-treatment), was used to identify predictors of dropping out of treatment and predictors that moderated clinical outcomes, such as psychological distress, anxiety and depressive symptoms. These variables were then incorporated into a range of statistical models that approximated replacement outcomes for missing cases, with the results compared using sensitivity and cross-validation analyses. RESULTS Treatment adherence, as measured by the rate of an individual’s progress through the treatment modules, and higher symptom scores at pre-treatment, were identified as the dominant predictors of missing cases probability (Nagelkerke R2 = 60.8%), as well as the rate of symptom change. Low treatment adherence, in particular, was associated with increased odds for presenting as missing cases during post-treatment assessment (eg, OR = 161.1:1) and at the same time, attenuate the rate of symptom change across anxiety (up to 28% of the total symptom 48% reduction effect), depression (up to 41% of the total 48% symptom reduction effect) and psychological distress symptom outcomes (up to 52% of the total 37% symptom reduction effect) at the end of an eight week window. Reflecting this pattern of results, statistical replacement methods that overlooked the features of treatment adherence, and baseline severity, underestimated missing case symptom outcomes by as much as 40% at post-treatment. CONCLUSIONS The treatment outcomes of the cases that were missing at follow up were distinct from the remaining observed sample. Thus, overlooking the features of missing cases is likely to result in an inaccurate estimate of the effect of treatment. CLINICALTRIAL

2018 ◽  
Vol 5 (2) ◽  
pp. e22 ◽  
Author(s):  
Eyal Karin ◽  
Blake F Dear ◽  
Gillian Z Heller ◽  
Monique F Crane ◽  
Nickolai Titov

Background Missing cases following treatment are common in Web-based psychotherapy trials. Without the ability to directly measure and evaluate the outcomes for missing cases, the ability to measure and evaluate the effects of treatment is challenging. Although common, little is known about the characteristics of Web-based psychotherapy participants who present as missing cases, their likely clinical outcomes, or the suitability of different statistical assumptions that can characterize missing cases. Objective Using a large sample of individuals who underwent Web-based psychotherapy for depressive symptoms (n=820), the aim of this study was to explore the characteristics of cases who present as missing cases at posttreatment (n=138), their likely treatment outcomes, and compare between statistical methods for replacing their missing data. Methods First, common participant and treatment features were tested through binary logistic regression models, evaluating the ability to predict missing cases. Second, the same variables were screened for their ability to increase or impede the rate symptom change that was observed following treatment. Third, using recontacted cases at 3-month follow-up to proximally represent missing cases outcomes following treatment, various simulated replacement scores were compared and evaluated against observed clinical follow-up scores. Results Missing cases were dominantly predicted by lower treatment adherence and increased symptoms at pretreatment. Statistical methods that ignored these characteristics can overlook an important clinical phenomenon and consequently produce inaccurate replacement outcomes, with symptoms estimates that can swing from −32% to 70% from the observed outcomes of recontacted cases. In contrast, longitudinal statistical methods that adjusted their estimates for missing cases outcomes by treatment adherence rates and baseline symptoms scores resulted in minimal measurement bias (<8%). Conclusions Certain variables can characterize and predict missing cases likelihood and jointly predict lesser clinical improvement. Under such circumstances, individuals with potentially worst off treatment outcomes can become concealed, and failure to adjust for this can lead to substantial clinical measurement bias. Together, this preliminary research suggests that missing cases in Web-based psychotherapeutic interventions may not occur as random events and can be systematically predicted. Critically, at the same time, missing cases may experience outcomes that are distinct and important for a complete understanding of the treatment effect.


2017 ◽  
Author(s):  
Eyal Karin ◽  
Blake F Dear ◽  
Gillian Z Heller ◽  
Monique F Crane ◽  
Nickolai Titov

BACKGROUND Missing cases following treatment are common in Web-based psychotherapy trials. Without the ability to directly measure and evaluate the outcomes for missing cases, the ability to measure and evaluate the effects of treatment is challenging. Although common, little is known about the characteristics of Web-based psychotherapy participants who present as missing cases, their likely clinical outcomes, or the suitability of different statistical assumptions that can characterize missing cases. OBJECTIVE Using a large sample of individuals who underwent Web-based psychotherapy for depressive symptoms (n=820), the aim of this study was to explore the characteristics of cases who present as missing cases at posttreatment (n=138), their likely treatment outcomes, and compare between statistical methods for replacing their missing data. METHODS First, common participant and treatment features were tested through binary logistic regression models, evaluating the ability to predict missing cases. Second, the same variables were screened for their ability to increase or impede the rate symptom change that was observed following treatment. Third, using recontacted cases at 3-month follow-up to proximally represent missing cases outcomes following treatment, various simulated replacement scores were compared and evaluated against observed clinical follow-up scores. RESULTS Missing cases were dominantly predicted by lower treatment adherence and increased symptoms at pretreatment. Statistical methods that ignored these characteristics can overlook an important clinical phenomenon and consequently produce inaccurate replacement outcomes, with symptoms estimates that can swing from −32% to 70% from the observed outcomes of recontacted cases. In contrast, longitudinal statistical methods that adjusted their estimates for missing cases outcomes by treatment adherence rates and baseline symptoms scores resulted in minimal measurement bias (<8%). CONCLUSIONS Certain variables can characterize and predict missing cases likelihood and jointly predict lesser clinical improvement. Under such circumstances, individuals with potentially worst off treatment outcomes can become concealed, and failure to adjust for this can lead to substantial clinical measurement bias. Together, this preliminary research suggests that missing cases in Web-based psychotherapeutic interventions may not occur as random events and can be systematically predicted. Critically, at the same time, missing cases may experience outcomes that are distinct and important for a complete understanding of the treatment effect.


2019 ◽  
Author(s):  
Simon Goldberg ◽  
Raymond P. Tucker ◽  
Preston A. Greene ◽  
Tracy L. Simpson ◽  
William T. Hoyt ◽  
...  

Because they provide data on responsiveness to experimental manipulation, clinical trials involving mindfulness-based inter- ventions are a source of evidence for the construct validity of self-report measures of mindfulness. Within-group and between- group changes in mindfulness were examined from randomized clinical trials comparing mindfulness interventions to other bona fide treatment comparison conditions or waitlist control conditions. We also examined changes in clinical outcomes and the magnitude of these changes relative to changes in mindfulness. We included 69 published studies representing 55 unique samples (n = 4743). Self-report mindfulness measures showed relatively larger gains in mindfulness intervention conditions vis-à-vis waitlist comparison conditions at both post-treatment (effect size [ES] = 0.52, 95% CI [0.40, 0.64]) and follow-up (ES = 0.52 [0.20, 0.84]), although the effect at follow-up diminished to non-significance in a trim-and-fill analysis intended to account for publication bias (ES = 0.35 [− 0.03, 0.72]). Measures of mindfulness also showed relatively larger gains in mindfulness inter- vention conditions vis-à-vis bona fide comparison conditions, but only at post-treatment (ES = 0.25 [0.11, 0.38], 0.10 [− 0.08, 0.28], at post-treatment and follow-up, respectively). All three conditions (mindfulness, bona fide, waitlist) showed relatively larger improvements on measures of clinical outcomes than measures of mindfulness, with the exception of waitlist conditions for which this effect was no longer significant at follow-up. Taken together, findings provide partial support for the unique respon- siveness of mindfulness self-report measures to interventions that include promotion of mindfulness meditation practice.


2020 ◽  
Vol 114 (9) ◽  
pp. 666-673
Author(s):  
Ahmad Fuady ◽  
Tanja A J Houweling ◽  
Muchtaruddin Mansyur ◽  
Erlina Burhan ◽  
Jan Hendrik Richardus

Abstract Background While the incidence of catastrophic costs due to tuberculosis (TB) remains high, there is little evidence about their impact on TB treatment outcomes and adherence. We assessed their effect on treatment outcomes and adherence in Indonesia. Methods We interviewed 282 adult TB patients who underwent TB treatment in urban, suburban and rural districts of Indonesia. One year after the interview, we followed up treatment adherence and outcomes. We applied multivariable analysis using generalized linear mixed models. Results Follow-up was complete for 252/282 patients. Eighteen (7%) patients had unsuccessful treatment and 40 (16%) had poor adherence. At a threshold of 30% of annual household income, catastrophic costs negatively impacted treatment outcomes (adjusted odds ratio [aOR] 4.15 [95% confidence interval {CI} 1.15 to 15.01]). At other thresholds, the associations showed a similar pattern but were not statistically significant. The association between catastrophic costs and treatment adherence is complex because of reverse causation. After adjustment, catastrophic costs negatively affected treatment adherence at the 10% and 15% thresholds (aOR 2.11 [95% CI 0.97 to 4.59], p = 0.059 and aOR 2.06 [95% CI 0.95 to 4.46], p = 0.07). There was no evidence of such an effect at other thresholds. Conclusions Catastrophic costs negatively affect TB treatment outcomes and treatment adherence. To eliminate TB, it is essential to mitigate catastrophic costs.


2017 ◽  
Vol 05 (02) ◽  
pp. E130-E136 ◽  
Author(s):  
Dennis Yang ◽  
Sunil Amin ◽  
Susana Gonzalez ◽  
Daniel Mullady ◽  
Steven Edmundowicz ◽  
...  

Abstract Background and study aims Data on clinical outcomes of endoscopic drainage of debris-free pseudocysts (PDF) versus pseudocysts containing solid debris (PSD) are very limited. The aims of this study were to compare treatment outcomes between patients with PDF vs. PSD undergoing endoscopic ultrasound (EUS)-guided drainage via transmural stents. Patients and methods Retrospective review of 142 consecutive patients with pseudocysts who underwent EUS-guided transmural drainage (TM) from 2008 to 2014 at 15 academic centers in the United States. Main outcome measures included TM technical success, treatment outcomes (symptomatic and radiologic resolution), need for endoscopic re-intervention at follow-up, and adverse events (AEs). Results TM was performed in 90 patients with PDF and 52 with PSD. Technical success: PDF 87 (96.7 %) vs. PSD 51 (98.1 %). There was no difference in the rates for endoscopic re-intervention (5.5 % in PDF vs. 11.5 % in PSD; P = 0.33) or AEs (12.2 % in PDF vs. 19.2 % in PSD; P = 0.33). Median long-term follow-up after stent removal was 297 days (interquartile range [IQR]: 59 – 424 days) for PDF and 326 days (IQR: 180 – 448 days) for PSD (P = 0.88). There was a higher rate of short-term radiologic resolution of PDF (45; 66.2 %) vs. PSD (21; 51.2 %) (OR = 0.30; 95 % CI: 0.13 – 0.72; P = 0.009). There was no difference in long-term symptomatic resolution (PDF: 70.4 % vs. PSD: 66.7 %; P = 0.72) or radiologic resolution (PDF: 68.9 % vs. PSD: 78.6 %; P = 0.72) Conclusions There was no difference in need for endoscopic re-intervention, AEs or long-term treatment outcomes in patients with PDF vs. PSD undergoing EUS-guided drainage with transmural stents. Based on these results, the presence of solid debris in pancreatic fluid collections does not appear to be associated with a poorer outcome.


2021 ◽  
pp. 1-9
Author(s):  
Rebecca G. Boswell ◽  
Ralitza Gueorguieva ◽  
Carlos M. Grilo

Abstract Background Impulsivity may be a process underlying binge-eating disorder (BED) psychopathology and its treatment. This study examined change in impulsivity during cognitive-behavioral therapy (CBT) and/or pharmacological treatment for BED and associations with treatment outcomes. Methods In total, 108 patients with BED (NFEMALE = 84) in a randomized placebo-controlled clinical trial evaluating the efficacy of CBT and/or fluoxetine were assessed before treatment, monthly throughout treatment, at post-treatment (16 weeks), and at 12-month follow-up after completing treatment. Patients completed established measures of impulsivity, eating-disorder psychopathology, and depression, and were measured for height and weight [to calculate body mass index (BMI)] during repeated assessments by trained/monitored doctoral research-clinicians. Mixed-effects models using all available data examined changes in impulsivity and the association of rapid and overall changes in impulsivity on treatment outcomes. Exploratory analyses examined whether baseline impulsivity predicted/moderated outcomes. Results Impulsivity declined significantly throughout treatment and follow-up across treatment groups. Rapid change in impulsivity and overall change in impulsivity during treatment were significantly associated with reductions in eating-disorder psychopathology, depression scores, and BMI during treatment and at post-treatment. Overall change in impulsivity during treatment was associated with subsequent reductions in depression scores at 12-month follow-up. Baseline impulsivity did not moderate/predict eating-disorder outcomes or BMI but did predict change in depression scores. Conclusions Rapid and overall reductions in impulsivity during treatment were associated with improvements in specific eating-disorder psychopathology and associated general outcomes. These effects were found for both CBT and pharmacological treatment for BED. Change in impulsivity may be an important process prospectively related to treatment outcome.


2021 ◽  
Author(s):  
Belinda Louise Parker ◽  
Melissa Anderson ◽  
Philip J Batterham ◽  
Aimee Gayed ◽  
Mirjana Subotic-Kerry ◽  
...  

BACKGROUND Secondary schools are increasingly supporting adolescent students’ mental health and wellbeing, yet many teachers report that they lack the skills and confidence to do so. The Building Educators’ Skills in Adolescent Mental Health (BEAM) is a web-based training program developed to improve secondary school teachers’ knowledge and confidence in caring for students’ mental health. OBJECTIVE This pilot study aimed to evaluate the acceptability and preliminary effectiveness of this new training program for improving mental health knowledge, attitudes, confidence, helping behaviors and psychological distress among secondary school teachers. METHODS A single arm, pre-post pilot trial was conducted from July to December 2019 among secondary school teachers located in New South Wales, Australia, who were in leadership positions responsible for managing student wellbeing (i.e., Year Advisors). Participants had access to the BEAM program for six weeks. Self-report surveys, delivered at baseline, post-intervention (6-weeks post-baseline) and follow-up (19 weeks post-baseline) were used to measure changes in mental health outcomes. Acceptability was assessed by program use, barriers, satisfaction, and participants’ perceptions of program effectiveness. RESULTS A total of 70 secondary school teachers took part (Mage=36.5 years, SD=9.41, range=24-60). Significant improvements in confidence were reported at post-test and follow-up, as well as psychological distress at post-test, and helping behaviors at follow-up. Participants agreed that the program was easy to understand and relevant; but completion was challenged by lack of time, competing priorities, and forgetfulness. CONCLUSIONS Findings indicate that the BEAM program may be an effective way to enhance secondary school teachers’ abilities to care for students’ mental health; however, modifications are required to improve adherence and attrition. CLINICALTRIAL Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12619000821190; Universal Trial Number (UTN): U1111-1232-7680.


2013 ◽  
Vol 19 (2) ◽  
pp. 207-216 ◽  
Author(s):  
Won-Sang Cho ◽  
Ki-Jeong Kim ◽  
O-Ki Kwon ◽  
Chi Heon Kim ◽  
Jiha Kim ◽  
...  

Object Spinal vascular diseases, such as spinal dural arteriovenous fistulas (DAVFs), perimedullary arteriovenous fistulas (AVFs), and spinal arteriovenous malformations (AVMs), are very rare. The authors analyzed the features and treatment outcomes of these conditions. Methods Data from 64 patients were retrospectively reviewed. There were 33 spinal DAVFs (1 patient had 2 lesions), 20 perimedullary AVFs, and 12 spinal AVMs. Clinical features, radiological findings, treatment results, and clinical outcomes were evaluated according to the diseases, subtypes, and treatment modalities. The median duration of follow-up was 20, 42, and 56 months for spinal DAVFs, perimedullary AVFs, and spinal AVMs, respectively. Results Spinal DAVFs showed faster progression of symptoms (median 5, 12, and 36 months for spinal DAVFs, perimedullary AVFs, and spinal AVMs, respectively) and worse neurological status at diagnosis (poor neurological status in 56%, 65%, and 33%, respectively). On MRI, signal voids were demonstrated in all except 1 spinal DAVF. At the last follow-up, 94% of spinal DAVFs, 68% of perimedullary AVFs, and 50% of spinal AVMs were completely obliterated. Favorable clinical outcomes were achieved in 91%, 95%, and 58%, respectively. In detail, the majority (78%) of spinal DAVFs were embolized, resulting in complete obliteration in 92% and favorable clinical outcomes in 92%. Most Type IVa and IVb perimedullary AVFs were surgically treated (71% and 88%), with complete obliterations of 86% and 71%, and favorable clinical outcomes in 100% and 86%, respectively. All Type IVc lesions were embolized with a low cure rate of 40%; however, clinical outcomes were satisfactory. Spinal AVMs were generally embolized (67%), and only glomus-type lesions attained a satisfactory cure rate (80%) and clinical outcome (100%). Conclusions Embolization produced satisfactory outcomes in spinal DAVFs and glomus-type spinal AVMs. Surgery is advantageous in Type IVa and IVb perimedullary AVFs. Palliative embolization can be effective in Type IVc perimedullary AVFs and juvenile spinal AVMs.


Sign in / Sign up

Export Citation Format

Share Document