scholarly journals Systematic Use of Visual Analysis for Assessing Outcomes in Single Case Design Studies

2017 ◽  
Vol 19 (1) ◽  
pp. 4-17 ◽  
Author(s):  
Jennifer R. Ledford ◽  
Justin D. Lane ◽  
Katherine E. Severini

Single case designs (SCDs) allow researchers to objectively evaluate the impact of an intervention by repeatedly measuring a dependent variable across baseline and intervention conditions. Rooted in baseline logic, SCDs evaluate change over time, with each participant serving as his or her own control during the course of a study. Formative and summative evaluation of data is critical to determining causal relations. Visual analysis involves evaluation of level, trend, variability, consistency, overlap, and immediacy of effects within (baseline and intervention) and between conditions (baseline to intervention). The purpose of this paper is to highlight the process for visually analysing data collected in the context of a SCD and to provide structures and procedures for evaluating the six data characteristics of interest. A checklist with dichotomous responses (i.e., yes/no) is presented to facilitate implementation and reporting of systematic visual analysis.

2018 ◽  
Vol 40 (3) ◽  
pp. 131-149 ◽  
Author(s):  
Elizabeth A. Stevens ◽  
Sunyoung Park ◽  
Sharon Vaughn

This systematic review examines the effects of summarizing and main idea interventions on the reading comprehension outcomes of struggling readers in Grades 3 through 12. A comprehensive search identified 30 studies published in peer-reviewed journals between 1978 and 2016. Studies included struggling reader participants in Grades 3 through 12; targeted summarizing or main idea instruction; used an experimental, quasi-experimental, or single-case design; and included a reading comprehension outcome. A meta-analysis of 23 group design studies resulted in a statistically significant mean effect of 0.97. Group size, number of sessions, grade level, and publication year did not moderate treatment effect. Visual analysis of six single-case designs yielded strong evidence for retell measures and a range of evidence for short-answer comprehension measures. Findings suggest that main idea and summarizing instruction may improve struggling readers’ main idea identification and reading comprehension. Limitations include the lack of standardized measures and the unreported, changing description of the counterfactual.


2009 ◽  
Vol 25 (2) ◽  
pp. 192-200 ◽  
Author(s):  
Renee R. Taylor ◽  
Gary Kielhofner ◽  
Caitlin Smith ◽  
Sherri Butler ◽  
Susan M. Cahill ◽  
...  

2020 ◽  
pp. 104420732093404 ◽  
Author(s):  
Collin Shepley ◽  
Kathleen N. Zimmerman ◽  
Kevin M. Ayres

The implementation of research-based practices by teachers in public school classrooms is required under federal law as expressed in the Individuals With Disabilities Education Improvement Act of 2004. To aid teachers in identifying such practices, researchers conduct systematic reviews of the educational literature. Although recent attention has been given to changes in the quality of these reviews, there has been minimal discussion about changes in the quality of the studies that comprise them. Specifically, to what extent have educational policies leading to the creation of experimental design standards resulted in a change in the rigor of educational research? Using a subset of the single-case literature commonly published in special education journals, we estimate the impact of What Works Clearinghouse single-case design standards on the trend in the rigor of single-case studies using a comparative interrupted time series framework. Within this subset of single-case studies, our estimation strategy did not detect a change in the trend of the rigor of single-case research following the establishment of What Works Clearinghouse single-case design standards. Implications are discussed for practitioners and researchers. Study data, syntax, and supplemental materials are available for public use at https://osf.io/xp7wv/.


Author(s):  
Mattias Erhardsson ◽  
Margit Alt Murphy ◽  
Katharina S. Sunnerhagen

Abstract Background Rehabilitation is crucial for maximizing recovery after stroke. Rehabilitation activities that are fun and rewarding by themselves can be more effective than those who are not. Gamification with virtual reality (VR) exploits this principle. This single-case design study probes the potential for using commercial off-the-shelf, room-scale head-mounted virtual reality for upper extremity rehabilitation in individuals with chronic stroke, the insights of which can inform further research. Methods A heterogeneous volunteer sample of seven participants living with stroke were recruited through advertisement. A single-case design was employed with a 5-week baseline (A), followed by a 10-week intervention (B) and a 6-month follow-up. Upper extremity motor function was assessed with validated kinematic analysis of drinking task. Activity capacity was assessed with Action Research Arm Test, Box and Block Test and ABILHAND questionnaire. Assessments were done weekly and at follow-up. Playing games on a VR-system with head-mounted display (HTC Vive) was used as rehabilitation intervention. Approximately 300 games were screened and 6 tested. Visual analysis and Tau-U statistics were used to interpret the results. Results Visual analysis of trend, level shift and overlap as well as Tau-U statistics indicated improvement of Action Research Arm Test in six participants. Four of these had at least a moderate Tau-U score (0.50–0.92), in at least half of the assessed outcomes. These four participants trained a total of 361 to 935 min. Two out of four participants who were able to perform the drinking task, had the highest training dose (> 900 min) and showed also improvements in kinematics. The predominant game played was Beat Saber. No serious adverse effects related to the study were observed, one participant interrupted the intervention phase due to a fall at home. Conclusions This first study of combining commercial games, a commercial head-mounted VR, and commercial haptic hand controls, showed promising results for upper extremity rehabilitation in individuals with chronic stroke. By being affordable yet having high production values, as well as being an easily accessible off-the-shelf product, this variant of VR technology might facilitate widespread adaption. Insights garnered in this study can facilitate the execution of future studies. Trial registration The study was registered at researchweb.org (project number 262331, registered 2019-01-30, https://www.researchweb.org/is/vgr/project/262331) prior to participant enrolment.


Author(s):  
Anna Chaddock ◽  
Richard Thwaites ◽  
James Bennett-Levy ◽  
Mark H. Freeston

AbstractSelf-Practice/Self-Reflection (SP/SR) has been developed as a self-experiential training strategy to enhance CBT therapists’ skills. SP/SR gives therapists an experience of CBT through practising CBT techniques on themselves, and reflecting on the experience and its implications for clinical practice. Many practitioners report significant professional and personal gains from SP/SR; however, there is considerable individual variation. This study examined individual experiences of SP/SR in order to develop a better understanding of idiosyncratic variations in participants’ approaches to SP/SR, and to inform the design and implementation of future SP/SR programmes. A single-case design was employed to examine the experiences of four trainee cognitive-behaviour therapists who were undertaking SP/SR as part of their professional training in CBT. Quantitative data from self-ratings of skill, and qualitative data from participants’ reflections and attributions following completion of SP/SR were examined. Both the participants, and two additional reviewers were consulted in the interpretation of the results. The impact of SP/SR appeared specific to each participant, reflecting different ways that participants engaged with SP/SR materials. The study suggests that for optimal development, engagement of the personal self and therapist self may be required.


2019 ◽  
Vol 62 (6) ◽  
pp. 1959-1978
Author(s):  
Kaitlyn P. Wilson ◽  
Jessica R. Steinbrenner ◽  
Tamar Kalandadze ◽  
Lara Handler

PurposeThe aims of this systematic review are to (a) synthesize the literature on interventions targeting expressive communication in adults with autism spectrum disorder and (b) evaluate the effectiveness of the interventions.MethodThe literature search resulted in 7,196 articles. The research team used 2 reviewers and consensus for title/abstract review, full-text review, and quality review. To be included, studies had to (a) include at least 1 adult (18 years of age and above) with an autism spectrum disorder; (b) examine an intervention, treatment, or model of care; (c) provide outcome data related to expressive communication modalities/domains; (d) be experimental or quasi-experimental; and (e) be published in English. Twenty-two studies (14 single-case design and 8 group design), with a total of 256 participants and varied interventions and outcome variables, met criteria for inclusion. Effect sizes are presented for group design studies, and visual analysis results are outlined for single-case design studies.ResultsExamination of treatment effects in the included studies showed positive effects, overall; however, there was great variability between studies. Single-case design studies showed evidence of functional relations in all but 1 study, with most showing medium to large effects, as well as maintenance and generalization of gains. Group design studies showed a wide range of effects from near-zero to large effects. Differences in intervention strategies and durations, as well as in participant characteristics and outcome measures, presented barriers to aggregation.ConclusionsThis review highlights the need for increased high-quality research examining interventions targeting expressive communication in adults with autism spectrum disorder and also pinpoints interventions with potential for future study and use in this population.


Sign in / Sign up

Export Citation Format

Share Document