Decision-Making Accuracy of CBM Progress-Monitoring Data

2017 ◽  
Vol 36 (1) ◽  
pp. 74-81 ◽  
Author(s):  
John M. Hintze ◽  
Craig S. Wells ◽  
Amanda M. Marcotte ◽  
Benjamin G. Solomon

This study examined the diagnostic accuracy associated with decision making as is typically conducted with curriculum-based measurement (CBM) approaches to progress monitoring. Using previously published estimates of the standard errors of estimate associated with CBM, 20,000 progress-monitoring data sets were simulated to model student reading growth of two-word increase per week across 15 consecutive weeks. Results indicated that an unacceptably high proportion of cases were falsely identified as nonresponsive to intervention when a common 4-point decision rule was applied, under the context of typical levels of probe reliability. As reliability and stringency of the decision-making rule increased, such errors decreased. Findings are particularly relevant to those who use a multi-tiered response-to-intervention model for evaluating formative changes associated with instructional intervention and evaluating responsiveness to intervention across multiple tiers of intervention.

2017 ◽  
Vol 84 (1) ◽  
pp. 42-54 ◽  
Author(s):  
Joseph Jenkins ◽  
Margaret Schulze ◽  
Allison Marti ◽  
Allen G. Harbaugh

We examined the idea that leaner schedules of progress monitoring (PM) can lighten assessment demands without undermining decision-making accuracy. Using curriculum-based measurement of reading, we compared effects on decision accuracy of 5 intermittent PM schedules relative to that of every-week PM. For participating students with high-incidence disabilities—all receiving special education reading instruction ( N = 56)—intermittent schedules of PM performed as well as every-week PM. These findings signal a need for research on the relative accuracy and timeliness of curriculum-based measurement decision making for intermittent and weekly PM.


2008 ◽  
Author(s):  
John M. Hintze ◽  
Craig S. Wells ◽  
Amanda M. Marcotte

2019 ◽  
pp. 153450841987224
Author(s):  
Ethan R. Van Norman ◽  
Peter M. Nelson

The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices improve upon the accuracy of current frameworks across periods of 4 to 8 weeks was also explored. Spring proficiency status on a curriculum-based measurement of reading assessment was used as the reference for classification accuracy. Using a goal line based upon fall to winter grade-level benchmarks tended to produce higher levels of accuracy, kappa, and sensitivity than goal lines based upon fall to spring benchmarks. Collectively, the observed results highlight the potential benefit of establishing seasonal goal lines and suggest that relatively simplistic and accessible approaches to decision-making may result in similar decisions when compared with analytically complex approaches.


Sign in / Sign up

Export Citation Format

Share Document