A Regression Discontinuity Design Framework for Controlling Selection Bias in Evaluations of Differential Item Functioning

Differential item functioning (DIF) is often used to examine validity evidence of alternate form test accommodations. Unfortunately, traditional approaches for evaluating DIF are prone to selection bias. This article proposes a novel DIF framework that capitalizes on regression discontinuity design analysis to control for selection bias. A simulation study was performed to compare the new framework with traditional logistic regression, with respect to Type I error and power rates of the uniform DIF test statistics and bias and root mean square error of the corresponding effect size estimators. The new framework better controlled the Type I error rate and demonstrated minimal bias but suffered from low power and lack of precision. Implications for practice are discussed.

Informing School Rehabilitation Professionals

The importance of appropriate use of test accommodations has drawn researchers to look closely for empirical evidence that supports the appropriateness and effectiveness of current accommodation practices over the last three decades. To inform teacher candidates enrolled in special education courses as well as school rehabilitation professionals who may or may not be new to the field, this chapter synthesizes research findings on the effectiveness of major accommodation categories and discusses how to make valid decisions for students with diverse special learning needs.

Accessibility Planning for Postsecondary Entrance and Placement Exams for Deaf Students

Postsecondary entrance and placement tests provide critical information that shapes the trajectory of the transition from secondary to postsecondary education. Test accommodations can play an important role in reducing barriers that deaf students face during high-stakes testing. For deaf students, decisions about access and accommodations for standardized assessment typically involve an Individualized Education Program (IEP) team. Deaf students’ access needs are not homogeneous, and decisions include a variety of factors including student characteristics, the content of the test, and test accommodations policies. In this article we share information about challenges that deaf students face and suggestions for ways to help to ensure that deaf students receive the accommodations that better allow them to show what they know and can do. These steps to improve accessibility can support equity in postsecondary pathways for deaf students.

Practical study on test accommodations for students with visual impairments based on scientific evidence.

Professor Yasushi Nakano, based in the Faculty of Economics, Keio University in Japan, is carrying out interconnected research studies geared towards improving the quality of life for people with visual impairments, which specifically includes university students in Japan. A particular goal for Nakano is creating a high-quality higher-education environment in which students with visual impairments can flourish. As part of this, he and his team are working to create an accessible textbook system and accessible test conditions for students with visual impairments.

Are Accommodations for English Learners on State Accountability Assessments Evidence-Based? A Multi-Study Systematic Review and Meta-Analysis

The objectives of this two-part study were to: (a) investigate English learner (EL) accommodation practices on state accountability assessments of reading/English language arts and mathematics in grades 3-8, and (b) conduct a meta-analysis of EL accommodation effectiveness on improving test performance. Across all distinct testing programs, we found that at least one EL test accommodation was provided for both test content areas. The most popular accommodations provided were supplying students with word-to-word dual language dictionaries, reading aloud test directions and items in English, and allowing flexible time/scheduling. However, we found minimal evidence that testing programs provide practitioners with recommendations on how to assign relevant accommodations to EL test takers’ English proficiency level. To evaluate whether accommodations used in practice are supported with evidence of their effectiveness, a meta-analysis was conducted. On average, across 26 studies and 95 effect sizes (N = 11,069), accommodations improved test performance by 0.16 standard deviations. Both test content and sampling design were found to moderate accommodation effectiveness; however, none of the accommodations investigated were found to have intervention effects that were statistically different from zero. Overall, these results suggest that currently employed EL test accommodations lack evidence of their effectiveness.

Informing School Rehabilitation Professionals

The importance of appropriate use of test accommodations has drawn researchers to look closely for empirical evidence that supports the appropriateness and effectiveness of current accommodation practices over the last three decades. To inform teacher candidates enrolled in special education courses as well as school rehabilitation professionals who may or may not be new to the field, this chapter synthesizes research findings on the effectiveness of major accommodation categories and discusses how to make valid decisions for students with diverse special learning needs.