High Stakes Tests through the Eyes of Science Teachers: Positive and Negative Impacts

In the past decades, there has been a growing interest in the effects of language tests, especially high-stakes tests, on teaching and learning referred to as ‘washback'. In fact, high-stakes tests have started to be exploited to reform instruction and achieve beneficial washback. This paper focuses on the washback effects of a high-stakes English Test (ET) on the teaching of English. The main goal of this study is to examine the washback effects of the ET on the following aspects of teaching: curriculum, materials, teaching methods, and teaching feelings and attitudes. The study also attempts to discover teachers' perceptions towards the introduction of a speaking and a listening component in the design of the new ET due to be implemented in 2012. The overall findings, collected from a questionnaire carried out among 51 secondary teachers, indicate that the ET is clearly affecting curriculum and materials. Results also reveal that the ET appears to influence teachers' methodology. Furthermore, most of the teachers believe that the introduction of a speaking and a listening component in the new ET design will help solve the mismatch between the communicative approach they seem to value and the skills so far evaluated in the ET.

Download Full-text

Math and science outcomes for students of teachers from standard and alternative pathways in Texas

Education Policy Analysis Archives ◽

10.14507/epaa.28.4863 ◽

2020 ◽

Vol 28 ◽

pp. 27

Author(s):

Michael Marder ◽

Bernard David ◽

Caitlin Hamrock

Keyword(s):

Student Performance ◽

Science Teachers ◽

Algebra I ◽

High Stakes ◽

Alternative Pathways ◽

Biology Students ◽

University Preparation ◽

Alternative Routes ◽

Almost All ◽

High Stakes Exams

Texas provides a unique opportunity to examine teachers without standard university preparation, for it prepares more teachers through alternative pathways than any other state. We find two advantages for mathematics and science teachers prepared in the standard way. First, since 2008 they have been staying in the classroom longer than those who pursued alternative routes. Second, we analyze student performance on Algebra 1 and Biology exams over the period 2012-2018. Algebra I students with experienced teachers from standard programs gain .03 to .05 in standard deviation units compared to students whose teachers were alternatively prepared. For Biology students there are fewer statistically significant differences, although when differences exist they almost all favor standard programs. These effects are difficult to measure in part because teachers are not assigned to teach courses with high-stakes exams at random. Nevertheless, we find strong evidence in Algebra I that students learn more when their teachers have standard preparation. In Biology there is also evidence but less compelling. Thus, we recommend that all states bolster traditional university-based teacher certification, that Texas not take drastic action to curtail alternative certification, and that other states not allow it to grow too quickly.

Download Full-text

Identifying Levers Related to Student Performance on High-Stakes Science Exams: Examining School, Teaching, Teacher, and Professional Development Characteristics

10.31219/osf.io/83hm2 ◽

2020 ◽

Author(s):

Christian Fischer ◽

Brandon Foster ◽

Ayana McCoy ◽

Frances Lawrenz ◽

Christopher Dede ◽

...

Keyword(s):

Professional Development ◽

Student Achievement ◽

Student Performance ◽

Science Teachers ◽

Curriculum Reform ◽

The United States ◽

School Level ◽

High Stakes ◽

Reform Implementation ◽

School Teaching

Background: Many students enter into postsecondary education without the college readiness skills that allow them to face the demands of postsecondary education. Increasingly, policymakers and educational researchers are responding to calls for reforming secondary education to provide more opportunity for all students to receive high quality education and to become career and college ready. Purpose: This study attempts to identify levers to increase student performance in secondary education. In particular, it examines relationships of school, teaching, teacher, and teacher professional development characteristics with student scores on high-stakes Advanced Placement (AP) examinations in the sciences.Setting: This study is situated in the context of the large-scale, top-down, nationwide AP curriculum and examination reform in the sciences (Biology, Chemistry, Physics) in the United States. This is an unprecedented opportunity to analyze changing educational landscapes in the United States with large-scale national student-, teacher-, school-, and district-level data sets across multiple science disciplines and different stages of the curriculum reform implementation connected to a standardized and high-stakes student outcome measure.Population: This study analyzes nationwide data samples of the AP Biology, AP Chemistry, and AP Physics population during the first, second, and third year of the curriculum reform implementation. Across disciplines and years, the analytical samples include a total of 113,603 students and 6,046 teachers. Research design: This empirical quantitative study uses data from web-based surveys sent to all AP science teachers. Additionally, College Board provided student- and school-level data for all students taking AP examinations. Data preparation methods included exploratory and confirmatory factor analysis. Associations towards student achievement were analyzed through multi-level ordered logistic regression analysis separately by science discipline and year of the curriculum reform implementation. Afterwards, the results were aggregated through a meta-analysis. Findings: Student performance is not pre-determined by students’ background, leaving roughly 60% of the AP score variance potentially malleable for teacher and school-level factors. In particular, teachers’ perceived administrative support, self-efficacy, teaching experience, and elements of classroom instruction were related to student performance. Notably, teachers’ professional development participation has a small, mixed impact on student achievement. Conclusion: The identified levers for improving student achievement provide a strong rationale for the continued efforts of policy makers to improve school environments and to support science teachers to ultimately both increase student learning and help all students graduate prepared for college and ready for their future careers.

Download Full-text