Introducing randomization tests via an evaluation of peer-led team learning in undergraduate chemistry courses

The methodological limitations education researchers face in the evaluation of reformed instruction have led to debates as to the evidence advancing evidence-based practices. To conduct more effective research, methodological pluralism in the evaluation of educational reforms can be used to complement the strengths and limitations of a corpus of literature informing the impact of an evidence-based practice. This study seeks to introduce randomization tests, a nonparametric statistical analysis incorporating a random-assignment component that can be applied to a single-subject (N = 1) research design, as a methodology to be counted amongst evaluations of instructional reforms. To demonstrate the utility of this approach, an evaluation of peer-led team learning (PLTL) for classes of second-semester general chemistry spanning 7 semesters was conducted using randomization tests. The design contributes novel understandings of PLTL including differences in effectiveness across instructors, trends in effectiveness over time, and a perspective as to the appropriateness of assumptions concerning statistical independence when applied to educational settings. At the research setting, four instructors (each constituting an individual case) alternated implementing lecture-based instruction and PLTL by term. Across these four instructors, the treatment effects of peer-led team learning when compared to lecture-based instruction ranged in impact (from d = 0.233 to 2.09). For two instructors, PLTL provided a means by which to significantly reduce the differential performances observed of students with variable preparations in mathematics, thereby advancing the equitability of their courses. Implications of this work include the incorporation of single-subject research designs in establishing evidence-based instructional practices, the effectiveness of PLTL as interpreted in a methodologically pluralistic context of the research literature, and enacting measurements of equity when gauging the success of instructional reforms in science. Further, this introduction to randomization tests offers another methodology for the evaluation of instructional reforms more widely applicable in educational settings with smaller sample sizes (e.g., reforms conducted within a single classroom or upper-level courses with small class sizes).

Teachers as reform leaders in Chinese schools

Purpose The purpose of this paper is to analyze the influence of teacher leadership on the enactment of educational reforms in southeastern China. It considers how the work of middle and teacher leaders in schools is structured to support reform enactment at the school level. Design/methodology/approach The research was conducted in three case study sites in one school district in Shenzhen, China. Low, moderate and high academic achieving schools which had engaged teacher leaders in instructional reforms were selected. A combined total of 34 senior, middle and teacher leaders participated in semi-structured interviews, which were analyzed through a comparative coding process. Findings Across the three schools, teacher leaders without positional authority strongly influenced the instructional reforms. Their influence was strongest when bolstered by a combination of formal recognition systems, opportunities to lead projects that were directly related to the reform efforts, and mentorship systems that skilled novice teachers in reform-related skills and experienced teachers in leading reform enactment. Mechanisms and structures embedded in schools, when coherently focused on selected reforms, supported the efficacy of teachers without formal authority. And, middle leaders’ impact was enhanced when working collaboratively with formal and teacher leaders. Originality/value This research yields insight on teacher leaders’ influence of reform. It considers how the work of middle and teacher leaders can be structured as a collective that impacts on reform enactment at the school level. And, it illuminates teacher leadership in a Chinese context other than the scrutinized Shanghai school system.

Fostering the Mathematical Power of Children with Behavioral Difficulties: The Case of Carter

The National Council of Teachers of Mathematics has called for instructional reforms that promote the mathematical power of all students (1989, 1991, 2000). Mathematical power involves (a) a positive disposition toward learning and using mathematics, including the confidence to tackle new and challenging problems; (b) understanding, including the ability to explain and justify the rationale for a procedure; and (c) inquiry skills, such as the ability to solve problems (Baroody with Coslick 1998). The term all students includes those “who have not been successful in school” (NCTM 1991, p. 4), including children with behavioral disorders (Thornton and Bley 1994). Are we being realistic to expect that the new Standards-based approach to mathematics instruction (NCTM 1989, 1991, 2000) will be successful with children who are in emotional turmoil, are angry, or are prone to acting out? Are such children capable of acquiring any real degree of mathematical power?