Effect Size and Critical Thinking Assessment

2015 ◽  
Vol 30 (3) ◽  
pp. 32-37 ◽  
Author(s):  
Donald Hatcher ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 1
Author(s):  
Sherry Fukuzawa ◽  
Michael DeBraga

Graded Response Method (GRM) is an alternative to multiple-choice testing where students rank options accordingto their relevance to the question. GRM requires discrimination and inference between statements and is acost-effective critical thinking assessment in large courses where open-ended answers are not feasible. This studyexamined critical thinking assessment in GRM versus open-ended and multiple-choice questions composed fromBloom’s taxonomy in an introductory undergraduate course in anthropology and archaeology (N=53students).Critical thinking was operationalized as the ability to assess a question with evidence to support or evaluatearguments (Ennis, 1993). We predicted that students who performed well on multiple-choice from Bloom’staxonomy levels 4-6 and open-ended questions would perform well on GRM involving similar concepts. Highperforming students on GRM were predicted to have higher course grades. The null hypothesis was question typewould not have an effect on critical thinking assessment. In two quizzes, there was weak correlation between GRMand open-ended questions (R2=0.15), however there was strong correlation in the exam (R2=0.56). Correlations wereconsistently higher between GRM and multiple-choice from Bloom’s taxonomy levels 4-6 (R2=0.23,0.31,0.21)versus levels 1-3 (R2=0.13,0.29,0.18). GRM is a viable alternative to multiple-choice in critical thinking assessmentwithout added resources and grading efforts.


2021 ◽  
Vol 10 (1) ◽  
pp. 103-111
Author(s):  
Ulfaturrona Nur Labibah ◽  
Mundilarto Mundilarto ◽  
Syazana Bt Sulaiman

This research aimed to understand the critical thinking ability improvement and preparedness assisted by Android-based media to understand landslides through physics learning and understand the effectiveness of the media. This research provides knowledge about disaster preparedness through physics learning in landslide-prone schools using Android media. This research used quasi-experimental with Control Group Design. The research subjects included tenth-grade students in class X (30 people) at SMA N 1 Kokap. The samples were selected using the lottery method and saturated sampling technique to determine the control and experiment groups (quasi-experimental with Control Group Design). The pretest and posttest were in the form of essay questions. The analysis data used independent sample T-test and effect size. The results show that the average critical thinking ability of the experimental class increased from 18.13 to 65.00, and the average preparedness increased from 68.75 to 81.88. The results of the independent sample t-test show the value of Sig. (2-tailed) on critical thinking ability was 0.000 and preparedness was 0.027 (Sig. (2-tailed) 0.05). Thus, it can be concluded that there are significant differences in critical thinking ability and disaster preparedness in the experimental class and the control class. The effect size of using an Android-based understanding of landslide natural disasters on students' critical thinking ability and preparedness is 2.0 with high effectiveness. Media landslides and landslides through Android-based physics learning can improve students’ critical thinking ability and disaster preparedness.


Sign in / Sign up

Export Citation Format

Share Document