An Examination of the Replicability of Angoff Standard Setting Results Within a Generalizability Theory Framework

2014 ◽  
Vol 51 (2) ◽  
pp. 127-140 ◽  
Author(s):  
Jerome C. Clauser ◽  
Melissa J. Margolis ◽  
Brian E. Clauser
Keyword(s):  
Generalizability Theory ◽  
Standard Setting ◽  
Theory Framework

scholarly journals Estimasi kesalahan pengukuran standard setting dalam penilaian kompetensi matematika tingkat SMP di Kabupaten Sumbawa

2018 ◽  
Vol 22 (1) ◽  
pp. 24-34
Author(s):  
Weni Wendari ◽  
Samsul Hadi
Keyword(s):  
Measurement Error ◽  
Focus Group ◽  
Error Estimation ◽  
Focus Group Discussion ◽  
Generalizability Theory ◽  
Group Discussion ◽  
Standard Setting ◽  
Group Method ◽  
Theory Approach ◽  
Cut Score

Penelitian ini bertujuan untuk mengetahui metode yang lebih akurat dalam mengestimasi kesalahan pengukuran standard setting pada metode Ebel, Bookmark, dan Contrasting group. Data penelitian ini merupakan dokumen Dinas Pendidikan dan Kebudayaan Kabupaten Sumbawa berupa respon peserta Ujian Nasional Matematika Paket P0C5520 tahun ajaran 2015/2016 yang berjumlah 352 siswa. Guru juga dilibatkan dalam penelitian sebagai panelis dalam Focus Group Discussion  (FGD). Data yang terkumpul kemudian dianalisis melaui tiga tahap.. Tahap pertama yaitu persiapan, kegiatan pada tahap ini mencakup penyiapan data, penggolongan SMP, dan penentuan karakteristik butir. Tahap kedua yaitu FGD dilakukan dalam dua putaran. Tahap ketiga yaitu mengestimasi kesalahan pengukuran dengan menggunakan pendekatan Generalizability Theory dengan bantuan program eduG. Hasil penelitian menunjukkan bahwa metode Contrasting group memiliki estimasi kesalahan pengukuran paling kecil dibandingkan metode Ebel dan Bookmark, oleh karena itu, metode Contrasting grouplebih akurat dibandingkan dengan dua metode lainnya.Kata kunci: cut score, standard setting, generalizability theory MEASUREMENT ERROR ESTIMATION OF STANDARD SETTING IN MATHEMATICS COMPETENCY ASSESSMENT FOR JUNIOR HIGH SCHOOL IN SUMBAWA REGENCYAbstractThis research aims to find the most accurate methods in estimating measurement error of standard setting among Ebel, Bookmark, and Contrasting group methods. The data used in this study were 352 students’ responses on Mathematics National Exam Package P0C5520 in the academic year of 2015/2016. The document was collected from the Department of Education and Culture in Sumbawa Regency. Teachers were also involved in this research as panelists in the Focus Group Discussion (FGD). The data collected were then analyzed through three stages. The first stage was preparation stage, including the activities of data preparation, school classification, and item characteristics analysis. The second stage was two-round FGD. The third stage was estimating the measurement error using Generalizability Theory approach assisted by eduG program. The research result shows that Contrasting Group method produces the smallest measurement error estimation compared to Ebel and Bookmark methods, therefore, Contrasting group method is considered as the most accurate method.Keywords: cut score, standard setting, generalizability theory

An Examination of Rater Drift Within a Generalizability Theory Framework

2009 ◽  
Vol 46 (1) ◽  
pp. 43-58 ◽  
Author(s):  
Polina Harik ◽  
Brian E. Clauser ◽  
Irina Grabovsky ◽  
Ronald J. Nungester ◽  
Dave Swanson ◽  
...  
Keyword(s):  
Generalizability Theory ◽  
Theory Framework ◽  
Rater Drift

Evaluating the Consistency of Angoff-Based Cut Scores Using Subsets of Items Within a Generalizability Theory Framework

2015 ◽  
Vol 28 (3) ◽  
pp. 169-186 ◽  
Author(s):  
Priya Kannan ◽  
Adrienne Sgammato ◽  
Richard J. Tannenbaum ◽  
Irvin R. Katz
Keyword(s):  
Generalizability Theory ◽  
Cut Scores ◽  
Theory Framework
Sign in / Sign up

Export Citation Format

Share Document