ENGLISH TEACHERS’ PERCEPTIONS OF STUDENT EVALUATION OF TEACHING IN AN INDONESIAN UNIVERSITY

Student evaluation of teaching (SET) has been proven to improve teachers’ teaching practices and students’ learning experiences despite being used commonly for accountability purposes. Indonesian teachers’ perceptions of SET, however, remain largely unexplored. This qualitative study therefore investigated how four Indonesian university teachers perceived SET, how SET impacted their teaching practices and what roles they believed the university should play in implementing SET properly. The participants taught English to undergraduate students in an Indonesian private university. Data were collected using semi-structured interviews and analysed using qualitative methods. The teachers perceived SET positively, had made conscious changes to improve their teaching practices and students’ learning, and believed the institution had facilitated teachers in meeting students’ needs, especially during the campus closure due to the COVID-19 pandemic, which led to a transition to online learning. The institution where the participants taught implemented SET only for formative or improvement purposes. Using SET for such purposes is important as it is more likely to cause teachers less pressure and anxiety. Hence, teachers are willing to act upon the student feedback. Meanwhile, using SET for accountability purposes may create extra work for teachers and make them feel manipulated and untrusted.

Case Examination of Teacher-Tailored Student Evaluation of Teaching Augmented with Peer Observation of Teaching in a Vietnamese University

<p>This study explored how teacher-tailored student evaluation of teaching (TT-SET) augmented with peer observation of teaching (POT) impacted on academics’ pedagogical reasoning in a Vietnamese university. The qualitative case study within the constructivist paradigm used multiple data collection methods. Detailed analysis developed findings through descriptions of individual academics’ experience of the intervention and analysis across participants (using thematic analysis). The intervention encouraged academics to reflect on their practice. This reflection promoted changes in their understandings of practice, actions to refine practice, future plans, and other outcomes (e.g., enhanced confidence, self-efficacy, sense of autonomy, and collegiality). However, there were several challenges which varied among the participants, including perceiving TT-SET as lacking reliability and validity, limited learning from junior peers, disagreement with feedback and lack of sensitivity, and limited time for POT and changes. The findings also suggested that among other factors, the nature of the peer relationship, which is under the impact of the Vietnamese Confucian collectivist culture, was important to successful implementation of the intervention. The theoretical framework developed for this study helps explain the changes in academics’ pedagogical reasoning, particularly reflection. The study contributes to the area of tertiary teacher development, both theoretically and practically. It offers insights into how such an approach may be effective, particularly in the context of Vietnamese higher education, and provides guidance for both practice and policies. It identifies what needs to be done to improve the implementation of the intervention. It also offers ideas for leaders to make institutional policies to support academics’ professional learning and development. Its findings contribute to understanding how the intervention works, and why it works in the Vietnamese context and also of academics’ reflection and reflective practice. The study includes recommendations for the use of TT-SET augmented with POT for promoting teacher reflection that may lead to changes in practice by addressing necessary conditions for the intervention to be effective. Further research is recommended into the nature of the peer relationship and the characteristics of the peer for POT (e.g., in terms of age, experience, gender, and discipline), the impact of contextual factors, the role of leaders in creating the culture of the learning community, the timing of the intervention, and the use of students’ learning outcomes to evaluate the effectiveness of changes.</p>

Case Examination of Teacher-Tailored Student Evaluation of Teaching Augmented with Peer Observation of Teaching in a Vietnamese University

<p>This study explored how teacher-tailored student evaluation of teaching (TT-SET) augmented with peer observation of teaching (POT) impacted on academics’ pedagogical reasoning in a Vietnamese university. The qualitative case study within the constructivist paradigm used multiple data collection methods. Detailed analysis developed findings through descriptions of individual academics’ experience of the intervention and analysis across participants (using thematic analysis). The intervention encouraged academics to reflect on their practice. This reflection promoted changes in their understandings of practice, actions to refine practice, future plans, and other outcomes (e.g., enhanced confidence, self-efficacy, sense of autonomy, and collegiality). However, there were several challenges which varied among the participants, including perceiving TT-SET as lacking reliability and validity, limited learning from junior peers, disagreement with feedback and lack of sensitivity, and limited time for POT and changes. The findings also suggested that among other factors, the nature of the peer relationship, which is under the impact of the Vietnamese Confucian collectivist culture, was important to successful implementation of the intervention. The theoretical framework developed for this study helps explain the changes in academics’ pedagogical reasoning, particularly reflection. The study contributes to the area of tertiary teacher development, both theoretically and practically. It offers insights into how such an approach may be effective, particularly in the context of Vietnamese higher education, and provides guidance for both practice and policies. It identifies what needs to be done to improve the implementation of the intervention. It also offers ideas for leaders to make institutional policies to support academics’ professional learning and development. Its findings contribute to understanding how the intervention works, and why it works in the Vietnamese context and also of academics’ reflection and reflective practice. The study includes recommendations for the use of TT-SET augmented with POT for promoting teacher reflection that may lead to changes in practice by addressing necessary conditions for the intervention to be effective. Further research is recommended into the nature of the peer relationship and the characteristics of the peer for POT (e.g., in terms of age, experience, gender, and discipline), the impact of contextual factors, the role of leaders in creating the culture of the learning community, the timing of the intervention, and the use of students’ learning outcomes to evaluate the effectiveness of changes.</p>

Validation of a Short Scale for Student Evaluation of Teaching Ratings in a Polytechnic Higher Education Institution

The general purpose of this work is 2-fold, to validate scales and to present the methodological procedure to reduce these scales to validate a rating scale for the student evaluation of teaching in the context of a Polytechnic Higher Education Institution. We explored the relationship between the long and short versions of the scale; examine their invariance in relation to relevant variables such as gender. Data were obtained from a sample of 6,110 students enrolled in a polytechnic higher education institution, most of whom were male. Data analysis included descriptive analysis, intraclass correlation, exploratory structural equation modeling (ESEM), confirmatory factorial analysis, correlations between the short and long form corrected for the shared error variance, gender measurement invariance, reliability using congeneric correlated factors, and correlations with academic achievement for the class as unit with an analysis following a multisection design. Results showed four highly correlated factors that do not exclude a general factor, with an excellent fit to data; configural, metric, and scalar gender measurement invariance; high reliability for both the long and short scale and subscales; high short and long-form scale correlations; and moderate but significant correlations between the long and short versions of the scales with academic performance, with individual and aggregate data collected from classes or sections. To conclude, this work shows the possibility of developing student evaluation of teaching scales with a short form scale, which maintains the same high reliability and validity indexes as the longer scale.

The Validity and Reliability of Student Evaluation of Teaching at the National University of Lesotho

Many Higher Education Institutions use the Student Evaluation of Teaching (SET) scale to evaluate the quality of instructors’ teaching. It includes students’ evaluation of the teacher, the teaching process, teaching approaches and the learning outcomes. Due to its reported dubious reliability and validity, and inherent bias in measuring the quality of teaching, SET remains a hotly debated and controversial instrument. This study evaluated thereliability and validity of the SET scale adopted by the National University of Lesotho. Self-administered SET questionnaires were distributed to 104 third- and fourth-year Bachelor of Commerce students to evaluate ten lecturers, resulting in 751 assessment records. The data were analysed using the Statistical Package for the Social Sciences (SPSS) and Partial Least Squares Structural Equation Modelling (PLS-SEM). While the findings suggest that the SET instrument used at the university is reasonably reliable and valid, minor concerns were raised with regard to discriminant validity, and serious concerns in relation to content validity. Based on the existing literature and the psychometric properties of this SET instrument, it is recommended that university management exercise caution in using its results to make evaluative personnel decisions such as promotions, confirmations, and dismissals. It is also recommended that the SET instrument should be revised and validated and be primarily used for formative purposes such as obtaining feedback for the development of individual instructors. Key words: formative assessment, reliability, student evaluation of teaching, summative assessment, validity