Evaluating the learning goal attainment in Nihongo Noryoku Shiken N5 course

The objective of the study is to evaluate the learning implementation of the Nihongo Noryoku Shiken N5 course as a new course offered in the 2020 curriculum at the Japanese Language Education Study Program in UNNES. A goal-oriented evaluation model by Tyler was employed in the evaluation process to measure how far the learning goals that have been determined at the beginning of the lecture are achieved. This evaluative research relied on a quantitative descriptive approach; its steps comprised (1) data collection, (2) data processing and analysis, and (3) recommendation formulation. According to the evaluation results, the learning goals of Nihongo Noryoku Shiken N5 had been met, although it was not that significant. Several conditions cause such issues. (1) In the class, some students had good Japanese language skills; they claimed that the lesson was too easy, so their progress was not significant. (2) The evaluation instruments were not valid. (3) Other conditions, e.g., the implementation of online learning and tests, hindered classroom activities and monitoring. Improving the teaching and learning materials and evaluation instruments is recommended. Furthermore, some additions to the curriculum need to be considered, such as adding the credits for the grammar or Bunpo course.

EVALUATION INSTRUMENTS OF COMPREHENSIVE GUIDANCE AND COUNSELING PROGRAM IN THE CULTURE OF HIGHER EDUCATION INSTITUTIONS IN INDONESIA

Program evaluation in comprehensive guidance and counseling is very important to determine the level of goal achievement. In order for the evaluation results to provide the right information, a valid and reliable instrument is needed. At the higher education level, the comprehensive guidance and counseling program, including the program evaluation component, does not have many references that users can refer to. The available references focus more on primary and secondary education levels. This research is intended to produce the intended evaluation instrument. Descriptive methods and literature review were used in this study. The data were revealed using a Delphi technique questionnaire involving three experts, then analyzed qualitatively and quantitatively. In this study, the constructs of evaluation instruments for comprehensive guidance and counseling programs were synthesized and modified from various expert opinions and professional organizations with two patterns of answers: yes and no, translated into 294 statements. The resulting evaluation instrument needs to be empirically tested for its feasibility by involving adequate participants.

LOTS and HOTS Capabilities as Assessment Instruments Made by Elementary School Teachers in Jakarta

Background: Assessment is a crucial step for determining whether or not a learning process has been successful. High-order thinking skills are a requirement for learning achievement in the twenty-first century. The goal of this project is to put quantitative evaluation instruments created by Jakarta elementary school teachers to the test. Methods: A mix method is used, which combines descriptive qualitative research with document analysis and quantitative research with instrument testing on reproductive system material, which is then examined using Anates. The participants in this study were eight Jakarta-based grade VI primary school teachers. Results: It demonstrates that teachers' capacity to construct evaluation instruments varies widely. Testing using Anates shows 15% of the questions compiled are valid and 85% invalid, 1 school with strong reliability and 7 other schools are less reliable. The difference shows that 42.5% are accepted and 57.5% are rejected. The level of difficulty showed that as many as 8.75% of the questions were in the very easy category, 18.75% easy, 51.25% moderate, 7.5% difficult and 13.75 very difficult. These results form the basis of the importance of the hierarchy of teacher understanding in depth, especially in relation to the preparation of HOTS-based assessment instruments because the quality of learning success is largely determined by the assessment instrument used. Conclusions: The LOTS and HOTS-based capability instruments made by the teacher at 8 East Dijakarta Elementary Schools have not been maximized and need development by these teachers.

Evaluation Instrument Development for Scientific Writing Instruction with A Constructivism Approach

This study was conducted to develop evaluation instruments for scientific writing instruction with a constructivism approach. The development of evaluation instruments is important to provide valid and reliable measurement to measure the success rate of scientific writing instruction with a constructivism approach. In order to achieve these objectives, the combined models of development, i.e. 4D and RDR were used. The implementation of the development consisted of four stages, namely the preliminary study, define, design, and product development. The research data were in the form of quantitative and qualitative data and the data sources were the students, lecturers, practitioners, and experts in relevant fields of study. Data analysis technique was the domain technique and t test statistical technique for related samples. Based on the results, the obtained development product in the form of the evaluation of the instruction of writing scientific papers were valid and reliable. The development product consisted of four types of evaluation devices, the assessment rubrics, portfolios, observation sheets, and learning journal. Based on the results of the four development products, the effectiveness test was valid and reliable so that it can be used to conduct evaluation of learning to write scientific papers with constructivism approach, both for the evaluation of the process and the evaluation of the learning outcomes.

Pelatihan Pengembangan Instrumen Evaluasi Online menggunakan Google Form bagi Guru Sekolah Dasar/Madrasah Ibtidaiyah

The Covid-19 pandemic forces all elements of society to adapt to newactivities that were not usually done before, including online learning. To carry outlearning evaluations during online learning, some teachers still have not optimizedthe use of available Platforms, such as the free Platform like Google Form.Therefore, it is necessary to have community service activities in the form of trainingon the development of online evaluation instruments for teachers. The purpose of thetraining is to improve the professionalism of teachers in the use of the Google Formapplication with the ExtendedForms add-on. The training was carried out virtuallythrough the Zoom Meeting and was attended by fifth-grade teachers of ElementarySchool/Madrasah Ibtidaiyah Muhammadiyah throughout Bantul Regency. Thetraining activity methods include lectures, practice, and questions and answers. Thistraining results were participants who participated in as many as 38 teachers, aspeaker delivered material about online evaluation in online learning, introductionto the Google Form Platform followed by practice compiling quiz questions usingGoogle Form. After participating in this training, participants have understood whatfacilities can be optimized when developing online evaluation instruments using theGoogle Form Platform, such as the shuffle option order, shuffle question order, andlimit timer feature with the Extended Forms add-on. After attending the training,there is an increase in the teacher's ability to maximize the Google Form applicationwith the ExtendedForms add-on.Keywords: Online Evaluation, Google Form, Online LearningAbstrak. Adanya pandemi Covid-19 memaksa semua elemen masyarakat untukberadaptasi dengan kegiatan baru yang tidak biasa dilakukan sebelumnya,diantaranya adalah pembelajaran daring. Untuk melaksanakan evaluasipembelajaran selama pembelajaran daring, beberapa guru masih belummengoptimalkan penggunaan Platform yang tersedia, seperti Platform tak berbayarGoogle Form. Oleh karena itu perlu adanya kegiatan pengabdian kepadamasyarakat berupa pelatihan pengembangan instrumen evaluasi online bagi guru.Adapun tujuan pelatihan adalah untuk meningkatkan profesionalisme guru dalampenggunaan aplikasi Google Form dengan add-on ExtendedForms. Pelatihandilaksanakan secara virtual melalui Zoom Meeting dan diikuti oleh 38 guru kelas VSekolah Dasar/Madrasah Ibtidaiyah Muhammadiyah se-Kabupaten Bantul. Adapunmetode kegiatan pelatihan berupa ceramah, praktek, dan tanya jawab. Hasilkegiatan pelatihan ini yaitu peserta telah memahami fasilitas-fasilitas apa saja yangbisa dioptimalkan ketika mengembangkan instrumen evaluasi online menggunakanPlatform Google Form seperti fitur shuffle option order, shuffle question order, danlimit timer dengan add-on ExtendedForms. Selain itu juga peserta telahmendapatkan pengalaman langsung menggunakan Google Form. Setelah mengikutipelatihan, terdapat peningkatan kemampuan guru dalam memaksimalkan aplikasiGoogle Form dengan add-on ExtendedForms.Kata Kunci: Evaluasi Online, Google Form, Pembelajaran Daring.

La utilización de instrumentos de evaluación en Educación Primaria: análisis de caso en centros educativos de la provincia de Valencia (España)

El objetivo de la investigación presentado en este artículo es el conocer cuáles son instrumentos de evaluación más empleados entre el profesorado de educación primaria en la provincia de Valencia. Este objetivo inicial pretende, en posteriores investigaciones, compararse con las metodologías que estos profesores manifiestan en su docencia. Se presentan los resultados de una encuesta aplicada a dichos profesores, integrando aspectos sobre el proceso evaluativo, identificando los instrumentos de evaluación utilizados y su frecuencia de aplicación dependiendo básicamente del tipo área de aprendizaje desarrollado. En términos de frecuencia, el profesorado reconoce que las pruebas objetivas son las más usadas, prefiriendo instrumentos de evaluación que les permitan demostrar más de una habilidad cognitiva y que a través de los mismos accedan tanto a la temática a tratar teniendo presente la posible diversidad de alumnado como a la búsqueda de una enseñanza personalizada. El profesorado considera que los instrumentos más eficaces al aprendizaje del alumnado son los de desempeño en donde la prevalencia del examen escrito juega un papel porcentual elevado en el conjunto de la nota final otorgada. Por último, esta investigación deja abierta la invitación a continuar profundizando en la búsqueda de técnicas y métodos que contribuyan a una evaluación del alumnado cada vez más personalizada, justa y equitativa, pudiendo con ello mejorar las prácticas docentes en pos de la mejora de los procesos de enseñanza-aprendizaje. Descubrir las acciones del profesorado frente a los procesos evaluativos podrá desvelar información importante respecto a lo realizado antes, durante y después de las evaluaciones. This study aims to know the most commonly used evaluation instruments by Primary Education teachers in the Province of Valencia. This aim, in subsequent studies, will be compared with the methodologies these teachers use in their classes. Data were obtained through a survey completed by these teachers regarding aspects of the evaluation process, identifying the evaluation instruments used and their frequency of application depending basically on the type of subject. In terms of frequency, teachers recognize that objective tests are the most frequently used instrument, preferring evaluation instruments that activate more than one cognitive ability, foster personalized teaching and take into account students’ diversity when it comes to the teaching of subject content. Teachers consider that the most effective instruments for student learning are those in which the written exam is assigned a high percentage of the final mark. Finally, this study encourages further research to continue searching for techniques and methods that can contribute to student evaluation models which are increasingly fairer and more personalized and equitable. In this vein, teaching practices will improve leading to better teaching-learning processes. Discovering teachers' actions regarding evaluative processes can reveal important information in relation to what was done before, during and after evaluations.

Penguatan Kompetensi Profesional Guru MGMP Kimia: Pengembangan Instrumen Evaluasi Diagnostik Multi–tier

Pelaksanaan evaluasi pembelajaran merupakan salah satu kompetensi profesional guru yang penting untuk mengukur kualitas hasil belajar siswa. Pada mata pelajaran kimia, evaluasi pembelajaran tersebut perlu dilakukan secara detil hingga diketahui sejauh mana pemahaman konsep yang dimiliki siswa. Salah satu instrumen evaluasi pembelajaran yang dapat digunakan adalah tes diagnostik bentuk bertingkat atau multi–tier. Beberapa penelitian di Indonesia melaporkan bahwa guru cenderung mengalami kesulitan dalam mengembangkan instrumen evaluasi yang berbasis diagnostic multi–tier. Kegiatan Pengabdian kepada Masyarakat (PkM) berikut bertujuan untuk membantu guru menjadi terampil dalam mengembangkan instrumen evaluasi diagnostik multi–tier. Peserta kegiatan adalah seluruh guru kimia dari MGMP (Musyawarah Guru Mata Pelajaran) Kimia Kabupaten Barito Kuala, Kalimantan Selatan. Kegiatan PkM dilaksanakan sebanyak dua kali secara daring. Metode kegiatan meliputi: (1) Penyampaian materi oleh narasumber; (2) Diskusi dan tanya–jawab antara narasumber dengan peserta; (3) Penugasan kepada peserta; dan (4) Evaluasi hasil penugasan. Instrumen evaluasi diagnostik multi–tier yang telah dikembangkan oleh peserta kegiatan Pengabdian kepada Masyarakat diharapkan dapat menguatkan kompetensi profesional guru Kimia Implementation of learning evaluation is one of the teacher's professional competence that is important to survey students' quality of learning outcomes. The evaluation in chemistry subject needs to be done detailly in determining how students understand the concepts. One of the learning evaluation instruments that can be used is multi-tier diagnostic. Several studies in Indonesia reported that teachers experience difficulties developing evaluation instruments based on multi-tier diagnostic. The following community service activities aimed to help teachers become skilled in developing multi-tier diagnostic evaluation instruments. Participants in the activity were all chemistry teachers from the MGMP (Musyawarah Guru Mata Pelajaran) of Barito Kuala Regency, South Kalimantan. The activity was carried out twice online. Methods of activity included: (1) Delivering material by the speakers; (2) Discussions between speakers and participants; (3) Assigning participants; and (4) Evaluating the assignment's result. There was expected that the multi-tier diagnostic evaluation instruments developed by participants of community service could strengthen their professional competence.

Communicative and Collaborative Aspects in Indonesian BSE Evaluation Instruments

This article aims to describe the diversity of communicative and collaborative aspects contained in the evaluation instrument in Indonesian BSE. This study uses a qualitative approach by applying the principles of content analysis. The data sources in this study were 541 evaluation instruments spread over eight teaching materials, namely compiling procedural texts, studying explanatory texts, managing information in lectures, studying life in short stories, preparing proposals, designing scientific papers, assessing works through reviews, and performing plays. The results showed that overall the evaluation instruments relevant to various communicative competence indicators were 110 questions or 20.33% while the evaluation instruments relevant to various indicators of cooperative competence were 81 questions or 14.97%. This percentage shows that the communicative and collaborative competences in the evaluation instrument in Indonesian BSE have been developed quite well.