VALIDATION OF THERMOCHEMISTRY SUPPLEMENT BOOK BASED PROBLEM SOLVING TO TRAIN STUDENTS METACOGNITIVE SKILLS

This research aims to know validity of thermochemistry suplement book based problem solving to train students metacognitive skills includes the content and construct. Content validity includes the suitability of the material and questions. Construct validity includes presentation and readability techniques. Problem solving model has 4 steps, that are understanding the problem, devising a plan, carrying out the plan, and lock back. Metacognitive skills consist of 3 components, namely planning, monitoring, and evaluating. The type of research used is the Research and Development (R&D) from Sugiyono. The supplement book was assessed by 3 experts in the field of chemical education using a validation instrument. The results showed that a chemical supplement book based on problem solving to train students' metacognitive skills on thermochemical material was very good with a score of 91.6% in content validation and 84.9% in construct validation.

Item Objective Congruence Analysis for Multidimensional Items Content Validation of a Reading Test in Sri Lankan University

This paper presents the findings of a study that intended to seek the content validity (CV) evidence of an instrument to measure the reading ability of university students in Sri Lanka. The reading passages and items were adapted from CEFR aligned Learning Resource Network (LRN) materials. The items were designed based on the cognitive processing involved in completing each reading task as prescribed by Khalifa and Weir (2009). As a part of collecting evidence for content validation of the instrumentation, Item Objective Congruence (IOC) analysis is used in this study. In IOC, the congruence between the cognitive processing of reading and the test items were studied providing quantified data for CV. A pool of twelve experts examined a total of 41 test items against eight cognitive processing effectively. As the experts had chosen more than one objective for an item, the IOC formula simplified by Crocker and Aligna (1986) for multi-dimensional assessment of multiple combinations of skills was applied in the present study. The findings of the IOC indicate the experts’ varying degrees of agreement in terms of what some of the items were designed to assess. 38 items had acceptable IOC indices, one item was removed from the study and two items were modified. Items having high congruence show that they test only one skill and those indicating low congruence notify that, items assess more than one cognitive processing skill. The study demonstrates the utility of the IOC method in gathering evidence for CV. Test development and validation are crucial in assessment which is the first and foremost process to evaluate educational management.   

Development and validation of chemistry learning videos as learning media in the era of the COVID-19 pandemic

Learning media, especially videos, are very effective in achieving learning objectives, especially during the COVID-19 pandemic. Therefore, this study aims to develop learning videos as learning media during the COVID-19 pandemic. The research was conducted using a development research approach from the Borg & Gall model. The developed product has good validity. Where the results of the content validation test by material experts show the CVR value in the range 0.75 – 0.95 (above the critical CVR value). The construct validity test results have a value in the range 0.75 – 0.95 so that it is included in the valid category. And lastly, the test results for student responses have percentage values in the range of 79% - 89% so that they are included in the interesting and very interesting category. Based on these results, the developed learning video can be used as a learning media solution during the COVID-19 pandemic.

Development and evaluation of an instructional LiveBinders for learning selected computer studies concept in Ilorin Metropolis

This research was developed and evaluated an instructional LiveBinders for learning selected computer Studies concepts in Ilorin Metropolis, Nigeria. In this research, the design and development model was used. The participants in the study were five computer studies teachers, five computer science experts, and five educational technology experts were chosen at random. The following research instruments were used in this study: a developed computer storage device for computer studies, an expert rating guide of educational technology, and a subject content validation questionnaire. Research questions were answered using percentages and mean. The study concluded that if LiveBinders are properly integrated into learning, computer studies learning can be improved. As a result, it was suggested that students be encouraged to use LiveBinders for learning regardless of a subject area.

Portuguese Physical Literacy Assessment Questionnaire (PPLA-Q) for adolescents (15–18 years) from grades 10–12: development, content validation and pilot testing

Background The Portuguese Physical Literacy Assessment (PPLA) is a novel tool to assess high-school students’ (grade 10–12; 15–18 years) Physical Literacy (PL) in Physical Education (PE); inspired by the four domains of the Australian Physical Literacy Framework (APLF), and the Portuguese PE syllabus. This paper describes the development, content validation, and pilot testing of the PPLA-Questionnaire (PPLA-Q), one of two instruments in the PPLA, comprised of modules to assess the psychological, social, and part of the cognitive domain of PL. Methods Development was supported by previous work, analysis of the APLF, and literature review. We iteratively gathered evidence on content validity through two rounds of qualitative and quantitative expert validation (n = 11); three rounds of cognitive interviews with high-school students (n = 12); and multiple instances of expert advisor input. A pilot study in two grade 10 classes (n = 41) assessed feasibility, preliminary reliability, item difficulty and discrimination. Results Initial versions of the PPLA-Q gathered evidence in favor of adequate content validity at item level: most items had an Item-Content Validity Index ≥.78 and Cohen’s κ ≥ .76. At module-level, S-CVI/Ave and UA were .87/.60, .98/.93 and .96/.84 for the cognitive, psychological, and social modules, respectively. Through the pilot study, we found evidence for feasibility, preliminary subscale and item reliability, difficulty, and discrimination. Items were reviewed through qualitative methods until saturation. Current PPLA-Q consists of 3 modules: cognitive (knowledge test with 10 items), psychological (46 Likert-type items) and social (43 Likert-type items). Conclusion Results of this study provide evidence for content validity, feasibility within PE setting and preliminary reliability of the PPLA-Q as an instrument to assess the psychological, social, and part of the cognitive domain of PL in grade 10 to 12 adolescents. Further validation and development are needed to establish construct validity and reliability, and study PPLA-Q’s integration with the PPLA-Observation (an instrument in development to assess the remaining domains of PL) within the PPLA framework.

Content Validation of a Chrononutrition Questionnaire for the General and Shift Work Populations: A Delphi Study

Unusual meal timing has been associated with a higher prevalence of chronic disease. Those at greater risk include shift workers and evening chronotypes. This study aimed to validate the content of a Chrononutrition Questionnaire for shift and non-shift workers to identify temporal patterns of eating in relation to chronotype. Content validity was determined using a Delphi study of three rounds. Experts rated the relevance of, and provided feedback on, 46 items across seven outcomes: meal regularity, times of first eating occasion, last eating occasion, largest meal, main meals/snacks, wake, and sleep, which were edited in response. Items with greater than 70% consensus of relevance were accepted. Rounds one, two, and three had 28, 26, and 24 experts, respectively. Across three rounds, no outcomes were irrelevant, but seven were merged into three for ease of usage, and two sections were added for experts to rate and comment on. In the final round, all but one of 29 items achieved greater than 70% consensus of relevance with no further changes. The Chrononutrition Questionnaire was deemed relevant to experts in circadian biology and chrononutrition, and could represent a convenient tool to assess temporal patterns of eating in relation to chronotype in future studies.

Content Validation of a Semi-Structured Interview to Analyze the Management of Suffering

This work involves the content validation of a semi-structured interview, whose objective is to learn about the management of suffering in people. The interview items have been classified into several categories that define the suffering construct. For the content validation of the instrument, in addition to initially conducting a scientific review on the subject, the procedure known as expert judgement has been used. The results obtained in terms of the content validity achieved in the dimensions and areas assessed are, in general, satisfactory. However, some of these dimensions and certain areas have not exceeded the required minimum values for content validity. Therefore, it is necessary to modify the items comprising these dimensions in the areas evaluated with the additional incorporation of the qualitative suggestions for improvement indicated by the experts. As for agreement among experts, the results point to moderate agreement, which, moreover, is not due to chance.