Confirmatory and Exploratory Analysis of the Questionnaire to Evaluate the Disposition towards Organizational Change (CEDCO)

This article shows the results of two processes that corresponded to exploratory and confirmatory analyses of the Questionnaire to Evaluate the Disposition towards Organizational Change (CEDCO). The overall sample consisted of 1554 people. The first process considered 489 participants, and provided evidence of the multidimensionality of the test on three levels. The second process involved a sample of 1065 people, and provided evidence for appropriate fit values for the model that were consistent with the initial proposal for the test on three levels of evaluation: individual, group, and organizational. The results suggest the need to evaluate the practice using other mathematical models to address the biases that exist in some item distributions.

Four levels of evaluation nurse training program on regional food

ABSTRACT Objectives: to verify the effectiveness of a regional nutrition training program for nurses based on four levels of assessment: response, learning, behavior, and conclusions. Methods: this was a longitudinal, almost experimental before and after type of study, carried out in 2014 with eight nurses and 62 mothers attended in the Primary Health Care Units of the rural area of Ceará, Brazil, in a training program using educational technology on regional food. Results: the evaluations showed a positive reaction from the nurses; a very good post-test average (92.3%); a change in nurses’ behavior, verified by 30 educational activities after training; and satisfactory results, verified by improvement in knowledge, attitude and practice of the mothers about regional food and food safety after participating in the educational interventions carried out by the trained nurses. Conclusions: the training program was considered effective, showing positive results in the four levels of evaluation.

An analytic study of the levels of evaluation questions in English courses in Syrian secondary schools according to Bloom’s Taxonomy

.This study aims to classify the levels of assessment questions according to Bloom's taxonomy in English course for eleventh grade in Syria and to analyze the percentage of questions in each level (recall, comprehension, application, analysis, synthesis, and evaluation). The sample of the study consists of student's book for eleventh grade in Syrian Arab Republic. The study follows the quantitative approach by making use the following tool: an analysis card to measure the frequency of assessment questions. The results show that assessment questions in English student’s book for eleventh grade cover all levels of Bloom’s Taxonomy. The percentages are: recall 51.65%, comprehension 14.89%, application 9,02%, analysis 2.8%, synthesis 7.48%, and evaluation 2.63%. Thus, recall which is the lowest thinking skill is the most frequent level of questions whereas evaluation is the least occurring level

Classical and Fuzzy Logic Evaluation of Students' Master Theses in Matlab Fuzzy Logic Toolbox Software: Dealing with Subjectivity in Human Reasoning

The two−level evaluation of defined objectives, presented materials and methods and interpretation of results in master theses was done, in order to estimate their scientific contribution and statistical relevance. First level of evaluation was performed using classical methods and consisted of three steps: defining criteria of evaluation, analyzing their fulfilment and positioning 26 master theses into the Likert−type scale in the range from 0 to 1. Second level of evaluation was based on fuzzy logic methodology, conducted mostly in Matlab Fuzzy Logic Toolbox software and consisted of definition of variables, fuzzification, fuzzy inference, defuzzification and interpretation. Obtained marks from two levels of evaluation were than compared. Results indicate that fulfilment of defined criteria of evaluation is moderate. Common mistakes made by authors are accentuated, and clear advices for improving scientific contribution of theses were pointed out here. Classical evaluation marks were higher in 96.15% cases (or 25 out of 26 theses). However, fuzzy approach has advantages, which is also discussed. The interpretation of research results, defined as logical−mathematical argumentation, was found to have the leading role in forming mark in both levels of evaluation.

Evaluating a physician leadership development program – a mixed methods approach

Purpose – With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach – The authors applied the theoretical framework of Kirkpatrick’s four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings – The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications – While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders’ partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value – Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.