scholarly journals Clinical Scholars: Using Program Evaluation to Inform Leadership Development

2021 ◽  
Author(s):  
Gaurav Dave ◽  
Cheryl Noble ◽  
Caroline Chandler ◽  
Giselle Corbie-Smith ◽  
Claudia S.P. Fernandez

Leadership development programs are notoriously difficult to evaluate, and when evaluations are attempted, they often do not go beyond measuring low-level, short-term outcomes of the impacts experienced by participants. Many leadership development programs do not systematically assess changes that are catalyzed within the organizations, communities and systems in which participants lead. To address these challenges, evaluators of the Clinical Scholars National Leadership Institute (CNLI) have designed a comprehensive, mixed-methods evaluation approach to determine the effectiveness of the training and explore the impacts of participants in the spheres in which they lead. Guided by Michael Patton’s Developmental Evaluation approach and framed by Kirkpatrick’s Training Evaluation Model, the CSNLI evaluation collects data on multiple levels to provide a robust picture of the multiple outcomes of the program. The approach focuses on individual participant outcomes, by measuring competency changes over time and exploring how participants use the competencies gained through the training in their work. Social network analysis is utilized to measure the development and expansion of participants’ networks and collaboration within the teams, cohorts, and across sectors and disciplines throughout their time in the CSNLI. The Most Significant Change methodology and semi-structured alumni interviews are used to measure impacts participants identify as occurring as a result of their participation. Finally, Concept Mapping is implemented to explore how Fellows make meaning of the foundational concepts and values of the CSNLI. The outcome and impact evaluation activities employed by the CSNLI, in combination with quality improvement-focused process evaluation, support innovation and excellence in the provision of a health equity-grounded leadership development program.

2019 ◽  
Vol 8 (4) ◽  
pp. 1309-1316

Nowadays, the implementers of Civilian Personnel (Pegawai Negeri Sipil/PNS) Career Development Programs within the Indonesian Navy are still one with military personnel where their existence is only complementary so that they become less optimal/less focused. In its implementation, it is only carried out by officials at the level of Head of Affair (Superintendent/PNS class III/c), the impacts are low of performance, competence and confidence that can be related with weakening work performance. This study aims to provide an evaluation of Civilian Personnel career development programs within the Indonesian Navy by using the CIPP evaluation approach (Content, Input, Process, Product) and Analytical Hierarchy Process (AHP) methods. Based on the results of the program evaluation study, it can be seen that the results of the Context aspect evaluation amounted to 85.84% with the Excellent category; Input aspects amounted to 76.38% with good categories; Process aspects were 79.77% with good categories; Product aspect is 82.48 in the excellent category. So, the overall evaluation of the Civilian Personnel career development program is 81.12% with an Excellent category. The results of the recommendations state that career development programs need to be revised on several aspects of the criteria.


2015 ◽  
Vol 34 (10) ◽  
pp. 1262-1271 ◽  
Author(s):  
Igor Kotlyar ◽  
Julia Richardson ◽  
Len Karakowsky

Purpose – An increasingly popular method of facilitating employee and leadership development is via a career community (Parker et al., 2004), where individuals self-organize to obtain career support. This study was driven by the following research question: how do external peer coaching groups – which are a form of career community – impact leadership development? The purpose of this paper is to report the findings of a research study that examined one such career community focussed on providing peer coaching for managers in business organizations. The authors conducted in-depth interviews with participants who attended a leadership development program that was based on harnessing a career community for the purpose of peer coaching. The authors report the results of the study and its implications for leadership development programs. Design/methodology/approach – The authors chose a qualitative methodology to conduct this exploratory examination, where the authors conducted in-depth interviews with participants in a unique leadership development program which involved peer group coaching supplemented by one-on-one personal coaching. A key reason for adopting a qualitative methodology was that the authors were looking for a deeper understanding of interviewees’ perceptions and experiences regarding peer coaching. The first component of the leadership program involved eight peer coaching sessions over a 12-month period. Participants met in small, exclusive groups – typically in cohorts of seven to eight peers, but as many as 12 peers – every six weeks to discuss a variety of topics relevant to their jobs and stage of career and to provide each other with peer coaching and advice. Each group was comprised of people from different organizations. Sessions were led by a facilitator and lasted three hours each. The authors conducted in-depth interviews with 17 graduates of the program. The sample comprised 14 women and three men. Interviews were audio taped and transcribed verbatim and then analyzed using thematic analysis (King, 2004) to identify the key themes in interviewees’ experiences of the respective program. Findings – Thematic interpretation of participants’ responses yielded the following four major themes: first, the value of a learning community; second, the utility of a formal approach to peer coaching; third, the value of diversity and “externality”; and fourth, the value of an open learning environment (each fully described in the manuscript). The study revealed that external peer coaching and personal coaching deliver distinct types of value as part of a complete leadership development program. Research limitations/implications – This was a case study and specific to one leadership development program. Consequently, the authors cannot necessarily generalize the findings. Practical implications – The findings draw critical attention to the major contribution that learning communities can make toward leadership development. Although many leadership development programs assume that “leadership” is best learned from top leaders (e.g. Presidents and CEOs), organizations can acquire unique benefits by leveraging the concept of peer coaching, which can produce substantial results by having managers at the same organizational level learn from each other. In addition, the study underscores the potential value of external sources of peer coaching and leader development. Organizations may further maximize such benefits by sending their mid and senior-level managers to external peer coaching programs, which can deliver unique value in addition to any internal leadership development initiatives. Social implications – This study underscores the need to better bridge the gap between two literatures – careers and leadership development. Career scholars explore the activities involved in developing careers (e.g. career communities) and leadership development scholars explore activities involved in developing leaders. This study demonstrates the value of integrating knowledge from both these literatures to suggest that learning communities can impact leadership development in significant and positive ways. Originality/value – This study makes a novel contribution to the literature addressing leadership development. It draws attention to the use of career communities for leadership development – an issue which has largely been ignored. In addition, while much of the extant research has focussed on either academic or student participants, the study focussed on business professionals. Few studies have examined the use of peers from outside organizations to serve as coaches for leadership development.


2014 ◽  
Vol 26 (8) ◽  
pp. 511-528 ◽  
Author(s):  
Ellen F. Goldman ◽  
Marilyn Wesner ◽  
Margaret M. Plack ◽  
Nisha N. Manikoth ◽  
Yolanda Haywood

Purpose – This paper aims to explore the impact leadership development program graduates had on their workgroup, the nature of that impact and how that impact occurred. Design/methodology/approach – This research was conducted at three sites using a qualitative interview methodology with thematic data analysis. Techniques to ensure trustworthiness included purposive sampling, triangulation of researchers, member checks and code checking. Findings – Analysis of the data revealed secondhand learning as specific changes in practices, behaviors and attitudes, transferred by program graduates to their peers and supervisors. The transfer of learning was described as both intentional and informal learning during episodes of varying duration, and occurred through a variety of dyadic and group interactions in a manner generally consistent with the 4I framework of organizational learning. Research limitations/implications – The study was limited to medical educators. Recommendations for supervisors and organizations to maximize training transfer are identified. These suggestions advocate for actively encouraging graduates in departmental leadership and faculty development; focusing transfer on specific practices, behaviors and attitudes; and considering both short- and long-term outcomes. Originality/value – This paper makes an original contribution to the literature by describing the process of secondhand learning from leadership development program graduates. The paper also expands our understanding of the nuances in transfer methods and associated learning episodes in the context of an educational environment. Finally, the research illustrates how qualitative methods can be used to expose secondhand learning.


Author(s):  
Emmanuel Mango ◽  
Jeremiah Koshal ◽  
Caren Ouma

Effective leadership development has eluded many organizations and academia for a long time. Those who have attempted to improve the practice and study of leadership development focus on the same old elements of leadership development. The traditional elements of leadership development that have been studied and implemented previously include: the content of the leadership development programs, the delivery of leadership development programs, the length of the programs and advocating for leadership development programs that are entrenched in leadership theory. Despite numerous studies and implementation of the studies’ findings on leadership development, there exists widespread dissatisfaction with leadership development outcomes. Some scholars have observed that leader developmental readiness may be the missing ingredient in leadership development. Learning goal orientation is one of the five elements of leader developmental readiness. Therefore, this study examines the effect of learning goal orientation on leadership development. The study reveals that learning goal orientation has a significant effect on leadership development, F(1,286) = 62.346, p < 001. In addition, learning goal orientation accounts for 17.9% of the variation in leadership development. Thus, enhancing participants’ learning goal orientation should be part and parcel of any leadership development program in order to improve the effectiveness of leadership development. 


2020 ◽  
pp. 144078332091145
Author(s):  
Meredith Nash ◽  
Robyn Moore

Leadership development programs (LDPs) are one response to the under-representation of women in leadership positions. This article evaluates Homeward Bound, a 12-month LDP for women in Science, Technology, Engineering, Mathematics and Medicine (STEMM) fields that culminates in a three-week voyage to Antarctica. We evaluate the extent that the program supports key features of LDPs for women – including creating a safe, women-only environment, providing professional networking opportunities and using intersectional approaches. We argue that remote locations generate challenges that must be considered in LDP design and implementation. Findings are widely applicable and can inform LDPs in multiple contexts.


Author(s):  
Makmun Abdullah

Leadership development program is an integrated leadership quality development program towards individuals and organizations to achieve organizational goals.  This is important in response to the urgent need to prepare competent leaders in the face of global challenges and uncertainty conditions. Through appropriate leadership development programs, government/institutions are expected to achieve their goals effectively and efficiently. Currently there has been a paradigm shift in leadership development programs that more targeted to the human side by focusing on individuals rather than on their own management processes. This research is expected to answer questions related to the benefits, effectiveness, and development of Leadership Training program organized by the Ministry of Energy and Mineral Resources at this time. The approach of this research is literature review and qualitative descriptive by distributing questionnaires with respondents of alumni of Diklatpim Level IV at KESDM Year 2017. The results show that the Leadership Training which has been held essentially in accordance with the trend of leadership development that is considered most effective model at this time. The alumni of leadership training program have also benefited from the implementation of the training.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Stephanie Douglas ◽  
Daisha Merritt ◽  
Robin Roberts ◽  
Daryl Watkins

Purpose This study aims to examine the impact of leadership development programs on organizational outcomes and organizational effectiveness. Design/methodology/approach Using a grounded theory approach, semi-structured interviews were conducted with 15 executive leaders from aviation firms in Brazil with employees participating in a leadership development program. NVivo12 was used for coding and managing the data. Thematic analysis was performed to determine themes and categories. Findings The leadership development program was found to influence organizational level outcomes identified as themes of internal impact, external impact, skill development and capacity. The interviews also found that executive leaders perceived the leadership development program to impact organizational effectiveness. Connections to human capital, social capital and collective leadership were found as outcomes of the leadership development program contributing to organizational effectiveness. Research limitations/implications The findings are dependent upon the executive leaders’ interviews and are limited sample size. The protocol of subjective inter-coder reliability was followed supporting the credibility and dependability of the findings; however, researcher bias may still be present in qualitative studies. Generalizability outside of the Brazilian aviation context is cautioned until further studies in additional contexts and industries are completed. Practical implications The findings of this study support leadership development programs as impactful on organizational outcomes and effectiveness. Incorporating leadership development programs as part of human capital management strategies supports organizational effectiveness through increased collective leadership capacity, human capital development and social capital. Originality/value A large amount is known regarding the outcomes for individuals as a result of leadership development programs with less examination on the contribution to organizational level outcomes and organizational effectiveness. This study aids in bridging this gap.


2015 ◽  
Vol 34 (2) ◽  
pp. 134-152 ◽  
Author(s):  
Elizabeth King ◽  
Paul Nesbit

Purpose – The purpose of this paper is to investigate ways to gain deeper understanding of the evaluation challenge by reporting on insights about the impact of a leadership development program. It focusses on participants’ reflective post-course analysis of their learning, comparing this to a traditional evaluative analysis. Recently there has been a greater focus on programs to develop leaders who have the requisite cognitive and behavioral complexity to lead in challenging environments. However models for the evaluation of such programs often rely on methodologies that assume learning of specific skills rather than assessment of how well participants are able to cognitively and behaviorally adapt to uncertain and complex environments. Design/methodology/approach – The leadership development program was evaluated in two stages and the findings compared. Stage 1 elicited responses to the program using a traditional evaluation approach. Stage 2 involved 30 semi-structured interviews with the participants exploring the connections made between their development experience, work environment and approach to challenge. Findings – Evaluation approaches which focus on assessing reflection about personal learning provide greater detail on learning experience than traditional approaches to evaluation and can increase our understanding of the broader impact of leadership development programs. Current evaluation practices are mostly traditional despite dissatisfaction with outcomes. There are functional and financial benefits flowing from this practice suggesting collusion with denial between the suppliers and purchasers of leadership development and posing a question of causation. Originality/value – This study supports the use of qualitative evaluation techniques and in particular a focus on post-learning reflection to increase understanding of the impact of leadership development programs. The increased understanding provided by this type of evaluation can play a significant role in both the design of leader development programs and the creation of strategic alignment between business strategy, the purpose of leadership development interventions, learning objectives, program design and program evaluation.


2021 ◽  
pp. 216507992110017
Author(s):  
Crystal Spears-Jones ◽  
Ranell Myles ◽  
Tichelle Porch ◽  
Stephanie Parris ◽  
Michelle Ivy-Knudsen ◽  
...  

Background: Leading Change is one of five Executive Core Qualifications (ECQs) used in developing leaders in the federal government. Leadership development programs that incorporate multirater feedback and executive coaching are valuable in developing competencies to lead change. Methods: We examined the extent by which coaching influenced Leading Change competencies and identified effective tools and resources used to enhance the leadership capacity of first- and midlevel leaders at Centers for Disease Control and Prevention’s National Center for HIV/AIDS, Viral Hepatitis, Sexually Transmitted Diseases, and Tuberculosis Prevention. Data included qualitative data collected via semi-structured interviews that focused on leadership changes made by leaders in the Coaching and Leadership Initiative (CaLI), a leadership development program for Team Leads and Branch Chiefs. Findings: Ninety-six participants completed leadership coaching; 94 (98%) of whom completed one or more interviews. Of those 94 respondents, 74 (79%) reported improvements in their ability to lead change in 3 of 4 leading change competencies: creativity and innovation, flexibility, and resilience. All respondents indicated tools and resources that were effective in leading change: 49 (52%) participated in instructor-led activities during their CaLI experience; 33 (35%) experiential activities; 94 (100%) developmental relationships, assessment, and feedback; and 25 (27%) self-development. Conclusions/Application to Practice: First- and midlevel leaders in a public health agency benefitted from using leadership coaching in developing competencies to lead organizational change. Leadership development programs might benefit from examining Leading Change competencies and including instructor-led and experiential activities as an additional component of a comprehensive leadership development program.


Sign in / Sign up

Export Citation Format

Share Document