Program Evaluation Practice in the Nonprofit Sector

2000 ◽  
Vol 10 (3) ◽  
pp. 331-339 ◽  
Author(s):  
Allison H. Fine ◽  
Colette E. Thayer ◽  
Anne Coghlan
Keyword(s):  
Program Evaluation ◽  
Nonprofit Sector ◽  
Evaluation Practice

Differential Item Functioning in Attitude Assessment

1997 ◽  
Vol 18 (2) ◽  
pp. 127-135
Author(s):  
George A. Johanson
Keyword(s):  
Program Evaluation ◽  
Differential Item Functioning ◽  
Age Groups ◽  
Attitude Assessment ◽  
Evaluation Practice ◽  
Item Functioning ◽  
Binary Format

Differential item functioning (DIF) is not often seen in the literature on attitude assessment. A brief discussion of DIF and methods of implementation is followed by an illustrative example from a program evaluation, using an attitude-towards-science scale with 1550 children in grades one through six. An item exhibiting substantial DIF with respect to gender was detected using the Mantel-Haenszel procedure. In a second example, data from workshop evaluations with 1682 adults were recoded to a binary format, and it was found that an item suspected of functioning differentially with respect to age groups was, in fact, not doing so. Implications for evaluation practice are discussed.

scholarly journals Using Rubrics for an Evaluation: A National Research Council Pilot

2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Ghislaine Hélène Tremblay ◽  
Frédéric Bertrand ◽  
Melissa Fraser
Keyword(s):  
Program Evaluation ◽  
Student Learning ◽  
Research Council ◽  
National Research Council ◽  
Pilot Project ◽  
Education Sector ◽  
Evaluation Practice

Rubrics are commonly used in the education sector to assess performance, products, or processes of student learning. Rubrics are gaining importance in or-ganizational performance and program evaluation practice. According to several evaluation practitioners, rubrics can elucidate how excellence and value are defined and applied to evaluation questions or indicators in a given context. This practice note summarizes a pilot project of the National Research Council Canada (NRC) using evaluative rubrics for characterizing relevance and generating conclusions in an evaluation.En pédagogie, on se sert souvent de rubriques pour évaluer la perfor-mance, les résultats ou la démarche d’apprentissage de l’étudiant. De plus en plus, les rubriques sont utilisées en analyse de la performance organisationnelle et dans la pratique évaluative. Selon certains évaluateurs, les rubriques peuvent contribuer à éclairer la façon dont l’excellence et le rendement sont définies et intégrées aux ques-tions d’évaluation ou aux indicateurs dans un contexte donné. Cette note de pratique résume un projet pilote du Conseil national de recherches du Canada (CNRC) dans lequel on a utilisé des rubriques pour caractériser la pertinence d’un programme et générer les conclusions de l’évaluation.

Using the 2018 AEA Evaluator Competencies for Effective Program Evaluation Practice

2020 ◽  
Vol 2020 (168) ◽  
pp. 75-97
Author(s):  
Laurie Stevahn ◽  
Dale E. Berger ◽  
Susan A. Tucker ◽  
Anna Rodell
Keyword(s):  
Program Evaluation ◽  
Evaluation Practice ◽  
Effective Program

scholarly journals THE GRANDE PRAIRIE PACT PROGRAM EVALUATION: DISCREPANCY BETWEEN MODEL EVALUATION PRACTICE AND CONSTRAINED REAL WORLD EVALUATION OF CRIME PREVENTION IN SMALL COMMUNITIES

2013 ◽  
Vol 4 (1) ◽  
pp. 136
Author(s):  
Crystal Hincks ◽  
Anne Miller ◽  
Monica Pauls
Keyword(s):  
Mental Health ◽  
Program Evaluation ◽  
Crime Prevention ◽  
Real World ◽  
Time Frame ◽  
Community Safety ◽  
Small Communities ◽  
Royal Canadian Mounted Police ◽  
Evaluation Practice ◽  
Start Up

This article discusses and demonstrates the discrepancies between ideal, theoretical program evaluation processes and real world evaluation practice, which is constrained by numerous and varying factors. The article describes the real world experience of Mount Royal University’s Centre for Criminology and Justice Research researchers in conducting an evaluation of the Police and Crisis Team (PACT) in Grande Prairie, Alberta, including a Social Return on Investment (SROI) analysis. PACT, which partners an Royal Canadian Mounted Police (RCMP) officer with a mental health professional, represents a blend of secondary and tertiary crime prevention and attempts to diminish crime in the community by addressing the risk factors of individuals with mental health concerns (creating trust with individuals, increasing awareness of resources, and decreasing stigmatization in the community). PACT also specifically targets those individuals with mental health issues who are in contact with the law to try to decrease recidivism and increase community safety. Challenges were present in the evaluation due to the time frame, staff turnover, program start-up issues, and confidentiality and sensitivity of the program focus. Despite the challenges, the CCJR team completed an evaluation including a forecast SROI, identifying several successes, challenges, and recommendations for change.

scholarly journals Indigenous Health Service: Principles and Guidelines from a Provincial “Three Ribbon” Expert Panel

2020 ◽  
Vol 34 (3) ◽  
Author(s):  
Michelle Firestone
Keyword(s):  
Program Evaluation ◽  
Social Service ◽  
Indigenous Health ◽  
Evaluation Research ◽  
Service Evaluation ◽  
Collective Knowledge ◽  
Evaluation Practice ◽  
Indigenous Worldviews ◽  
Values And Beliefs ◽  
Evidence Based Guidelines

A group of Indigenous health and social service evaluators called the “Three Ribbon” panel came together in Toronto, Canada with the goal of informing a set of evidence-based guidelines for urban Indigenous health and social service and program evaluation. The collective knowledge and experiences of the Three Ribbon panel was gathered through discussion circles and synthesized around the following areas: barriers with conducting Indigenous health and social service evaluation; decolonizing principles and protocols that support community self-determination and centralize Indigenous culture and worldviews; and guidelines to inform health and social service evaluation moving forward.  The wisdom and contributions of the Three Ribbon Panel creates space for Indigenous worldviews, values and beliefs within program evaluation practice and has important implications for evaluation research and application.

scholarly journals Evaluation framework for urban development programs: the case of Morocco

2021 ◽  
Vol 3 (4) ◽  
pp. 383-392
Author(s):  
SAIDA Hajjaji ◽  
Mounir Zouiten
Keyword(s):  
Program Evaluation ◽  
Urban Development ◽  
Evaluation Studies ◽  
Evaluation Process ◽  
Public Affairs ◽  
Evaluation Framework ◽  
Development Programs ◽  
Evaluation Practice ◽  
Institutional Landscape ◽  
Global Initiative

The evaluation of urban development programs is now a prerequisite for any initiative to improve their effectiveness. The United Nations has designated 2015 as the International Year of Evaluation (EvalYear). This global initiative aims to support the development of an enabling environment for evaluation at international, national, and local levels (UN, 2015). In Morocco, the situation is still characterized by a weak anchoring of the evaluation function in the political-institutional landscape, except for a few sectoral mechanisms for collecting information and drawing up diagnoses. However, there is a real awareness of this, as the new Constitution of 2011 addresses this deficit and highlights the importance of evaluation in the management of public affairs. In this context, the Moroccan Ministry of Housing has initiated several evaluation studies on specific programs. Accordingly, we will analyze three evaluation studies of urban development projects. The objective of our work is to verify to what extent the modeling of the program evaluation process, developed by Hurteau and Houle (2006), was applied to the evaluation reports analyzed and to issue a well-founded judgment. To do this, we translated the steps of modeling the evaluation process into indicators to create an analysis grid. However, our study may have a limitation in that while the reports analyzed have the advantage of being almost uniform in terms of content, this choice is biased because it does not provide an exhaustive representation of evaluation practice. Finally, the results of our study show that the practice of modeling the evaluation process is not uniform and that it would be important to develop and frame the practice of program evaluation.

scholarly journals Program Evaluation for Health Professionals: What It Is, What It Isn’t and How to Do It

2020 ◽  
Vol 19 ◽  
pp. 160940692096434
Author(s):  
Jeffery Adams ◽  
Stephen Neville
Keyword(s):  
Health Care ◽  
Program Evaluation ◽  
Health Services ◽  
Health Professionals ◽  
Work Experience ◽  
Evaluation Practice ◽  
Value Judgements ◽  
Suitable Framework ◽  
The Impact

Health professionals deliver a range of health services to individuals and communities. The evaluation of these services is an important component of these programs and health professionals should have the requisite knowledge, attributes, and skills to evaluate the impact of the services they provide. However, health professionals are seldom adequately prepared by their training or work experience to do this well. In this article we provide a suitable framework and guidance to enable health professionals to appropriately undertake useful program evaluation. We introduce and discuss “Easy Evaluation” and provide guidelines for its implementation. The framework presented distinguishes program evaluation from research and encourages health professionals to apply an evaluative lens in order that value judgements about the merit, worth, and significance of programs can be made. Examples from our evaluation practice are drawn on to illustrate how program evaluation can be used across the health care spectrum.

scholarly journals Evaluation of Aboriginal Programs: What Place is Given to Participation and Cultural Sensitivity?

2013 ◽  
Vol 4 (2) ◽  
Author(s):  
Steve Jacob ◽  
Geoffroy Desautels
Keyword(s):  
Program Evaluation ◽  
Cultural Sensitivity ◽  
Aboriginal People ◽  
Evaluation Process ◽  
Aboriginal Peoples ◽  
Royal Commission ◽  
Systematic Analysis ◽  
Evaluation Practice ◽  
Aboriginal Populations ◽  
Positive Evolution

Aboriginal populations in Northern Canada have, for many years, been confronted with socio-economic problems affecting their development. In the early 1990s, the Royal Commission on Aboriginal Peoples (1996) report concluded that it was important to integrate Aboriginal people into the management of public policies that concern them and to encourage their autonomy. In order to produce a quality evaluation that is useful in particular cultural contexts, measures have been developed to assure that the evaluation highly regards cultural sensitivity while integrating local participants in the evaluation process. This study, based on the systematic analysis of a non-probability sample of 27 program evaluation reports, presents an inventory of evaluation practice in Aboriginal contexts and estimates in what measure a culturally sensitive and participatory approach was applied. It was apparent that cultural sensitivity is gradually being integrated into Aboriginal program evaluation and that certain indicators show that there has been a positive evolution in this direction. Finally, the study shows an occasional recourse to participatory approaches, but this is not a strong tendency as systematically technocratic approaches are more broadly employed.

Sign in / Sign up

Export Citation Format

Share Document