OVE's Review of Project Completion Reports (PCRs) and Expanded Supervision Reports (XSRs): The 2020 Validation Cycle

2020 ◽  
Author(s):  
Maria Fernanda Rodrigo ◽  
Claudia Figueroa ◽  
Oliver Peña-Habib ◽  
Xiomara Rojas-Asqui ◽  
Melanie Putic

This report summarizes the results of the Office of Evaluation and Oversight's (OVE) annual validation of the self-assessments of project performance and results completed by the Inter-American Development Bank (IDB) and IDB Invest in 2019-2020. The IDB and IDB Invest have systems in place to measure the development effectiveness of their operations. These systems use a number of instruments to assess projects at the design, implementation, and completion phases. The design-phase assessment uses a “Development Effectiveness Matrix” (DEM) for sovereign guaranteed (SG) operations. The effectiveness of non-sovereign guaranteed (NSG) operations is measured with a “Development Effectiveness Learning, Tracking, and Assessment tool” (DELTA). Implementation-phase assessments measure SG operations with “Project Monitoring Reports,” while NSG operations are assessed with “Project Supervision Reports.” Upon completion, SG projects are self-evaluated with “Project Completion Reports,” or PCRs. NSG operations, use “Expanded Supervision Reports,” or XSRs when they reach early operation maturity (EOM). OVE validates Managements self-evaluations (PCRs and XSRs) and assigns a final project performance rating to each operation. As part of the 2020 validation cycle, OVE reviewed PCRs for 63 operations, 62 with operational closure (CO fully justified) in 2018 and one in 2013. XSRs were reviewed for 36 IDB Invest operations that had reached early operating maturity (EOM) in 2018.

2021 ◽  
Author(s):  
Carola Álvarez ◽  
Leonardo Corral ◽  
Ana Cuesta ◽  
José Martínez ◽  
César Montiel ◽  
...  

The goal of development assistance is to deliver measurable results. At the Inter-American Development Bank (IDB), the Development Effectiveness Framework (DEF) was adopted to enhance the likelihood this goal is met. The key objective of this analysis is to enhance our understanding of the role the set of tools and processes adopted at the IDB, from project design to completion, play in the assessment of a projects success and effectiveness. Specifically, we are interested in teasing out the role different dimensions of project design, assessed through the Development Effectiveness Matrix (DEM), and execution performance indicators, as per the Project Monitoring Report (PMR), have on the delivery of effective and successful projects measured through the Project Completion Report (PCR) methodology implemented at the IDB. We also explore the validation process of PCRs and delve into the effectiveness analysis at the level of specific objectives and result indicators, identifying key pitfalls associated with objectives not being met. Overall, our findings provide strong validation for the DEF and its tools. We find robust evidence for the importance of the quality at entry assessment conducted through the DEM. In particular, the quality of the results matrix at approval is a strong determinant of project success and effectiveness at closure, and the quality of the Evaluation Plan is strongly associated with the effectiveness of a project. In terms of execution performance, our analysis finds that, on average, projects that execute a lower share of their approved loan amount, are put on Alert, or are classified as a Problem, in its first three years of execution; and projects that experience a higher share of their outputs discontinued, with respect to their first results matrix, are most likely to be ineffective in achieving their objectives and will likely be rated as unsuccessful.


2015 ◽  
Vol 10 (1) ◽  
pp. 57-64
Author(s):  
Marek Krajňák ◽  
Renáta Bašková

Abstract Contribution presents methodology for evaluating at-completion project performance status. Accurate cost and schedule project forecasts are difficult to generate when considering the impact of such events as unforeseen cost changes, material delays, scope deviation, changes to the project execution plan and poor subcontractor performance. In reality, the original estimate may be considered the first project forecast and at the point of project completion, the latest updated estimate (last forecast) and the actual amount of what is being expended should be the same. Final project performance is determined by comparing the planned budget and project duration, with the expected forecasted final budget and elapsed time. The stochastic S-curve methodology permits objective evaluation of project performance without the limitations inherent in a deterministic approach. This paper used the stochastic S curve to monitor the cost and time consumption in operation of the construction machines. The contribution presents a partial outcome from the dissertation thesis called the Interactive tools for resource optimization in construction.


2020 ◽  
Vol 41 (S1) ◽  
pp. s8-s10
Author(s):  
Julia Johnson ◽  
Asad Latif ◽  
Bharat Randive ◽  
Abhay Kadam ◽  
Uday Rajput ◽  
...  

Background: In low- and middle-income country (LMIC) healthcare facilities, gaps in infection prevention and control (IPC) practices increase risk of healthcare-associated infections (HAIs) and mortality among hospitalized neonates. Method: In this quasi-experimental study, we implemented the Comprehensive Unit-based Safety Program (CUSP) to improve adherence to evidence-based IPC practices in neonatal intensive care units (NICUs) in 4 tertiary-care facilities in Pune, India. CUSP is a validated strategy to empower staff to improve unit-level patient safety. Baseline safety culture was measured using the Hospital Survey on Patient Safety Culture (HSOPS). Baseline IPC assessments using the Infection Control Assessment Tool (ICAT) were completed to describe existing IPC practices to identify focus areas, the first of which was hand hygiene (HH). Sites received training in CUSP methodology and formed multidisciplinary CUSP teams, which met monthly and were supported by monthly coaching calls. Staff safety assessments (SSAs) guided selection of multimodal interventions. HH compliance was measured by direct observation using trained external observers. The primary outcome was HH compliance, evaluated monthly during the implementation and maintenance phases. Secondary outcomes included CUSP meeting frequency and HH compliance by healthcare worker (HCW) role. Result: In March 2018, 144 HCWs and administrators participated in CUSP training. Site meetings occurred monthly. During the implementation phase (June 2018–January 2019), HH monitoring commenced, sites formed their teams, completed the SSA, and selected interventions to improve HH based on the WHO’s IPC multimodal improvement strategy: (1) system change; (2) training and education; (3) monitoring and feedback; (4) reminders and communication; and (5) a culture of safety (Fig. 1). During the maintenance phase (February–September 2019), HH was monitored monthly and sites adapted interventions as needed. HH compliance improved from 58% to 70% at participant sites from implementation to maintenance phases (Fig. 2), with an odds ratio (OR) of 1.66 (95% CI, 1.50–1.84; P < .001). HH compliance improved across all HCW roles: (1) physician compliance improved from 55% to 67% (OR, 1.69; 95% CI, 1.42–2.01; P < .001); (2) nurse compliance from 61% to 73% (OR, 1.68; 95% CI, 1.46–1.93; P < .001); and (3) other HCW compliance from 52% to 62% (OR, 1.48; 95% CI, 1.10–1.99; P = .010). Conclusion: CUSP was successfully adapted by 4 diverse tertiary-care NICUs in Pune, India, and it resulted in increased HH compliance at all sites. This multimodal strategy is a promising framework for LMIC healthcare facilities to sustainably address IPC gaps and reduce HAI and mortality in neonates.Funding: NoneDisclosures: Aaron Milstone, Johns Hopkins University, BD (consulting)


2021 ◽  
Author(s):  
César E. Montiel Olea ◽  
Leonardo R. Corral

Project Completion Reports (PCRs) are the main instrument through which different multilateral organizations measure the success of a project once it closes. PCRs are important for development effectiveness as they serve to understand achievements, failures, and challenges within the project cycle they can feed back into the design and execution of new projects. The aim of this paper is to introduce text analysis tools for the exploration of PCR documents. We describe and apply different text analysis tools to explore the content of a sample of PCRs. We seek to illustrate a way in which PCRs can be summarized and analyzed using innovative tools applied to a unique dataset. We believe that the methods presented in this investigation have numerous potential applications to different types of text documents routinely prepared within the Inter-American Development Bank (IDB).


2017 ◽  
Vol 1 (1) ◽  
pp. 39-52
Author(s):  
Ibrahim Saidu ◽  
W Shakantu ◽  
A Adamu ◽  
I Anugwo

The problems of material waste and cost overruns are common in the construction industry. These problems occur at different stages of a construction project, from planning, design to project completion. The argument on how to eliminate cost overrun has been on-going for the past 70 years as on-site wastage of materials leads to increase in the final project cost. This paper examines the relationship between the causes of material waste and those of cost overrun at the pre-contract and post-contract stages of a project. The desktop methodological approach was firstly adopted in comparing the causes of material waste and those of cost overruns from the literature, in order to determine the possible relationship. Subsequently, interviews were purposively conducted with construction professionals within Abuja, Nigeria, in order to verify the literature based information. The result reveals that all the causes of material waste also cause cost overrun at the pre-contract and the post-contract stages of a project. 96.88% and 81.81% of the causes of cost overrun also cause material waste at the pre-contract and post-contract stages respectively. Other causes which are not related are mostly, the micro-economic and macro-economic factors. These results are not different from those of the interviews conducted with professionals and summarised in the tick box. It was also found that to achieve Effective Construction Material Waste Management (ECMWM) for any construction project, material waste must be controlled at its sources and causes, and at different stages of a project. Based on these findings, it can be concluded that effective management of material waste would translate into a reduction in the level of project cost overrun. The study recommends that construction-project managers, as well as the construction practitioners should encourage the management of material-waste causes, as it has the potential to minimise cost overrun for projects. 


Author(s):  
Denise Villanyi ◽  
Romain Martin ◽  
Philipp Sonnleitner ◽  
Christina Siry ◽  
Antoine Fischbach

Although student self-assessment is positively related to achievement, skepticism about the accuracy of students’ self-assessments remains. A few studies have shown that even elementary school students are able to provide accurate self-assessments when certain conditions are met. We developed an innovative tablet-computer-based tool for capturing self-assessments of mathematics and reading comprehension. This tool integrates the conditions required for accurate self-assessment: (1) a non-competitive setting, (2) items formulated on the task level, and (3) limited reading and no verbalization required. The innovation consists of using illustrations and a language-reduced rating scale. The correlations between students’ self-assessment scores and their standardized test scores were moderate to large. Independent of their proficiency level, students’ confidence in completing a task decreased as task difficulty increased, but these findings were more consistent in mathematics than in reading comprehension. We conclude that third- and fourth-graders have the ability to provide accurate self-assessments of their competencies, particularly in mathematics, when provided with an adequate self-assessment tool.


2015 ◽  
Vol 770 ◽  
pp. 729-734
Author(s):  
Christina N. Zavalishina

The paper discusses advantages and disadvantages of self-assessment of an organization conducted by filling out a reporting form. A questionnaire is suggested as a self-assessment tool together with a self-assessment structural model. It is proved that the process of obtaining more objective data can be regulated by reducing or increasing the number of performance indicators. Consideration is given to the process of self-assessment indicators development as an integral package and its subsequent optimization by means of Rasch model. Advantages of the measuring model are demonstrated and are supported by the results of self-assessments conducted in 7 organizations.


2004 ◽  
Vol 79 (Supplement) ◽  
pp. S55-S57 ◽  
Author(s):  
Amy Sawhill ◽  
Aggie Butler ◽  
Douglas Ripkey ◽  
David B. Swanson ◽  
Raja Subhiyah ◽  
...  

2014 ◽  
Vol 2 (1) ◽  
Author(s):  
Yemesrach Assefa ◽  
Oscar P. Rivera ◽  
Désiré Vencatachellum

One year from the target date of the achievement of the Millennium Development Goals (MDGs), the result in Africa is only a work in progress. Africa has made progress towards some of the MDGs but needs to draw lessons and improve performance post 2015. This study investigates the development effectiveness of the African Development Bank Group-financed projects using 229 concluded projects between 2004 and 2012 to assess the major determinants of project performance. The study finds that the Bank Group has on average a high level of development effectiveness. Using econometric analysis the study found that country-level variables’ interactions with project-level variables explain a substantial share of the variationsin project performance. In particular, it affirmed that country policies and institutions and country capacity in general is positively correlated with project performance whilst parallel project implementation units were not correlated. At the micro level, the age of a project, the quality of project design and the choice of programing instrument were also important determinants of project success. The findings of this study therefore will inform the policy formulation processes in the post 2015 agenda.


Sign in / Sign up

Export Citation Format

Share Document