Project Data Sheet

Project Data Sheets (PDS) contain summary information on the project or program: Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.

PDS Creation Date
PDS Updated as of 25 Mar 2014

Project Name Implementing Impact Evaluation at ADB
Country Regional
Project/Program Number 44353-012
Status Approved
Geographical Location 1 or 2 projects in each subregion (Central and West Asia, East Asia, Pacific, South Asia, Southeast Asia)
In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area.
Sector and/or Subsector Classification Public sector management
/ Economic and Public Affairs Management
Thematic Classification Economic growth
Social development
Gender Mainstreaming Categories Some gender benefits

Financing

Type/Modality of Assistance Approval Number Source of Funding Approved Amount (thousand)
Technical Assistance7680Technical Assistance Special Fund1,000
TOTAL US$ 1,000

Summary of Environmental and Social Issues

Environmental Aspects
Involuntary Resettlement
Indigenous Peoples

Stakeholder Communication, Participation and Consultation

During Project Design
During Project Implementation

Description

The outputs of the TA will include (i) at least 5 impact evaluation studies (1 to 2 per RD) with published case study illustrations on the IE studies, (ii) IE awareness building and capacity development for DMC officials and ADB staff, and awareness building for Management; and (iii) provision of technical support to RDs in selecting and implementing IE interventions. The TA will provide financial and technical support for selected IE interventions.

Project Rationale and Linkage to Country/Regional Strategy

Bilateral and multilateral development agencies spend billions of dollars each year supporting development programs, and developing countries spend many times more on programs from their own resources. There is a substantial amount of empirical work on, for example, the effects of economic growth and human capital development on poverty reduction. However, evidence on the development effectiveness of individual projects and programs is limited. In particular, questions often remain on whether a given intervention produced its intended benefits, by how much, and how efficiently such intervention contributed to the intended outcomes and impacts. Unless the evidence of project and program impact is available, it is not possible to adequately inform policy makers and development partners as to how further assistance can be more effectively designed and implemented. While a number of multilateral and bilateral development institutions have introduced programs to institutionalize IE analyses, ADB lags behind. Since its establishment, ADB has supported its developing member countries (DMCs) in designing, financing, and implementing project and policy interventions aimed at fostering economic development and reducing poverty in the region. ADB's routine economic sector work, cost-benefit analysis, and project performance monitoring, as well as project completion and self-evaluation exercises currently provide the basis for identifying project outcomes and impacts ex-ante and ex-post. The ex-ante analysis used in ADB for identifying causal links between development interventions, outcome and impact is relatively comprehensive. Monitoring of implementation progress and processes, especially inputs and outputs, is also attended through project performance reporting system. However, once projects are completed, the ex-post assessment of the causal links between outputs, outcomes and impact is often limited by the absence of carefully constructed counterfactuals, which are needed to assess of what would have happened to beneficiaries in absence of the interventions. Often, evaluations at project completion are conducted on the basis of monitoring of partial indicators, which may lead to selection bias due to focus on available rather than needed data. The lack of good counterfactuals and baselines also leads to reliance on qualitative assessments and identification of ADB contribution rather than attribution, limiting the accountability for development outcomes. IED evaluates projects following their completion, but the extent to which it can carry out impact evaluations is limited by the availability of reliable counterfactuals and baseline surveys. It is recognized that good counterfactual identification and baselines surveys are best started at the beginning of the project cycle as part of project monitoring and evaluation system, as then these can be used to carry out the IEs at, to the extent possible, project mid-term and at project completion. As such, IEs should be implemented by RDs responsible for operations. ADB recognizes the need to more systematically measure outcomes and impact as a way of strengthening the management of effective development. This issue was also underscored by member countries in General Capital Increase (GCI V) and Asian Development Fund (ADF X) discussions. In response ADB has taken actions toward upscaling and mainstreaming IE. Better measurement of the outcome and impact of ADB interventions will help the institution and DMC policy makers to assess the consequences of the development initiatives and help allocate limited resources more efficiently, guide the design of more effective interventions, and enable evidence-based policy dialogue. Upscaling and mainstreaming IE into ADB operations require additional resources. These resources are needed to initiate DMC awareness raising and capacity building, and to provide seed funds to initiate start-up of new and highly selective IEs with aim to promote and expand IE activities. All departments are expected to have a direct or indirect role in an IE initiative, but the key implementing role is recognized to lie with the RDs, with technical support from ERD. As such, a RETA was selected as the appropriate modality. Designing and implementing IE studies is a complex undertaking and is not necessary or feasible for every project. The proposed TA will design and implement (or initiate implementation of) IEs of strategically selected project interventions so as to develop the knowledge base required to sharpen ADB's development effectiveness. The TA will be an important step toward implementing the initial ADB Impact Evaluation Work Program (2009 2010).

Development Impact

Impact evaluation firmly established in ADB operations.

Project Outcome

Description of Outcome
Impact evaluation piloted in each regional department with an effective centralized technical support system.
Progress Towards Outcome
5 IE studies are ongoing, one for each RD. Advice on project design and implementation is provided on a continuing basis. An IE guidebook is planned to be produced in late 2013 to mid 2014.

Outputs and Implementation Progress

Description of Project Outputs
1. ADB staff and DMC counterparts understand impact evaluation concepts and practices. 2. Impact evaluation methodology guidelines selected, advice provided to ADB staff and DMC counterparts on project design and implementation, and at least five new impact evaluation projects implemented 3. Lessons from pilot activities presented to Management and disseminated within ADB and DMCs
Status of Implementation Progress (Outputs, Activities, and Issues)
A training workshop will be held in November 2013
Status of Development Objectives
Material Changes

Business Opportunities

Date of First Listing 2010 Sep 02
Consulting Services
Although the exact requirements of the type of expertise and the length of their inputs will only be known during the implementation of the individual studies, it is envisaged that the TA will require about 18 person-months of international and 25 person-months of national consultant services. Given this limitation and the intermittent nature of assignments and anticipated variety of expertise required, the TA will primarily fulfill its consulting requirements by recruiting experts on an individual basis. If the studies require involvement of a research institution, the recruitment will be based on the Consultants Qualification Selection (CQS). On an exceptional basis, and where the subproject selections result in a country context where only one research institution can provide the required expertise, the recruitment will be conducted on a single-source selection (SSS) basis. All consultants, individual and research institutions, will be engaged in accordance with ADB s Guidelines on the Use of Consultants (2010, as amended from time to time).
Procurement
Procurement of equipment (computer hardware and software) by ADB will be in accordance with its Procurement Guidelines (2010, as amended from time to time) and in coordination with ADB s Office of Information Systems and Technology, and the Office of Administrative Services. At TA completion, any equipment procured will be disposed off in accordance with project administration instructions.
Procurement and Consulting Notices
http://www.adb.org/projects/44353-012/business-opportunities

Timetable

Concept Clearance 26 Aug 2010
Fact-finding 28 Feb 2010 to 13 Mar 2010
Management Review Meeting
Approval 07 Dec 2010
Last Review Mission

Milestones

Approval No. Approval Signing Effectivity Closing
Original Revised Actual
Technical Assistance 7680 07 Dec 2010 07 Dec 2010 31 Oct 2012 30 Sep 2015

Utilization

Date Approval Number ADB (US$ thousand) Others (US$ thousand) Net Percentage
Cumulative Contract Awards
Cumulative Disbursements

TA Amount (US$ thousand)

Approval Number Approved Amount Revised Amount Total Commitment Uncommitted Balance Total Disbursement Undisbursed Balance
Technical Assistance 7680 1,000 1,000 969 31 595 405

Contacts and Update Details

Responsible ADB Officer Sakiko Tanaka (sakikotanaka@adb.org)
Responsible ADB Department Economics and Research Department
Responsible ADB Divisions Economic Analysis and Operations Support Division
Executing Agencies Asian Development Bank

Links

Project Website http://www.adb.org/projects/44353-012/main
List of Project Documents http://www.adb.org/projects/44353-012/documents