Project Data Sheets (PDS) contain summary information on the project or program: Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.
| PDS Creation Date | – |
| PDS Updated as of | 18 Apr 2013 |
| Project Name | Implementing Impact Evaluation at ADB |
| Country |
Regional |
| Project/Program Number | 44353-012 |
| Status | Approved |
| Geographical Location | 1 or 2 projects in each subregion (Central and West Asia, East Asia, Pacific, South Asia, Southeast Asia) |
| In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area. | |
| Sector and/or Subsector Classification | Public sector management / Economic and Public Affairs Management |
| Thematic Classification | Economic growth Social development |
| Gender Mainstreaming Categories | Some gender benefits |
| Type/Modality of Assistance | Approval Number | Source of Funding | Approved Amount (thousand) |
|---|---|---|---|
| Technical Assistance | 7680 | Technical Assistance Special Fund | 1,000 |
| TOTAL | US$ 1,000 | ||
| Environmental Aspects – |
| Involuntary Resettlement – |
| Indigenous Peoples – |
| During Project Design – |
| During Project Implementation – |
| The outputs of the TA will include (i) at least 5 impact evaluation studies (1 to 2 per RD) with published case study illustrations on the IE studies, (ii) IE awareness building and capacity development for DMC officials and ADB staff, and awareness building for Management; and (iii) provision of technical support to RDs in selecting and implementing IE interventions. The TA will provide financial and technical support for selected IE interventions. |
| Bilateral and multilateral development agencies spend billions of dollars each year supporting development programs, and developing countries spend many times more on programs from their own resources. There is a substantial amount of empirical work on, for example, the effects of economic growth and human capital development on poverty reduction. However, evidence on the development effectiveness of individual projects and programs is limited. In particular, questions often remain on whether a given intervention produced its intended benefits, by how much, and how efficiently such intervention contributed to the intended outcomes and impacts. Unless the evidence of project and program impact is available, it is not possible to adequately inform policy makers and development partners as to how further assistance can be more effectively designed and implemented. While a number of multilateral and bilateral development institutions have introduced programs to institutionalize IE analyses, ADB lags behind. Since its establishment, ADB has supported its developing member countries (DMCs) in designing, financing, and implementing project and policy interventions aimed at fostering economic development and reducing poverty in the region. ADB's routine economic sector work, cost-benefit analysis, and project performance monitoring, as well as project completion and self-evaluation exercises currently provide the basis for identifying project outcomes and impacts ex-ante and ex-post. The ex-ante analysis used in ADB for identifying causal links between development interventions, outcome and impact is relatively comprehensive. Monitoring of implementation progress and processes, especially inputs and outputs, is also attended through project performance reporting system. However, once projects are completed, the ex-post assessment of the causal links between outputs, outcomes and impact is often limited by the absence of carefully constructed counterfactuals, which are needed to assess of what would have happened to beneficiaries in absence of the interventions. Often, evaluations at project completion are conducted on the basis of monitoring of partial indicators, which may lead to selection bias due to focus on available rather than needed data. The lack of good counterfactuals and baselines also leads to reliance on qualitative assessments and identification of ADB contribution rather than attribution, limiting the accountability for development outcomes. IED evaluates projects following their completion, but the extent to which it can carry out impact evaluations is limited by the availability of reliable counterfactuals and baseline surveys. It is recognized that good counterfactual identification and baselines surveys are best started at the beginning of the project cycle as part of project monitoring and evaluation system, as then these can be used to carry out the IEs at, to the extent possible, project mid-term and at project completion. As such, IEs should be implemented by RDs responsible for operations. ADB recognizes the need to more systematically measure outcomes and impact as a way of strengthening the management of effective development. This issue was also underscored by member countries in General Capital Increase (GCI V) and Asian Development Fund (ADF X) discussions. In response ADB has taken actions toward upscaling and mainstreaming IE. Better measurement of the outcome and impact of ADB interventions will help the institution and DMC policy makers to assess the consequences of the development initiatives and help allocate limited resources more efficiently, guide the design of more effective interventions, and enable evidence-based policy dialogue. Upscaling and mainstreaming IE into ADB operations require additional resources. These resources are needed to initiate DMC awareness raising and capacity building, and to provide seed funds to initiate start-up of new and highly selective IEs with aim to promote and expand IE activities. All departments are expected to have a direct or indirect role in an IE initiative, but the key implementing role is recognized to lie with the RDs, with technical support from ERD. As such, a RETA was selected as the appropriate modality. Designing and implementing IE studies is a complex undertaking and is not necessary or feasible for every project. The proposed TA will design and implement (or initiate implementation of) IEs of strategically selected project interventions so as to develop the knowledge base required to sharpen ADB's development effectiveness. The TA will be an important step toward implementing the initial ADB Impact Evaluation Work Program (2009 2010). |
| Impact evaluation firmly established in ADB operations. |
| Description of Outcome Impact evaluation piloted in each regional department with an effective centralized technical support system. |
Progress Towards Outcome – |
| Description of Project Outputs 1. ADB staff and DMC counterparts understand impact evaluation concepts and practices. 2. Impact evaluation methodology guidelines selected, advice provided to ADB staff and DMC counterparts on project design and implementation, and at least five new impact evaluation projects implemented 3. Lessons from pilot activities presented to Management and disseminated within ADB and DMCs |
Status of Implementation Progress (Outputs, Activities, and Issues) – |
| Status of Development Objectives – |
Material Changes – |
| Date of First Listing | 2010 Sep 02 |
| Consulting Services Although the exact requirements of the type of expertise and the length of their inputs will only be known during the implementation of the individual studies, it is envisaged that the TA will require about 18 person-months of international and 25 person-months of national consultant services. Given this limitation and the intermittent nature of assignments and anticipated variety of expertise required, the TA will primarily fulfill its consulting requirements by recruiting experts on an individual basis. If the studies require involvement of a research institution, the recruitment will be based on the Consultants Qualification Selection (CQS). On an exceptional basis, and where the subproject selections result in a country context where only one research institution can provide the required expertise, the recruitment will be conducted on a single-source selection (SSS) basis. All consultants, individual and research institutions, will be engaged in accordance with ADB s Guidelines on the Use of Consultants (2010, as amended from time to time). |
|
| Procurement Procurement of equipment (computer hardware and software) by ADB will be in accordance with its Procurement Guidelines (2010, as amended from time to time) and in coordination with ADB s Office of Information Systems and Technology, and the Office of Administrative Services. At TA completion, any equipment procured will be disposed off in accordance with project administration instructions. |
|
| Procurement and Consulting Notices http://www.adb.org/projects/44353-012/business-opportunities |
|
| Concept Clearance | 26 Aug 2010 |
| Fact-finding | 28 Feb 2010 to 13 Mar 2010 |
| Management Review Meeting | – |
| Approval | 07 Dec 2010 |
| Last Review Mission | – |
| Approval No. | Approval | Signing | Effectivity | Closing | ||
| Original | Revised | Actual | ||||
| Technical Assistance 7680 | 07 Dec 2010 | – | 07 Dec 2010 | 31 Oct 2012 | 31 Dec 2013 | – |
| Date | Approval Number | ADB (US$ thousand) | Others (US$ thousand) | Net Percentage |
| Cumulative Contract Awards | ||||
| Cumulative Disbursements | ||||
| Approval Number | Approved Amount | Revised Amount | Total Commitment | Uncommitted Balance | Total Disbursement | Undisbursed Balance |
| Technical Assistance 7680 | 1,000 | 1,000 | 483 | 517 | 400 | 600 |
| Responsible ADB Officer | Sakiko Tanaka (sakikotanaka@adb.org) |
| Responsible ADB Department | Economics and Research Department |
| Responsible ADB Divisions | Economic Analysis and Operations Support Division |
| Executing Agencies |
Asian Development Bank |
| Project Website | http://www.adb.org/projects/44353-012/main |
| List of Project Documents | http://www.adb.org/projects/44353-012/documents |