Regional : Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1
The Subproject 1 TA aims to mainstream impact evaluation (IE) to improve the development effectiveness of project and policy interventions in Asian Development Bank developing member countries (DMCs). The TA will support (i) the conduct of atleast five IE study phases/surveys applying various methodologies and survey instruments, and (ii) the development of IE awareness and capacity among the DMCs.
Economic Research and Regional Cooperation Department
Request for information
- Public sector management
|Project Name||Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1|
|Country / Economy||Regional
China, People's Republic of
|Project Type / Modality of Assistance||Technical Assistance
|Source of Funding / Amount||
|Operational Priorities||OP1: Addressing remaining poverty and reducing inequalities
OP2: Accelerating progress in gender equality
OP3: Tackling climate change, building climate and disaster resilience, and enhancing environmental sustainability
OP5: Promoting rural development and food security
|Sector / Subsector||
Agriculture, natural resources and rural development / Agricultural policy, institutional and capacity development
Education / Education sector development
Energy / Energy sector development and institutional reform
Finance / Inclusive finance
Public sector management / Social protection initiatives
Transport / Transport policies and institutional development
|Gender||Some gender elements|
|Description||The Subproject 1 TA aims to mainstream impact evaluation (IE) to improve the development effectiveness of project and policy interventions in Asian Development Bank developing member countries (DMCs). The TA will support (i) the conduct of atleast five IE study phases/surveys applying various methodologies and survey instruments, and (ii) the development of IE awareness and capacity among the DMCs.|
|Project Rationale and Linkage to Country/Regional Strategy||Impact evaluation is essential to strengthen ADB's Strategy 2030 ambition to be a knowledge provider. The development profession has increasingly recognized the need for rigorous IE methodologies (including randomized experiments and appropriate econometric approaches) to isolate the effects of interventions from those of confounding factors. Recognizing the value of IE, ERCD under its first IE TA cluster (CTA 0012) initiated many studies. However, few have been brought to completion so far because IEs often require multiple surveys spanning prior and post project implementation. Initiated studies have also not all had consistent technical oversight from regional departments (RDs), which do not all have staff with background in IE. Under this new TA, more effective mainstreaming and continued support will be provided to ensure that promising initiated studies from CTA 0012 are completed, while new IE studies are initiated. TA support to conduct IE studies will be further improved by focusing support more strategically to add value to operations. This includes (i) adopting nimble approaches for IEs to be completed in shorter periods, (ii) targeting under-studied themes, and (iii) supporting IE of pilot interventions under consideration for future investments. Thus, additional resources will be required to (i) support ongoing IE studies for completion; (ii) support new IE studies; (iii) disseminate study findings and lessons; and (iv) contribute to capacity building of DMC stakeholders. The TA will ensure that financial resources are accompanied by appropriate technical expertise and oversight via more of a 'One ADB approach, in which research economists from ERCD can be fully engaged in studies, along with global experts.|
Enhanced knowledge has improved the development effectiveness of ADB finance and partnerships.
|Description of Outcome||
Consideration of evidence on the effectiveness of interventions in ADB operations and discussions informing DMC policies expanded.*
*Impact evaluation has three main outcome pathways: 1) direct pathway of study findings informing the design of similar subsequent projects; 2) process pathway of interaction between the impact evaluation and project teams leading to improvements prior to any findings; and 3) broader conceptual pathway in which findings inform other research and discussions to influence policies in a range of contexts and countries. The third pathway is often the most important over the long term, but is also difficult to track or predict in the short term, so it has no direct target.
|Progress Toward Outcome|
|Description of Project Outputs||
Impact evaluation studies conducted
IE awareness and capacity enhanced
|Status of Implementation Progress (Outputs, Activities, and Issues)||
- Nine impact evaluation studies are ongoing covering a wide range of sectors, including agriculture, education, energy, social protection, and transport, and are spread across 7 countries encompassing every ADB region
- Two impact evaluation training workshops conducted for Indonesia and Pakistan
- Maintenance of IE portal for repository, internal dissemination, and knowledge sharing
|Geographical Location||Bangladesh - Nation-wide; China - Nation-wide; Fiji - Nation-wide; Pakistan - Nation-wide; Philippines - Nation-wide|
|Summary of Environmental and Social Aspects|
|Stakeholder Communication, Participation, and Consultation|
|During Project Design|
|During Project Implementation|
Each of the IE studies will require a team of consultants, both international and national, to be engaged separately. The consultants will (i) provide technical guidance and feedback on the initial IE concept, (ii) develop the design of the IE studies together with the ADB team, (iii) assist in guiding and overseeing the implementation of IE studies, (iv) assist in survey and sampling design, (v) implement the surveys, and (vi) assist in data analysis and report preparation. In addition, other consultants will need to backstop activities beyond the individual studies (including Output 2, as well as overall support to Output 1), by supporting outreach, helping to monitor and improve IE efforts by the study teams, ensuring that ADB knowledge products are generated from studies, preparing synthesis reports, and contributing to capacity building.
Consequently, the TA will require the services of a mix of individual consultants and firms. Requisite fields of expertise and cost estimates of consulting services will be finalized upon selection and approval of IE proposals by the IEC. Support beyond individual IE studies by international IE experts and editors and national research associates, project coordinators, and layout artists will be through individual consulting services. The precise composition of firms and individual consultants for IE studies funded under Output 1 will depend on the proposals approved by the IEC. Some studies may contract specific roles through individual consultant selection or framework agreements, supplemented by nonconsulting services for data. Others may be contracted to firms via selection methods defined based on the resource needs of the IE studies. Purchase of goods, data and IT equipment within consulting contracts will be allowed if justified to be cost-effective and approved by ADB. Subject to approval of the Procurement, Portfolio, and Financial Management Department, single source selection will be utilized when the proposed engagement is a continuation of previously initiated work and/or there is only one firm with capacity to deliver the proposed IE tasks. The consultants will be engaged in accordance with the ADB Procurement Policy 2017, as amended from time to time and the associated project administration instructions and/or staff instructions.
|Procurement||Procurement will follow the ADB Procurement Policy (2017, as amended from time to time), the Procurement Regulations for ADB Borrowers (2017, as amended from time to time) and Staff Instructions for TA Procurement of Goods, Works and Nonconsulting Services. Nonconsulting services for separately contracted data collection will be procured using open advertisement or request for quotation. Procurement of equipment will take place in coordination with ADB's Office of Information Systems and Technology and Office of Administrative Services. When the TA is completed, any procured equipment will remain ADB property and/or will be disposed of in accordance with relevant ADB guidelines. Disbursements under the TA will be made in accordance with ADB's Technical Assistance Disbursement Handbook (2010, as amended from time to time).|
|Responsible ADB Officer||Yamano, Takashi|
|Responsible ADB Department||Economic Research and Regional Cooperation Department|
|Responsible ADB Division||Economic Analysis and Operations Support Division|
Asian Development Bank
|Fact Finding||18 Oct 2019 to 18 Oct 2019|
|Approval||19 Dec 2019|
|Last Review Mission||-|
|Last PDS Update||28 Oct 2021|
|Approval||Signing Date||Effectivity Date||Closing|
|19 Dec 2019||-||19 Dec 2019||30 Nov 2024||-||-|
|Financing Plan/TA Utilization||Cumulative Disbursements|
|1,500,000.00||0.00||0.00||0.00||0.00||0.00||1,500,000.00||25 May 2023||641,630.90|
Project Data Sheets (PDS) contain summary information on the project or program. Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.
The Access to Information Policy (AIP) recognizes that transparency and accountability are essential to development effectiveness. It establishes the disclosure requirements for documents and information ADB produces or requires to be produced.
The Accountability Mechanism provides a forum where people adversely affected by ADB-assisted projects can voice and seek solutions to their problems and report alleged noncompliance of ADB's operational policies and procedures.
In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area.
|Title||Document Type||Document Date|
|Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1: Impact Evaluation of the Graduation of the Ultra-Poor Pilot in the Philippines||Consultants' Reports||Apr 2022|
|Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1: Technical Assistance Subproject Report||TA Subproject Proposal||Dec 2019|
Safeguard Documents See also: Safeguards
Safeguard documents provided at the time of project/facility approval may also be found in the list of linked documents provided with the Report and Recommendation of the President.
None currently available.
Evaluation Documents See also: Independent Evaluation
None currently available.
None currently available.
The Access to Information Policy (AIP) establishes the disclosure requirements for documents and information ADB produces or requires to be produced in its operations to facilitate stakeholder participation in ADB's decision-making. For more information, refer to the Safeguard Policy Statement, Operations Manual F1, and Operations Manual L3.
Requests for information may also be directed to the InfoUnit.
ADB-funded livelihood program helps lift households out of extreme poverty in the PhilippinesADB and other partners launched a project in the Philippines using the graduation approach to provide poor and vulnerable households in Negros Occidental province with livelihoods.
|Tender Title||Type||Status||Posting Date||Deadline|
|National Consultant on Smart Metering||Individual - Consulting||Closed|
|Project Coordinator||Individual - Consulting||Closed|
|Impact Evaluation Specialist||Individual - Consulting||Closed|
|Research Associate for PHI Edtech Solutions for Last Mile Schools in COVID-19||Individual - Consulting||Closed|
|Career Guidance Video Production in Bhutan||Firm - Consulting||Closed|
|Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1||Firm - Consulting||Closed|
|Contract Title||Approval Number||Contract Date||Contractor | Address||Executing Agency||Total Contract Amount (US$)||Contract Amount Financed by ADB (US$)|
|Research and Developme||Technical Assistance 9940||10 Mar 2021||Pricewaterhousecoopers Pvt. Ltd. (IND)(INDIA) | 8-2-624/A/1, 4th Floor, Road No.10, Banj Hyderabad, Andhra Pradesh 500 034 India||Asian Development Bank||133,061.00||—|
None currently available.