fbpx 53343-002: Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1 | Asian Development Bank

Regional: Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1

Sovereign (Public) Project | 53343-002 Status: Active

The Subproject 1 TA aims to mainstream impact evaluation (IE) to improve the development effectiveness of project and policy interventions in Asian Development Bank developing member countries (DMCs). The TA will support (i) the conduct of atleast five IE study phases/surveys applying various methodologies and survey instruments, and (ii) the development of IE awareness and capacity among the DMCs.

Project Details

Project Officer
Yamano, Takashi Economic Research and Regional Cooperation Department Request for information
Country
  • Regional
Sector
  • Public sector management
 
Project Name Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1
Project Number 53343-002
Country Regional
Bangladesh
Fiji
Pakistan
Philippines
China, People's Republic of
Project Status Active
Project Type / Modality of Assistance Technical Assistance
Source of Funding / Amount
TA 9940-REG: Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1
Technical Assistance Special Fund US$ 1.50 million
Strategic Agendas Environmentally sustainable growth
Inclusive economic growth
Drivers of Change Gender Equity and Mainstreaming
Knowledge solutions
Sector / Subsector

Agriculture, natural resources and rural development / Agricultural policy, institutional and capacity development

Education / Education sector development

Energy / Energy sector development and institutional reform

Finance / Inclusive finance

Public sector management / Social protection initiatives

Transport / Transport policies and institutional development

Gender Equity and Mainstreaming Some gender elements
Description The Subproject 1 TA aims to mainstream impact evaluation (IE) to improve the development effectiveness of project and policy interventions in Asian Development Bank developing member countries (DMCs). The TA will support (i) the conduct of atleast five IE study phases/surveys applying various methodologies and survey instruments, and (ii) the development of IE awareness and capacity among the DMCs.
Project Rationale and Linkage to Country/Regional Strategy Impact evaluation is essential to strengthen ADB's Strategy 2030 ambition to be a knowledge provider. The development profession has increasingly recognized the need for rigorous IE methodologies (including randomized experiments and appropriate econometric approaches) to isolate the effects of interventions from those of confounding factors. Recognizing the value of IE, ERCD under its first IE TA cluster (CTA 0012) initiated many studies. However, few have been brought to completion so far because IEs often require multiple surveys spanning prior and post project implementation. Initiated studies have also not all had consistent technical oversight from regional departments (RDs), which do not all have staff with background in IE. Under this new TA, more effective mainstreaming and continued support will be provided to ensure that promising initiated studies from CTA 0012 are completed, while new IE studies are initiated. TA support to conduct IE studies will be further improved by focusing support more strategically to add value to operations. This includes (i) adopting nimble approaches for IEs to be completed in shorter periods, (ii) targeting under-studied themes, and (iii) supporting IE of pilot interventions under consideration for future investments. Thus, additional resources will be required to (i) support ongoing IE studies for completion; (ii) support new IE studies; (iii) disseminate study findings and lessons; and (iv) contribute to capacity building of DMC stakeholders. The TA will ensure that financial resources are accompanied by appropriate technical expertise and oversight via more of a _One ADB_ approach, in which research economists from ERCD can be fully engaged in studies, along with global experts.
Impact Enhanced knowledge has improved the development effectiveness of ADB finance and partnerships.
Project Outcome
Description of Outcome

Consideration of evidence on the effectiveness of interventions in ADB operations and discussions informing DMC policies expanded.*

*Impact evaluation has three main outcome pathways: 1) direct pathway of study findings informing the design of similar subsequent projects; 2) process pathway of interaction between the impact evaluation and project teams leading to improvements prior to any findings; and 3) broader conceptual pathway in which findings inform other research and discussions to influence policies in a range of contexts and countries. The third pathway is often the most important over the long term, but is also difficult to track or predict in the short term, so it has no direct target.

Progress Toward Outcome
Implementation Progress
Description of Project Outputs

Impact evaluation studies conducted

IE awareness and capacity enhanced

Status of Implementation Progress (Outputs, Activities, and Issues)
Geographical Location Bangladesh - Nation-wide; China - Nation-wide; Fiji - Nation-wide; Pakistan - Nation-wide; Philippines - Nation-wide
Summary of Environmental and Social Aspects
Environmental Aspects
Involuntary Resettlement
Indigenous Peoples
Stakeholder Communication, Participation, and Consultation
During Project Design
During Project Implementation
Business Opportunities
Consulting Services

Each of the IE studies will require a team of consultants, both international and national, to be engaged separately. The consultants will (i) provide technical guidance and feedback on the initial IE concept, (ii) develop the design of the IE studies together with the ADB team, (iii) assist in guiding and overseeing the implementation of IE studies, (iv) assist in survey and sampling design, (v) implement the surveys, and (vi) assist in data analysis and report preparation. In addition, other consultants will need to backstop activities beyond the individual studies (including Output 2, as well as overall support to Output 1), by supporting outreach, helping to monitor and improve IE efforts by the study teams, ensuring that ADB knowledge products are generated from studies, preparing synthesis reports, and contributing to capacity building.

Consequently, the TA will require the services of a mix of individual consultants and firms. Requisite fields of expertise and cost estimates of consulting services will be finalized upon selection and approval of IE proposals by the IEC. Support beyond individual IE studies by international IE experts and editors and national research associates, project coordinators, and layout artists will be through individual consulting services. The precise composition of firms and individual consultants for IE studies funded under Output 1 will depend on the proposals approved by the IEC. Some studies may contract specific roles through individual consultant selection or framework agreements, supplemented by nonconsulting services for data. Others may be contracted to firms via selection methods defined based on the resource needs of the IE studies. Purchase of goods, data and IT equipment within consulting contracts will be allowed if justified to be cost-effective and approved by ADB. Subject to approval of the Procurement, Portfolio, and Financial Management Department, single source selection will be utilized when the proposed engagement is a continuation of previously initiated work and/or there is only one firm with capacity to deliver the proposed IE tasks. The consultants will be engaged in accordance with the ADB Procurement Policy 2017, as amended from time to time and the associated project administration instructions and/or staff instructions.

Procurement Procurement will follow the ADB Procurement Policy (2017, as amended from time to time), the Procurement Regulations for ADB Borrowers (2017, as amended from time to time) and Staff Instructions for TA Procurement of Goods, Works and Nonconsulting Services. Nonconsulting services for separately contracted data collection will be procured using open advertisement or request for quotation. Procurement of equipment will take place in coordination with ADB's Office of Information Systems and Technology and Office of Administrative Services. When the TA is completed, any procured equipment will remain ADB property and/or will be disposed of in accordance with relevant ADB guidelines. Disbursements under the TA will be made in accordance with ADB's Technical Assistance Disbursement Handbook (2010, as amended from time to time).
Responsible ADB Officer Yamano, Takashi
Responsible ADB Department Economic Research and Regional Cooperation Department
Responsible ADB Division Economic Analysis and Operations Support Division
Executing Agencies
Asian Development Bank
6 ADB Avenue,
Mandaluyong City 1550, Philippines
Timetable
Concept Clearance -
Fact Finding -
MRM -
Approval 19 Dec 2019
Last Review Mission -
Last PDS Update 16 Jan 2020

TA 9940-REG

Milestones
Approval Signing Date Effectivity Date Closing
Original Revised Actual
19 Dec 2019 - 19 Dec 2019 30 Nov 2024 - -
Financing Plan/TA Utilization Cumulative Disbursements
ADB Cofinancing Counterpart Total Date Amount
Gov Beneficiaries Project Sponsor Others
1,500,000.00 0.00 0.00 0.00 0.00 0.00 1,500,000.00 19 Dec 2019 0.00

Project Data Sheets (PDS) contain summary information on the project or program. Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.

The Access to Information Policy (AIP) recognizes that transparency and accountability are essential to development effectiveness. It establishes the disclosure requirements for documents and information ADB produces or requires to be produced.

The Accountability Mechanism provides a forum where people adversely affected by ADB-assisted projects can voice and seek solutions to their problems and report alleged noncompliance of ADB's operational policies and procedures.

In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area.

None currently available.

Safeguard Documents See also: Safeguards

Safeguard documents provided at the time of project/facility approval may also be found in the list of linked documents provided with the Report and Recommendation of the President.

None currently available.

Evaluation Documents See also: Independent Evaluation

None currently available.

Related Publications

None currently available.


The Access to Information Policy (AIP) establishes the disclosure requirements for documents and information ADB produces or requires to be produced in its operations to facilitate stakeholder participation in ADB's decision-making. For more information, refer to the Safeguard Policy Statement, Operations Manual F1, and Operations Manual L3.

Requests for information may also be directed to the InfoUnit.

Tenders

No tenders for this project were found.

Contracts Awarded

No contracts awarded for this project were found

Procurement Plan

None currently available.