Regional: Developing Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries (Subproject 1)

Sovereign Project | 46185-002

Summary

Impact evaluation (IE) is a cross-cutting theme that is relevant in all countries, sectors, and regions. Conducting impact evaluation for strategically selected interventions will help improve relevance and effectiveness of country and regional partnership strategies. Properly implemented impact evaluations will help in the proper selection of a strategic mix of effective interventions. By implementing impact evaluations of development interventions in the Asia-Pacific region, the proposed cluster TA will contribute to the creation of knowledge on what works in development, how it works, and why.

Latest Project Documents

No documents of this type are currently available for this project.

Consulting Notices

See also: CMS

No notices are currently available for this project.

Procurement Notices

See also: Operational Procurement

No notices are currently available for this project.

Procurement Documents

No documents of this type are currently available for this project.


Project Data Sheets (PDS) contain summary information on the project or program. Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.

The Public Communications Policy (PCP) recognizes that transparency and accountability are essential to development effectiveness. It establishes the disclosure requirements for documents and information ADB produces or requires to be produced.

The Accountability Mechanism provides a forum where people adversely affected by ADB-assisted projects can voice and seek solutions to their problems and report alleged noncompliance of ADB's operational policies and procedures.

In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area.

Project Name Developing Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries (Subproject 1)
Project Number 46185-002
Country Regional
Project Status Approved
Project Type / Modality of Assistance Technical Assistance
Source of Funding / Amount
TA 8332-REG: Developing Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries (Subproject 1)
Technical Assistance Special Fund US$ 1.50 million
Strategic Agendas Inclusive economic growth
Drivers of Change Governance and capacity development
Private sector development
Sector / Subsector Public sector management - Economic affairs management
Gender Equity and Mainstreaming
Description

Impact evaluation (IE) is a cross-cutting theme that is relevant in all countries, sectors, and regions. Conducting impact evaluation for strategically selected interventions will help improve relevance and effectiveness of country and regional partnership strategies. Properly implemented impact evaluations will help in the proper selection of a strategic mix of effective interventions. By implementing impact evaluations of development interventions in the Asia-Pacific region, the proposed cluster TA will contribute to the creation of knowledge on what works in development, how it works, and why.

The proposed cluster TA will comprise three sub-projects with each sub-project covering 4 to 5 impact evaluation studies, or a total of 12 to 15 studies distributed over the five regional departments. By the end of the proposed TA, impact evaluation will have been mainstreamed in ADB operations, i.e., it is envisioned that impact evaluation is incorporated in the design of ADB s investment projects, especially in project preparatory technical assistance (PPTA) projects.

Sub-projects

Each subproject will include 4 to 5 impact evaluation studies and will comprise two main components, namely, (a) the conduct of IE studies applying various methodologies and survey instruments, and (b) the development of impact evaluation methodologies, approaches, and capacities in both ADB and the DMCs.

(a) Conduct of IE studies

The IE studies component will cover support to conduct of a number of IE studies while ensuring that at least one study will be supported in each of the five regions (Central and West Asia, East Asia, the Pacific, South Asia, and Southeast Asia). Activities under the individual studies may include design of the study methodology and survey instruments; conduct of baseline, mid-line and end-line surveys; and production of the study reports. The proposed TA will endeavor to support the conduct of full IE studies from beginning to end within the timeframe of the proposed TA. However, as learned from the experience of TA 7680, the TA may support key phases of individual studies; for example, as to be approved by the IE Committee, only the design and conduct of the baseline survey may be implemented under the proposed TA, while the mid-line and end-line surveys can be financed through separate initiatives. Through this component, the TA will provide direct technical support by individual and firm consultants, and ERD specialists to individual studies by advising on study design, methodology, and application in all phases of the study. This technical support will also include partnerships with renowned IE research institutes (e.g., International Initiative for Impact Evaluation or the Jameel Lateef Poverty Action Lab) to provide expertise, as well as ground-level support for DMCs in the design of IE frameworks and methodologies (e.g., visits to project sites, pre-testing of survey instruments, and other fieldwork activities).

(b) Development of impact evaluation methodologies, approaches, and capacities

The second component on development of IE-methodologies, approaches and capacities will entail a number of activities including (i) review of IE methodologies and adoption of available techniques and tools for sector and theme specific studies; (ii) conduct of pilot studies to test sector- or theme-specific techniques and tools; (iii) IE awareness raising and capacity building for DMC officials and project staff; (iv) establishment of a central IE data source containing information on project baseline, mid-line and end-line surveys (e.g., questionnaires, sampling methodology, interviewer manuals, field data, etc.); and (v) conduct of knowledge-sharing activities (i.e., regional conferences, where IE studies conducted will be presented; workshops and seminars, where experts will be invited to share methods, practices and lessons on IE) and dissemination of IE studies (publishing IE studies for distribution to ADB and government counterparts, and uploading studies in the ADB website).

Project Rationale and Linkage to Country/Regional Strategy

Bilateral and multilateral development agencies spend more than $30 billion each year on social development programs, with developing countries spending another $300 billion annually. However, the development effectiveness of this spending is not always clear, and evidence on their impact, if they are available, is scant. In particular, it is not clearly known how much of Asia s recent improvements in poverty reduction and human capital outcomes have been due to development spending and how much are trickle-down effects of the region s rapid economic growth. This lack of information limits the ability of policy makers and development partners to further improve effectiveness of the development spending through proper design of programs and projects.

ADB has supported its developing member countries (DMCs) in designing, financing, and implementing project and policy interventions aimed at fostering economic development and reducing poverty in the region. ADB's economic sector work, cost benefit analysis and past effort at benefit monitoring and evaluation, as well as design and monitoring frameworks and social safeguard requirements, collect information that provide a basis for identifying project performance ex-ante and ex-post. While these are useful exercises in designing projects and monitoring their performance, they do not necessarily identify the actual impacts of ADB s development support. Although it may not be possible to identify specific impacts of development spending at the macro level, it is possible to do so at the project level through the use of rigorous impact evaluation (IE) studies.

Thus, mainstreaming IE in ADB operations is highly beneficial not only for the Bank but also, and more importantly, for DMCs. Gaining accuracy in the evaluation of interventions will permit policymakers in DMCs and ADB to anticipate the expected consequences of these interventions. In this way, IE will allow DMCs and ADB to allocate limited resources more efficiently, guide the design of more effective interventions, and enhance evidence-based policy dialogue.

Impact Improved development effectiveness of ADB-designed projects responsive to the development needs of DMCs
Project Outcome
Description of Outcome Impact evaluation is mainstreamed in ADB operations
Progress Toward Outcome
Implementation Progress
Description of Project Outputs

1. Impact evaluation studies adopting appropriate methodology with effective technical support

2. Impact evaluation awareness-raising seminars and capacity building workshops for ADB staff and DMC officials

3. Reports and dissemination workshops on lessons learned from review of methodologies and conduct of pilot studies

Status of Implementation Progress (Outputs, Activities, and Issues)
Geographical Location
Summary of Environmental and Social Aspects
Environmental Aspects
Involuntary Resettlement
Indigenous Peoples
Stakeholder Communication, Participation, and Consultation
During Project Design

Each study team may work in close collaboration with the concerned government agencies, both oversight agencies and project/intervention implementation units.

This technical support will also include partnerships with renowned IE research institutes (e.g., International Initiative for Impact Evaluation or the Jameel Lateef Poverty Action Lab) to provide expertise, as well as ground-level support for DMCs in the design of IE frameworks and methodologies.

During Project Implementation
Business Opportunities
Consulting Services

Each of the impact evaluation studies will require a team of consultants, both international and national, to be engaged separately. The consultants will (i) provide technical guidance and feedback on the evaluation studies, (ii) develop the design of the impact evaluation studies together with the ADB team, (iii) assist in guiding and overseeing the implementation of impact evaluation studies, (iv) assist in survey designs, (v) implement the surveys, and (vi) assist in data analysis and report evaluation. Cost estimates for consulting services will be prepared in consultation with the divisions implementing the individual impact evaluation studies. Consultant packages for each impact evaluation study will comprise both firms and individuals, as appropriate. About 21 person-months of international and 45 person-months of national consulting services will be required for Subproject 1. Consultants will be engaged by ADB in accordance with its Guidelines on the Use of Consultants (2010, as amended from time to time).

The following are the required consulting services:

A. International Consulting Services:

1. Impact evaluation advisor (5 person-months, intermittent)

2. International impact evaluation specialists (11 person-months, intermittent)

3. Copy editor (2.5 person-month)

4. Impact evaluation trainers (2.5 person-month, intermittent)

B. National Consulting Services:

1. National impact evaluation specialists (20 person-months, intermittent)

2. Project coordinator (25 person-months, intermittent)

3. Research assistants (as needed)

Procurement Procurement of equipment (computer hardware and software) by ADB will be in accordance with ADB's Procurement Guidelines (2010, as amended from time to time). Procurement will take place in coordination with ADB's Office of Information Systems and Technology and Office of Administrative Services. When the C-TA is completed, any procured equipment will remain ADB property and/or will be disposed of in accordance with PAIs concerned. Disbursements under the C-TA will be made in accordance with ADB's Technical Assistance Disbursement Handbook (2010, as amended from time to time).
Responsible ADB Officer Sakiko Tanaka
Responsible ADB Department Economic Research and Regional Cooperation Department
Responsible ADB Division Economic Analysis and Operations Support Division
Executing Agencies
Asian Development Bank6 ADB Avenue, Mandaluyong
Metro Manila, Philippines
P.O. Box 789, 1099 Manila,
Philippines
Timetable
Concept Clearance -
Fact Finding -
MRM -
Approval 25 Feb 2013
Last Review Mission -
Last PDS Update 18 Mar 2013

TA 8332-REG

Milestones
Approval Signing Date Effectivity Date Closing
Original Revised Actual
25 Feb 2013 - 25 Feb 2013 31 Jan 2015 30 Sep 2016 -
Financing Plan/TA Utilization Cumulative Disbursements
ADB Cofinancing Counterpart Total Date Amount
Gov Beneficiaries Project Sponsor Others
1,500,000.00 0.00 0.00 0.00 0.00 0.00 1,500,000.00 25 Feb 2013 335,669.55

No documents found.

Safeguard Documents

See also: Safeguards

No documents found.

Evaluation Documents

See also: Independent Evaluation

No documents found.


The Public Communications Policy (PCP) establishes the disclosure requirements for documents and information ADB produces or requires to be produced in its operations to facilitate stakeholder participation in ADB's decision-making. For more information, refer to the Safeguard Policy Statement, Operations Manual F1, and Operations Manual L3.

Requests for information may also be directed to the InfoUnit.