Regional: Selected Evaluation Studies for 2013

Sovereign Project | 47068-001

Summary

This research and development technical assistance (RDTA) will cover a time slice of the 2013-2015 program cycle, with a focus on the studies initiated in 2013. It will fund select evaluations from both the operations (for example, country evaluations and sector assessments) and knowledge programs (e.g., special evaluation studies, impact evaluation study, and topical working papers) of the Board-approved work program. These include, but are not limited to, :

1. Country evaluations and country sector assessments. The RDTA will fund at least one country assistance program evaluation (CAPE), i.e. Tajikistan, as part of IED commitments in the 2013-2015 work program. The CAPE will provide ADB and the DMC with a basis for determining the future country partnership strategy. When appropriate, country sector assessments will be undertaken to provide inputs for the preparation of this CAPE and future such CAPEs (notably Indonesia, scheduled for 2014).

Latest Project Documents

Title Document Date
Selected Evaluation Studies for 2013 Mar 2013

Consulting Notices

See also: CMS

No notices are currently available for this project.

Procurement Notices

See also: Operational Procurement

No notices are currently available for this project.

Procurement Documents

No documents of this type are currently available for this project.


Project Data Sheets (PDS) contain summary information on the project or program. Because the PDS is a work in progress, some information may not be included in its initial version but will be added as it becomes available. Information about proposed projects is tentative and indicative.

The Public Communications Policy (PCP) recognizes that transparency and accountability are essential to development effectiveness. It establishes the disclosure requirements for documents and information ADB produces or requires to be produced.

The Accountability Mechanism provides a forum where people adversely affected by ADB-assisted projects can voice and seek solutions to their problems and report alleged noncompliance of ADB's operational policies and procedures.

In preparing any country program or strategy, financing any project, or by making any designation of, or reference to, a particular territory or geographic area in this document, the Asian Development Bank does not intend to make any judgments as to the legal or other status of any territory or area.

Project Name Selected Evaluation Studies for 2013
Project Number 47068-001
Country Regional
Project Status Approved
Project Type / Modality of Assistance Technical Assistance
Source of Funding / Amount
TA 8353-REG: Selected Evaluation Studies for 2013
Technical Assistance Special Fund US$ 1.95 million
Strategic Agendas Inclusive economic growth
Regional integration
Drivers of Change Governance and capacity development
Sector / Subsector

Agriculture, natural resources and rural development - Agricultural policy, institutional and capacity development

Education - Pre-primary and primary

Energy - Energy sector development and institutional reform

Finance - Finance sector development

Industry and trade - Trade and services

Public sector management - Public administration

Transport - Road transport (non-urban)

Gender Equity and Mainstreaming
Description

This research and development technical assistance (RDTA) will cover a time slice of the 2013-2015 program cycle, with a focus on the studies initiated in 2013. It will fund select evaluations from both the operations (for example, country evaluations and sector assessments) and knowledge programs (e.g., special evaluation studies, impact evaluation study, and topical working papers) of the Board-approved work program. These include, but are not limited to, :

1. Country evaluations and country sector assessments. The RDTA will fund at least one country assistance program evaluation (CAPE), i.e. Tajikistan, as part of IED commitments in the 2013-2015 work program. The CAPE will provide ADB and the DMC with a basis for determining the future country partnership strategy. When appropriate, country sector assessments will be undertaken to provide inputs for the preparation of this CAPE and future such CAPEs (notably Indonesia, scheduled for 2014).

2. Special Evaluation Study (SES) on Regional Cooperation and Integration and Related Operations. The SES will assess the design and implementation of the RCI Strategy since its inception in 2006 up until end-2013. A combination of secondary, project, and survey data and in-depth interviews will enable an assessment of the responsiveness, effectiveness and relevance of the RCI Strategy and the RCI-related elements of Strategy 2020 to draw out useful lessons for ADB's future operations.

3. SES on Implementation of the new Safeguards Policy. The SES will assess ADB safeguard operations since the SPS was adopted in 2009. It will include an in-depth review of the portfolio to discern trends in the application of the policy by region, income level, sector, and time. The evaluation will look into the staffing and resources of ADB to manage its Safeguards in its projects.

4. SES on ADB's Technical Assistance (TA) approach and methodology. The SES will assess the relevance, efficiency and effectiveness of ADB's TA in all its categories. The SES will: (i) review and assess ADB's guiding policy and implementation documents for TA (2008 policy paper and 2011 Operational Manual); (ii) review ADB's business processes for TA approval and implementation (including use of consultants); (iii) compare TA practices of ADB with other development institutions (including independent evaluations of TAs); (iv) assess the performance of ADB TA in its various forms (capacity development, policy and advisory, research and development, project preparatory).

5. Impact evaluation study of an education support project in Bangladesh. The study will build on data collected during the project's implementation, and address impact and the sustainability of education in Bangladesh. It will be based on the identification of comparison groups, surveys of beneficiaries and the application of quantitative and qualitative methods. The study will use quasi-experimental design, conduct a large household (or schools) survey and use mixed methods.

In addition to the preparation of the evaluations described above, the RDTA will also support the following:

1. Other sector and thematic assessments, and topical working papers. The TA will support selected country and sector and/or thematic assessments needed to feed into or help disseminate the high-level major evaluations included in the IED work program. This will also include selective evaluative research work on high impact topics of specific interest and relevance to ADB DMCs through "quick-turn around" topical working papers.

2. Dissemination of knowledge products. To make its evaluation products more accessible and influential, the IED will continue to disclose, disseminate, and share evaluation feedback on performance and lessons. Using the SES results, it will prepare and publish syntheses, briefs, and occasional papers tailored to widen readership and provide continuous feedback on ADB's operations, strategies, and policies.

Project Rationale and Linkage to Country/Regional Strategy

IED's yearly program of high-level evaluations involves multiple countries, sectors and themes. These evaluations also emphasize a strategic perspective to ensure that ADB's directions and operations are captured for greatest usefulness and impact, and are supported by knowledge and outreach activities for greater impact.

Strategy 2020 and its results framework have made development effectiveness a touchstone for ADB operations. Through suupport for high-level evaluations, this RDTA will help IED supply evaluative feedback on the effectiveness of ADB operations in order to gauge the continued relevance and effectiveness of Strategy 2020 in several important thematic areas, and in one country, Tajikistan.

1. Strengthening regional cooperation and integration (RCI). The RCI strategy adopted in 2006 set forth an explicit and integrated development approach to RCI. It identifies ADB's priorities, elaborates on its role in supporting and promoting RCI, and delineates organizational responsibilities for implementation. Strategy 2020 reaffirmed the overall strategic directions outlined in the RCI strategy and set a long-term target of increasing RCI-related lending to at least 30% of ADB operations by 2020. A proposed special evaluation study (SES) will assess the design and implementation of the RCI Strategy to provide broad guidance for future ADB regional operations. It will try to address the following questions: In what ways and how effectively did ADB integrate RCI into its operations in terms of the modalities used in different regional, sub-regional, and country contexts? To what extent have ADB's RCI projects achieved their intended outputs, outcomes and impacts? How has ADB coordinated with other agencies involved in RCI and monitored the progress of such activities? Is ADB on track to achieve the Strategy 2020 RCI lending target? How can the RCI Strategy be strengthened to enhance development effectiveness, in line with Strategy 2020?

2. Implementing ADB's new safeguards policy. Strategy 2020 commits to enforcing environmental and social safeguards in ADB operations and to safeguard operations being compatible with, or strengthening country safeguard systems (CSS). ADB's safeguards policy is embodied in its Safeguards Policy Statement (SPS) issued in July 2009. This provides operational guidelines related to involuntary resettlement, indigenous peoples and environment. It also specifies, on the request of ADB's Board of Directors, that IED should conduct two reviews, one after 3 years, and one after 5. While the latter review is to assess the effectiveness of the 2009 policy in achieving ADB's safeguard objectives, the former, called an operational review, would have particular emphasis on assessing (i) progress on the use of and effectiveness of CSS; and (ii) implementation of safeguard requirements for financial intermediation projects, and the effectiveness of such requirements.

3. Evaluating the role of ADB technical assistance operations. TA operations can be financed by grants or more rarely loans through ADB's main fund sources or a number of special funds as provided by individual donors. As outlined in Strategy 2020, ADB TAs assist developing member countries (DMCs) in identifying and designing projects, improving institutions, formulating development strategies, or fostering regional cooperation. TA in ADB and other international financial institutions is increasing in importance given its contribution to capacity building and knowledge generation and management, which complement the traditional loan portfolios. As such, there is interest to improve the strategic relevance, efficiency and effectiveness of TA in relation to project preparation, knowledge generation or capacity development. In particular, priority will be given to considering changes in the role of TA and how it can best contribute to development effectiveness.

4. Education impact evaluation in Bangladesh. . IED will conduct a rigorous impact evaluation on the Second Primary Education Sector Project (Loan 1521-BAN[SF]) in Bangladesh to assess its effects on learning including years of schooling, enrollment, literacy, and earnings etc. The project, which was co-financed by Overseas Development Administration, was oriented to primary schools and rated successful at the time of self-evaluation. The study will feed into ADB's decision making as to meaningful and successful investment in the education sector, which is also a core operational area under Strategy 2020. The latter has not received much investment so far, and for which the success rates of completed projects have been very varied in recent years. The impact evaluation is to also address the debate regarding the need for extra efforts into quality improvements in primary education, and the concomitant improved learning outcomes.

5. Country assistance program evaluation Tajikistan. The proposed country assistance program evaluation (CAPE) for Tajikistan will be the first assessment of ADB country strategies and programs in Tajikistan. It aims to: (i) draw forward-looking lessons and make recommendations for the next country partnership strategy, and (ii) provide an objective assessment and rating of the performance of ADB's assistance to Tajikistan and identify factors affecting such performance.

Impact Improved development effectiveness of ADB operations, policies, strategies, and business processes
Project Outcome
Description of Outcome Increased use of evaluation findings, lessons, and recommendations by the ADB Board of Directors and the Board's Development Effectiveness Committee, by ADB Management and operations, and also by the public
Progress Toward Outcome
Implementation Progress
Description of Project Outputs Useful lessons and recommendations from completed evaluation reports
Status of Implementation Progress (Outputs, Activities, and Issues)
Geographical Location
Summary of Environmental and Social Aspects
Environmental Aspects
Involuntary Resettlement
Indigenous Peoples
Stakeholder Communication, Participation, and Consultation
During Project Design The evaluation process will be guided by an approved evaluation approach paper (EAP) (or in some specific cases a concept paper) which defines the intended study, i.e., key evaluation issues and questions, methods and approach, inputs and activities. The formulation of the EAP will involve interactions between IED staff and ADB operations (including interdepartmental review or commenting on the draft paper) and non-operations staff, representatives from the international evaluation community, non-government organizations, and, where appropriate, consultations with relevant study countries.
During Project Implementation The implementation of of each evaluation study will include a mixed set of (i) country visits to meet beneficiaries and affectees (including vulnerable groups), (ii) in-country meetings with DMC government staff, non-government organizations, and development partners, (iii) consultations with operations and non-operations staff at ADB headquarters and in resident missions, (iv) targeted field interviews/surveys, and (iv) video conferences with relevant evaluation units, international think tanks etc.
Business Opportunities
Consulting Services Evaluation studies under the TA are tentatively estimated to require about 47 person-months and 64 person-months of international and national consulting inputs, respectively. Specific requirements for each evaluation will be reviewed and finalized during the preparation of an appropriate concept paper or evaluation approach paper.
Procurement Requirements for seminars/workshops and other goods will be determined during the preparation of an appropriate concept paper or evaluation approach paper for each major evaluation.
Responsible ADB Officer Hans Van Rijn
Responsible ADB Department Independent Evaluation Department
Responsible ADB Division Independent Evaluation Department
Executing Agencies
Asian Development BankJocelyn G. Tubadeza, Evaluation Specialist (Operations Coordination)6 ADB Avenue, Mandaluyong City 1550, Philippines
Timetable
Concept Clearance 07 Dec 2012
Fact Finding -
MRM -
Approval 19 Apr 2013
Last Review Mission -
Last PDS Update 31 Jan 2013

TA 8353-REG

Milestones
Approval Signing Date Effectivity Date Closing
Original Revised Actual
19 Apr 2013 - 19 Apr 2013 30 Jun 2015 31 Dec 2016 -
Financing Plan/TA Utilization Cumulative Disbursements
ADB Cofinancing Counterpart Total Date Amount
Gov Beneficiaries Project Sponsor Others
1,950,000.00 0.00 0.00 0.00 0.00 0.00 1,950,000.00 19 Apr 2013 1,215,438.47
Title Document Type Document Date
Selected Evaluation Studies for 2013 Technical Assistance Reports Mar 2013

Safeguard Documents

See also: Safeguards

No documents found.

Evaluation Documents

See also: Independent Evaluation

No documents found.


The Public Communications Policy (PCP) establishes the disclosure requirements for documents and information ADB produces or requires to be produced in its operations to facilitate stakeholder participation in ADB's decision-making. For more information, refer to the Safeguard Policy Statement, Operations Manual F1, and Operations Manual L3.

Requests for information may also be directed to the InfoUnit.