Terminal Evaluator (KOICA-UNDP Project)
UNDP Country Office - PHILIPPINES | Published March 27, 2017 - Deadline April 3, 2017
BACKGROUND:Typhoon Yolanda (international name Haiyan), one of the strongest typhoons on record, hit the Visayas (Central Philippines) on 08 November 2013 with a force equivalent to that of a Category 5 hurricane. Rainfall rates reached 30 millimeters per hour, wind speeds registered beyond 315 kilometers per hour and massive storm surges reached as high as five to six meters along coastal areas. Over a 16-hour period, the “super typhoon” passed over six provinces in Central Philippines, knocking out power, telecommunications and water facilities. Along the eastern coast of Samar, Eastern Samar and Leyte, extensive damage was caused by powerful storm surges. Entire villages by the sea were swept away, claiming thousands of lives and causing heavy infrastructure damage in highly populated areas. Meanwhile, on the western coast and mainland areas of Samar and Leyte, severe winds flattened vast areas of farmlands planted with coconut and other fruit-bearing trees. Strong winds also caused damage, although to a lesser extent, along the coasts of Cebu, Panay and Coron.Hardest hit in Eastern Visayas were the islands of Leyte and Samar, particularly Tacloban City, where about 90 percent of the infrastructure was destroyed. Official government figures indicate that about 1.1 million homes were destroyed, 16.1 million people were affected and 4.1 million were displaced. At least 6,300 people were confirmed dead across all areas hit by the typhoon.In December 2014, the Korea International Cooperation Agency (KOICA) and the United Nations Development Programme (UNDP) signed an Arrangement that formalized a collaboration in providing assistance to the affected population, particularly in the recovery phase. The Arrangement defined the terms of the project entitled “Support to Typhoon Recovery and Resilience in the Visayas: Waste Management, Vocational Training and Cash-for-Livelihoods.” The Project has a total KOICA funding of USD 3,180,000 and implemented by the UNDP in the hard-hit municipalities of Basey (Western Samar) and Guiuan and Hernani (Eastern Samar). Refer to the signed Arrangement (Project Document as Annex 1) and Addendum for more details.The overall goal of the project is to contribute in enabling the recovery and building the resilience of selected local government units (LGUs) and communities in the Visayas affected by Typhoon Haiyan, while its objective is to strengthen the post-disaster environmental and economic resilience of its target areas. Implementation period is from December 2014 to June 2017 and is expected to lead to the following outputs:Output 1: Improved waste management systemOutput 2: Increased access to vocational training towards livelihood diversificationOutput 3: Optimized use of typhoon-damaged coconut trees to create cash-for-livelihood opportunitiesOutput 4: Improved community disaster preparedness and reduced number of families living in danger zonesThe objective and target outputs are expected to be achieved through the following:Component 1: Waste ManagementTwo (2) landfills or materials recovery facilities (MRF) constructed in Guiuan and BaseyHeavy and waste management equipment support provided to Basey, Guiuan and Hernani and one (1) Eco-Waste Management Center constructed in GuiuanCapacity building activities on waste management conducted in Hernani, Guiuan and Basey for at least 1,000 participantsComponent 2: Livelihood-Training SupportOne (1) Basey Manpower Training Center (BMTC) constructed/rehabilitated and provided with equipment and toolsAt least 1,200 beneficiaries provided with vocational trainingComponent 3: Coconut Debris-to-Lumber (cash-for-livelihood)At least 2,300 workers in Guiuan, Basey and Hernani employed in clearing and hauling coconut treesAt least 30 skilled workers in Guiuan, Basey and Hernani employed in cutting/processing coconut trees110 hectares of land cleared from typhoon-damaged coconut treesComponent 4: Disaster-Resilient InfrastructureOne (1) Community Evacuation Center constructed and provided with WASH, solar panels, and backup generatorModel disaster-resilient CEC with WASH, solar panels, and back-up generator turned over to the LGU67 permanent disaster resilient homes constructed in identified relocation areaResettlement community with 67 permanent shelters, WASH, power turned over to the 67 families who are organized as a homeowner’s association with basic organizational and estate management skillsAt least one livelihood activity ongoing for either the individual members or managed by the associationSCHEDULE OF PAYMENTS:First Tranche - 20% Upon signing of contract and submission of performance bond;Second Tranche – 20% Upon submission evaluation inception report and issuance of the certificate of acceptance;Third Tranche – 10% Upon presentation of mission evaluation highlights;Fourth Tranche – 30% Upon submission of draft evaluation report and issuance of the certificate of acceptance;Fifth Tranche – 20% Upon submission of final evaluation report, other related documents, and issuance of the certificate of acceptanceEVALUATION PURPOSE:With the operational closure of the Project in June 2017, UNDP will engage a competent service provider to carry out the Project’s terminal evaluation. The activity is a mandatory exercise for all UNDP-implemented projects and stipulated under Paragraph 4 (Reporting, Monitoring and Evaluation) Section 6 of the signed Arrangement between KOICA and UNDP.The terminal evaluation seeks to assess the overall performance of the Project vis-à-vis its identified targets and objectives. The results, expected to be released by May 2017, will be used by UNDP and KOICA to enhance programming of future interventions on recovery and resilience-building of areas/communities affected by disasters. The results can likewise be used as reference by government agencies and LGUs to guide and sustain the recovery efforts and possible replication in other localities.DESCRIPTION OF RESPONSIBILITIES:The evaluation shall be conducted to assess Project performance vis-à-vis its targets and expected outputs, and its contribution relative to its objective. The exercise will cover the implementation period December 2014 – March 2017. Geographically, it should cover all three municipalities (i.e., Basey, Guiuan and Hernani). Target respondents include key informants from the Municipal/Barangay LGUs and direct beneficiaries, NEDA, TESDA, PCA, DENR, KOICA, EU and UNDP. At the Municipal LGU level, the respondents should include the Offices of the Municipal Mayor, Administrator, Planning, Engineering, General Services, Social Welfare, Public Employment Service and Agriculture, as applicable. For sub-projects with multiple beneficiaries (e.g., housing, vocational training, livelihood inputs), the evaluator shall propose the sampling strategy and size, and indicate the same in its technical proposal and inception report (once selected). Specific objectives of the evaluation include:To assess the KOICA-UNDP Project performance relative to its objective and targets as stated in the Project Design Matrix and M&E Plan, and with reference to the project Baseline Study;To assess the appropriateness of the Project’s overall/per component implementation methodologies and strategies in achieving the set outputs, results and objective as well as in putting in place models or practices which the government, partners and communities could adopt in building and achieving physical, economic, social and institutional resilience in their future projects;To assess the effectiveness and efficiency in the use of Project resources to meet target outputs, results and objective;To analyze factors, including the Project management/operational set-up, and its degree of influence in the achievement or non-achievement of target outputs, results and objective;To assess the relevance and effectiveness of the Project’s partnership and other implementation strategies and highlight which among these methodologies and approaches could be sustained or replicated by government agencies, LGUs and communities;To determine local capacities developed and level of participation of stakeholders in the achievement of the outputs and results; and,To document and draw up lessons learned, good, replicable and/or innovative practices, cross-cutting issues (e.g. gender mainstreaming, human rights, resiliency-building, governance, beneficiary selection, stakeholder participation) and recommendations on appropriate project strategies to improve future programming on post-disaster recovery and resilience building;To put forward some policy and programme recommendations to UNDP as direct implementer of the project Considering the number of projects in Basey and the distance of Guiuan and Hernani from Tacloban, the Evaluator would have to map out and plot the sequence of projects to be covered by on-site validation and respondents to be included in key informant interviews and focus group discussions. The Evaluator would likewise have to consider weather conditions and availability of respondents (particularly government officials and remaining Project Team members) in programming field visits and interviews.EVALUATION APPROACH AND METHODOLOGYThe overall approach and methodology of the terminal evaluation shall be guided by the provisions set forth in the UNDP Handbook on Planning, Monitoring and Evaluating for Development Results and the UNEG Norms and Standards for Evaluation (refer to attached documents). It should be conducted in accordance with the principles outlined in the UNEG Ethical Guidelines for Evaluation. The Evaluator will be required to sign an Evaluation Consultant Code of Conduct Agreement Form.The Evaluator is expected to frame the evaluation effort using the core criteria of relevance, effectiveness, efficiency and sustainability and additional criteria appropriateness, coherence, connectedness and gender mainstreaming (i.e., equity, inclusiveness and participation). A rating scale for each criterion and overall Project performance will have to be defined by the Evaluator and must include a description for each rating as basis for interpretation. The list of key evaluation questions and sub-questions, which shall form part of technical proposal of the Evaluator, should be able to draw out the required information for each evaluation objective and classified according to criteria they belong to. The list will have to be finalized with the Project Team and shall be included in the Evaluator’s Inception Report.The evaluation should employ a combination of both qualitative and quantitative evaluation methods and instruments. The technical proposal of the Evaluator would have to indicate specific activities, data sources, data collection and analysis methods needed to meet the evaluation purpose and objectives. These may include, but not limited to, desk review of Project documents, on-site validation of tangible outputs, key informant interviews and focus group discussions. The Evaluator is expected to follow a participatory and consultative approach ensuring close engagement with the Project Team, implementing partners and direct beneficiaries. EVALUATION PRODUCTSThe selected Evaluator will be accountable for producing the following documents:Evaluation Inception Report. To be submitted within a week from the official start of engagement (i.e., issuance of Notice to Proceed), outlining the framework of analysis, schedule of activities/tasks/ milestones/deliverables, responsibilities of team members (if the Evaluator opts to bring in technical and administrative support), and evaluation matrix;PowerPoint Presentation. To be presented three (3) days after end of evaluation mission and will highlight actual coverage of mission, initial findings, additional requirements (if any) and next steps. Draft Evaluation Report and PowerPoint Presentation. The document will be circulated to Project stakeholders for review and comments. The draft report may be subjected to several revisions, as needed. An evaluation report audit trail will be required to document sections with comments and the corresponding response or actions taken by the Evaluator. The PowerPoint presentation shall contain the highlights of the report. The table below is an audit trail template for the Evaluator to show how the received comments on the draft terminal evaluation report have (or have not) been incorporated into the final report. This audit trail should be included as an annex in the final terminal evaluation report.Final Evaluation Report and PowerPoint Presentation. The outline of the report should be based on the guidelines provided under Annex 7 (Evaluation Report Template and Quality Standards) of the UNDP PME Handbook. The PowerPoint presentation shall contain the highlights of the report. The Evaluator is also expected to turn over to UNDP all materials related to the evaluation exercise (i.e., raw and processed data, pictures, list of respondents and written/signed consents). IMPLEMENTATION ARRANGEMENTSThe principal responsibility for managing this evaluation resides with the Project Team through the Project Manager (PM) and the Monitoring and Evaluation Officer (MEO). Both will be responsible for liaising with the IC pertaining to required technical and financial documents, coordinating with implementing partners and direct beneficiaries, setting up stakeholder interviews, arranging field visits, and looking after the evaluation budget and schedule. The Team will likewise assist in distribution of draft reports to stakeholders for their review, consolidation of comments, and in organizing key stakeholders’ meetings for presentation of the salient points of the draft/final reports.At the UNDP Country Office, the Resilience and Peace Building Unit (RPBU) and Management Support Unit (MSU) will provide assistance in the procurement process for the selection of an IC (i.e., publication of the TOR and assessment of proposals), briefing the IC on UNDP evaluation norms and standards, reviewing and quality assuring the inception/draft/final reports, and in publishing findings and management responses at the UNDP Evaluation Resource Center.The IC will be responsible for implementing all evaluation-related activities and in producing the evaluation products listed in Section E. While the Project Team will provide the information required and support in coordinating with stakeholders, the IC will have to manage its own schedule and logistical arrangements in the conduct of interviews and site visits. The IC must take into consideration changes in weather condition and the availability of target respondents in its work plan. Corporate competencesCommitment to UNDP’s mission, vision and values;Sensitivity to cultural, gender, religion, race, nationality and age differences.Functional competencesExperience in working in the private sector, or in an outreach position relating with the government and private sector;Past experience and effective communication skills for dialoguing with senior level private sector executives;Strong initiative and desire to succeed, accountable and willingness to be pro-active in identifying suitable companies for BCtA membership and engaging in appropriate business opportunities;Experience and knowledge of the international development sector, e.g. through working at the UN in the private sector engagement and/or development field;Existing work experience in the Philippines and with the Philippines-based private sector organizations/companies, donor partners and UN agencies;Possess strong intellectual interest in economic development and the role of the private sector in driving poverty reduction; knowledge of private sector – development impact assessment;Past international work experience preferred;Demonstrated ability to function in a team environment & to deal with complex multi-stakeholder environment. QUALIFICATIONS:Education:Advanced degree in Development/Environmental Management, Public Administration, Economics, Social Sciences, or equivalent work experienceExperience:At least ten (10) years of progressively responsible experience in development research, evaluation of development projects, or project management, in areas related to comprehensive early recovery and rehabilitation assistance, waste management, infrastructure development, livelihood, resettlement and governanceDemonstrated strong knowledge and experience in the application of monitoring and evaluation methods for development projects; experience in conducting terminal evaluation, specially UNDP-managed projects, an advantage Language:Fluency in the English language and proven ability to write high-quality technical reports (Evaluator will be required to provide work samples)Familiarity with the Project areas and ability to speak the local languages (i.e., Waray and Visayan) an advantageCriteria for selection process:The offer will evaluated based on the Combined Scoring method – where the qualifications will be weighted a max. of 30%, Methodology will be weighted a max. of 40% and combined with the financial offer which will be weighted a max of 30%.Application requirements:Duly accomplished Letter of Confirmation of Interest and Availability using the template provided by UNDP;Personal CV or P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references.Application requirements should be emailed to firstname.lastname@example.org and email@example.com on or before 03 April 2017.