Beyond Ticks and Checkmarks: A Monitoring and Evaluation Framework for the CTI-CFF
Ambitious, multi-sectoral, cross-boundary... there is no shortage of superlatives to qualify the Coral Triangle Initiative on Coral Reefs, Fisheries, and Food Security (CTI-CFF). A multilateral partnership of 6 countries working to sustain marine resources by addressing food security, climate change and marine biodiversity, the initiative has set out a roadmap with milestones to gauge progress. To monitor this, a comprehensive framework is needed.
To monitor progress, the CTI-CFF has been working towards a common monitoring and evaluation (M&E) framework for reporting evolution towards the goals of the 2010-2020 CTI-CFF Regional Plan of Action (RPOA). The RPOA has five overall goals which were established at the first Regional Senior Officials Meeting (SOM) in December 2007. These goals focus on:
- Priority seascapes;
- Ecosystem approach to managing fisheries and other marine resources (EAFM);
- Marine Protected Areas (MPAs);
- Climate Change Adaptation; and
- Threatened Species.
Keeping a close eye on progressIn 2008, a Monitoring and Evaluation Working Group (MEWG) was formed to develop indicators for these goals and to provide a formal mechanism to monitor and report progress towards these goals over time. MEWG has worked with other CTI-CFF working groups to develop, revise and refine indicators and develop an M&E system that includes protocol for data collection, storage, retrieval processing, analysis and reporting.
Since its inception in 2008, the USCTI Support Program (USCTI) and the Coral Triangle Support Partnership (CTSP) have been instrumental in the development of both the Coral Triangle Marine Protected Areas System (CTMPAS) and the Coral Triangle Atlas (CT Atlas, http://ctatlas.reefbase.org). Both of these platforms include national indicators that could be incorporated into a regional M&E system.
Leveraging solid data platforms for the Coral Triangle
CTMPAS systematizes MPA registration and documents management effectiveness ratings, while creating an overarching system of ecologically connected MPA networks. The development of CTMPAS has included:
- a formal review of the status of all MPAs and MPA systems in each CT6 country;
- the publication of a practitioner guide on the principles of MPA design;
- formulation of MPA management effectiveness criteria and guides; and
- formulation and publication of the CTMPAS Framework and Action Plan that has been approved by the CT6. This framework includes mutually agreed-upon regional standards for classifying MPAs according to their level of management effectiveness.
A governance system to oversee data sharing and ownershipThe MEWG has coordinated M&E efforts with staff working on both of these projects to ensure that indicators and M&E methodology are feasible and consistent. A Memorandum of Understanding (MOU) has been developed between CT Atlas and each CT6 country that defines the terms of data sharing, including ownership and uses of the data. An important aspect of these MOUs is that no analysis of any data that is not public can be published without the country’s permission.
Other database systems, such as those of the Regional Fisheries Management Organizations (RFMOs) may eventually provide another source of data for the CTI-CFF M&E System.
Ongoing refinements through a consultative processThe MEWG has presented regular updates on their progress at the various SOMs held in the region. At a CTI-CFF MEWG workshop held in the Philippines in April 2013, representatives from each of the 6 countries reviewed draft indicators and mapped the flow of M&E data and information at the country level. This mapping exercise identified responsibility centers for data collection and identified capacity gaps.
Defining Indicators and Key Concepts – including “improved livelihoods”As a part of the development of an M&E system, countries identified “improved livelihoods” as a key EAFM indicator and recognized the important linkages between “wellbeing” and a healthy, productive and sustainable marine environment. To that end, CTI-CFF has included a target of “improved income, livelihoods and food security of people in coastal communities across the region through a new sustainable coastal fisheries and poverty reduction initiative” in the EAFM M&E framework. This initiative has been named “COASTFISH” and seeks to document:
- The percent change in average income (fishing and non-fishing) of coastal households as compared to a baseline; and
- Percent contribution of fish to protein requirements.
Meanwhile, another important aspect of the development of this regional M&E system is a regional agreement on definitions for key terms such as “seascape”, “EAFM”, and “critical habitat”. The difficulties of arriving at agreements on these definitions should not be underestimated.
Concerns and Guiding PrinciplesWhile the need for a regional M&E framework is widely accepted across the region, concerns regarding the long-term viability of this framework remain. Specifically:
- There are concerns regarding the willingness of governmental and other agencies to share data. In an attempt to encourage data sharing, the development of regional indicators was based on an analysis of existing country M&E processes. To the extent possible, the regional M&E system will make use of M&E reporting systems that are already in place in each country.
- As the MEWG works towards the institutionalization of M&E within the CTI-CFF, the need for dedicated and knowledgeable staff to manage a regional M&E system has become obvious. To that end, the MEWG is recommending the engagement of a full-time Regional M&E Coordinator who will be responsible for directing, organizing and ensuring the effective flow of information between all involved in measuring CTI-CFF progress toward RPOA goals – including both data providers and users. Concerns have been raised regarding the cost of this Coordinator given that the CTI-CFF is in a start-up phase with limited funds, especially until the CTI-CFF is ratified and becomes a permanent Secretariat. The sustainability of the M&E system is also in question as current USCTI financial support is ending. The German Society for International Cooperation (GIZ) has expressed interest in supporting a M&E Coordinator.
- The MEWG recognizes that where possible, data collection methods should be homogenized to improve comparability. Along those lines, the socioeconomic monitoring needs further clarification. While there was general agreement to use available national official socioeconomic indicators, the MEWG must determine how to aggregate this data into a regional indicator. For now, indicators will be reported on in their current disaggregated form.
Next StepsAn outline for a CTI-CFF M&E System Operations Manual has been approved by the MEWG. The Manual will be oriented to the primary users of the M&E system, and include sections on the development of the M&E process, a description of the objectives and their corresponding indicators as well as a description of the organizational, information, and communication management for M&E. A final version of the Manual should be presented at the next SOM tentatively scheduled to take place in the Philippines in September 2013.
Ultimately, the CTI-CFF M&E System will be housed within the CTI-CFF Secretariat. The CTI-CFF is currently operating as an interim entity until it is ratified by at least 4 of the 6 CT countries. For now, the Philippines is leading the MEWG and will continue to do so. TNC will continue to provide some support to the MEWG, though it will largely be up to the countries to sustain the M&E system until it is transferred to the Permanent Secretariat.