Final Evaluation ACT Capacity Building Project

1. General information:

Project name: ACT Capacity Building Project (CBP) 

Country: Tunisia 

Project Duration: January 2019 – June 2022 

2. Initiative:

This final evaluation is initiated by ACT (Association Cooperation in Tunisia) for the Capacity Building Project. Due to CV-19, the initial project period (2019-2021) has been extended to a total duration of 4 years (2019 –  2022). 

3. Purpose of the evaluation:

The primary purpose of the final evaluation is:

1. to objectively measure to what extend the project objective and expected results have been achieved.
2. to identify and document lessons learnt and good practices.
3. to present a list of recommendations enabling informed management decisions for future ACTprojects.

The evaluation provides an opportunity for the project management to examine the project performance more closely and familiarize partners and key stakeholders with the evaluation  outcomes.

4. Scope of the evaluation:

The final evaluation will be an external evaluation of the Capacity Building Program (CBP) implemented by ACT for the period of 3.5 years.

5. Project presentation:

The CBP is an initiative of ACT in partnership with Norwegian Development Partners (NODEPA) funded by NORAD. After the Yasmine Revolution in 2011, Tunisia has seen a tremendous increase of new local associations registered. ACT aims to help through the Capacity Building Program five Tunisian Local Associations (LAs) to become strong and effective associations.

Project Results Expected:  

Result 1: Increased organizational capacity (administrative, financial, governance, etc.). 

Result 2: Increased project capacity (project cycle management, MEAL, etc.)  

Result 3: Increased network capacity (sharing and learning in collaboration with others.)  

6. Questions to be answered:

The evaluator should answer the following questions categorized by four major areas of Relevance, Effectiveness, Efficiency and Sustainability.

1. Relevance:
   1. To what extent did the project interventions meet the needs of the project beneficiaries? 
   2. To what degree was the project designed considering economic, social and cultural context in the project target areas? 

• Effectiveness (this includes the quality and effectiveness of the methodologies, approaches and techniques used to achieve program outcomes).

1. To what extent did the project achieve its specific project objective?
2. How, in light of expected result 1 (increased organisatinal capacity), have the trainings (topics) and follow-up visits contributed to increased organisational capacity?
3. How, in light of expected result 2 (increased project experience), have the small-scale projects (SPP) helped the to increase the project experience of LAs?
4. How, in the light of result 3 (increased network capacity), have the network meetings contributed to increased network capacity?
5. What could have been done differently by ACT to make the Local Associations (LAs) benefit more from the project? 
6. Efficiency (This includes reviewing program processes and program management.)
7. Have project resources (inputs) resulted in expected results? 
8. How have the different monitoring tools (OCA, CAPI and Netwotk Assessment) and Steering Committee helped to monitor and evaluate the ongoing project progress? 
9. How would you assess the “value-for-money” of the project? 
10. Have program management financial, technical, logistical systems been set up and functioning? 
11. Sustainability: 
    1. To what extent has the CBP contributed to strengthen civil society in Tunisia? 
    2. How have the LAs made (through the Small Scale Projects) made an in impact in Civil Society?
    3. What is the likelihood that the LAs will be able to continue to grow and operate and have impact in Civil Society after the completion of the project? 
    4. What are the most important lessons learnt and what are areas of improvements and recommendations for future ACT projects?

In compliance with Digni-funded projects an Empowerment Assessment Table will need to be filled (see also section 7 Methods) answering the following questions: 

1. To what degree is the change in empowerment – at output, outcome, or impact level? 
2. At what levels are the empowerment taking place: Individual, Community or Society? 
3. Are there differences in empowerment with regard to “themes/areas of work” in the project?

7. Methods:

The final evaluation will use a participatory approach by which the External Evaluator will work closely with CBP project staff, local associations, and other stakeholders. It will use qualitative methods involving Key Informant Interviews, focus group discussions and site visits.  The External Evaluator will ensure that relevant partners and stakeholders actively participate to ensure high quality, credibility, and effectiveness of the exercise. 

The evaluator will, in consultation with the CBP Project Manager, take responsibility for the design of the evaluation methodology. This will be a combination of using existing tools within CBP such as the Organisational Capacity Assessment (OCA) and the Capacity Assessment for Project Implementation (CAPI) and determining appropriate other tools. The evaluator will have to follow the detailed timetable (see point 10) for information collection, analysis, and reporting. 

Collection methods must include a combination of primary sources from interviewing beneficiaries, partners and stakeholders, general observations, and gathering information from secondary sources including the CBP monitoring and reporting system. It is expected that the results will be disaggregated by gender.

With the CBP being a Digni funded project, an Empowerment Assessment table (EAT) should be made in connection with this final evaluation and the External Evaluator is required to familiarize him/herself with the tool and complete it in the evaluation report. The External Evaluator will receive detailed instructions and background information for EAT during the first meeting with ACT. 

In the preparation of the final report, the External Evaluator is expected to provide the reader with accurate sources of its information and conclusions. All evaluation statements must be backed by existing data and information. When this is not the case, the evaluator is required to state its rationale for its observations and conclusions. If some of the questions do not apply, the Consultant must explain the reason(s).

8. Sampling and limitations/delimitations:

The evaluator will need to meet/visit all five local associations participating in the CBP.

9. Expected product presentations:

After approval of the submitted Technical and Methodological proposal and proposed fees, the selected External Evaluator will be invited to attend a meeting (21st of March 2022) with the CBP staff by in order to receive more details about the CBP project and the purpose of the evaluation mission. Within two working days the evaluator should submit an updated version of the Technical and Methodological proposal which will function as the Evaluation Design which will become an Annex to the Evaluation report. 

The Evaluation Design will include: 

1. A detailed Evaluation Design Plan that links the evaluation questions in the ToR to data sources and data analysis methods. 
2. Draft questionnaires and other data collection instruments or their main features. 
3. The list of potential interviewees and sites/associations to be visited. 
4. Known limitations to the evaluation design. 
5. The list of further collaborators if needed, delineated by roles and responsibilities. 

Once the External Evaluator receives the approval on the Evaluation Design from the CBP Project Manager, the evaluator is expected to start Data Collection and Data Analysis starting with a Focus Group Discussion on the 24th of March (where all LAs will be present) followed by Key Informant Interviews (KII) and visits to the five LAs.

The first draft Evaluation Report should be submitted to the CBP Project Manager in English by the 24th of April as a deadline. The report will address each of the questions identified in the ToR and any other issues the evaluator considers having a bearing on the objectives of the evaluation. Any such issues can be included in the report only after consultation with the CBP Project Manager.

Once the initial draft Evaluation Report is submitted, ACT will send comments and feedback to the Consultant after five days of receiving the draft report. The External Evaluator will be asked to take no more than four business days to respond/incorporate the final comments from ACT and submit the Final Evaluation Report with the 8th of May 2022 as the deadline. 

After submitting the final report, the evaluator will present the findings and recommendation in a 2-hour meeting/workshop for ACT, CBP staff and the LAs on the 12th of May 2022. 

All project data and records (detailed work plan, evaluation interviews tools for FGD and Key informant interviews, draft final evaluation report, final evaluation report) will be submitted to ACT in English and should be in electronic form in easily readable format, organized and documented for use by those not fully familiar with the intervention or evaluation. 

All deliverable documents and reports should be in English language. 

10. The utilization of the evaluation findings:

ACT will use the final evaluation report and the outcomes of the meeting/workshop with the evaluator as a base to discuss the development of the CBP training manual (in the last 6 months of 2022) as well as better plan future ACT projects.

11. Timeframe for evaluation and reporting:

12. Report format:

The final report should include the following sections:

• Cover page
• Table of content
• Executive summary
• Body of the report:
  • Introduction
  • Purpose and specific objectives for the final evaluation
  • Methodology employed
  • Findings
  • Analysis/discussions
  • Conclusion and recommendations
• Supporting data should be included in appendices. 

The report should be max. 25 pages, excluding appendices.

13. Evaluation team:

Must be gender balanced. 

14. Facilitator:

The External Evaluator will be hired with a consultancy contract and is expected to have the following profile:

• a relevant university or master’s degree 
• proven experience with (1) project evaluations including evaluation design, (2) the use of different evaluation tools and (3) international reporting standards
• a good understanding of Tunisia Civil Society and familiar with Local Associations  
• experience in gender equality and women’s empowerment is highly recommended.
• Arabic and English language fluency.
• Be available at the scheduled days between the 21th of March until the 12th of May 2022

The consultant should submit the following documents to the CBP Project Manager before 13th of March 2022 ensuring the necessary profile requirements are met:

1. An updated Curriculum Vitae with references showing previous experiences with project evaluation.
2. A technical and methodological proposal for the evaluation mission including a general presentation of the proposed evaluation tools and methods linked to the TOR questions.
3. A financial price offer with the proposed fees for the evaluation mission for a total of 14 working days during the period between 17th of March and the 12th of May 2022.

The documents should be sent by mail on the following address:  Yassine.farhat@actdev.org

15. Detailed budget:

16. Attachments:

The evaluation team’s CVs are compulsory, as the team must be approved by Nodepa.

Appel à consultation – ACT