Purpose
The International Federation of Red Cross and Red Crescent Societies (IFRC) seeks to evaluate the relevance/appropriateness, effectiveness, efficiency, coherence and impact of the actions implemented under the “Mental Health and Psychosocial Support (MHPSS) and hygiene kits support to Afghan and Ukrainian refugees living in urban areas of Türkiye as well as to the host communities” project implemented from 1 January 2023-June 2024, by building upon and integrating findings from primary and secondary data collection.
- Audience: Turkish Red Crescent Society (TRCS), IFRC, other Red Cross and Red Crescent (RC/RC) Movement actors and the donor. The findings, recommendations and lessons learned will be specifically used by TRCS and IFRC for planning and preparedness for similar projects in the future.
- Commissioners: This evaluation is being commissioned by the IFRC Türkiye Delegation.
- Reports to: The consultant will report to the Evaluation Management Team (EMT).
- Duration: This consultancy will be for approximately four weeks (20 working days).
- Location: The evaluation will take place in IFRC Türkiye Delegation and TRCS’s National Office located in Ankara, Türkiye and three Community Centres in Konya, Bursa and Mersin.
Background
Key sectors together with summary of interventions and areas of operation are provided in the table below:
Project Details
Key Sectors:
- Mental Health and Psychosocial Support (MHPSS):
- Summary: Provision of MHPSS to children and adults and provision of comprehensive MHPSS to Afghan and Ukrainian refugees and host community members living in urban areas – including psychological counselling, psychiatric service provision, psychoeducation and support group sessions, referrals to specialized psychiatric services
- Areas of operation: Urban areas through community centres
- Water, Sanitation and Hygiene (WASH):
- Summary: Distribution of hygiene kits
- Areas of operation: Urban areas through community centres
- Community Engagement and Accountability (CEA):
- Summary: Volunteering from refugees for community centre activities particularly for translation. Information dissemination through social media regarding the project and its support
- Areas of operation: Urban areas, online
- National Society (NS) Capacity Building:
- Summary: Supporting TRCS with trainings for volunteers and staff
- Areas of operation: N/A
- Protection, Gender and Inclusion (PGI):
- Summary: Provision of relevant support through referrals to protection services as required based on identified individual needs
- Areas of operation: Urban areas
Alignment to the IFRC’s objectives and strategy
The evaluator must ensure that the evaluation respects and protects the rights and welfare of people and communities. It should also be technically accurate, reliable, and contribute to organizational learning and accountability. The EMT should adhere to the IFRC Framework for Evaluation, which includes standards such as utility, feasibility, ethics, and legality, impartiality and independence, transparency, accuracy, participation, and collaboration.
The evaluation should also respect the seven Fundamental Principles of the RC/RC: 1) humanity, 2) impartiality, 3) neutrality, 4) independence, 5) voluntary service, 6) unity, and 7) universality.
Objectives
The evaluation will focus on relevance/appropriateness of the project, the effectiveness of the interventions, the efficiency of the interventions in delivering quality services, the coherence and complementarity of the interventions with other interventions as well as its impact on the target population. Specifically, it aims to:
- Evaluate the project’s activities to determine their relevance/appropriateness and effectiveness.
- Assess the operational model’s efficiency and resource utilization, including IFRC’s contribution to the process.
- Identify the project’s design coherence, coordination, and complementarity with other interventions.
- Assess the impact of the project activities on the supported individuals.
- Provide a space for TRC members that took part in the project to reflect on the process, the outcomes successes and areas for improvement.
- Identify and document good practices and lessons learned for future programming and organizational learning.
Desired outcomes and consultancy outputs
The evaluation consultant is expected to conduct secondary data analysis and primary data collection including, key informant interviews (KIIs) and, focus group discussions (FGDs) with assisted people. Please check the “Method of delivery” section for details. The consultant should also design and facilitate (in Turkish) 2 days Lessons Learned Workshop with TRC and IFRC participants and integrate the workshop outputs into the evaluation study. The cost (location, food, accommodation…etc.) of the Lessons Learned Workshop should not be included in the financial offer as it will be covered by the IFRC directly.
Expected deliverables:
- Inception report: A report demonstrating a clear understanding of the ToR with a realistic plan of work for the evaluation, including proposed methodologies, data collection plan, and draft data collection tools.
- Lessons learned workshop methodology, facilitation and documentation.
- Draft report: A draft report in English to be reviewed by the EMT. The consultant will receive feedback within 5 working days to incorporate into the final report.
- Draft report presentation: A presentation of the draft report to EMT and TRC to discuss the initial findings, conclusions and recommendations, before submission of the final report.
- Final report: A final evaluation report submitted within 5 days after receiving feedback from the draft report. The final report is expected to be no more than 20 pages (including executive summary) which highlights key findings, conclusions, and recommendations. Final report will be submitted in English.
Method of delivery and management
The consultant will be expected to develop a detailed methodology for this evaluation in the inception report, which needs to be approved by the EMT. The EMT consists of the IFRC Deputy Head of Delegation for Turkiye, the IFRC Senior Programme Officer, the IFRC Planning, Monitoring, Evaluation and Reporting (PMER) team Lead, and a representative from the TRCS` Community-Based Migration Programme team.
Support to be provided to the consultant
The EMT will support the evaluation consultant with establishing contact with relevant stakeholders in TRCS and by providing relevant documentation for the secondary data analysis. The IFRC will also provide administrative support for the organization of the lessons learned workshop. TRCS will be coordinating with the consultant actively to ensure that the project target group and relevant staff is interviewed.
Schedule
Expected consultancy period: 6 May-14 June (20 working days)
Week 1:
- Activities (and number of estimated days):
- Kick off meeting with EMT (1 day)
- Desk review and analysis: Review of intervention documentation, and related secondary resources for the evaluation. (2 days)
- Development of draft inception report, and data collection/analysis plan and schedule, draft methodology, and data collection tools. (2 days)
- Deliverables:
- Draft inception report, data collection/analysis plan and schedule, draft methodology, and data collection tools
- Final inception report
Week 2:
- Activities (and number of estimated days):
- Integrate IFRC and TRCS to the inception report and finalize inception report (1 day)
- Key informant interviews and FGDs (3 days)
Week 3:
- Activities (and number of estimated days):
- Key informant interviews and FGDs (2 days)
- Lessons Learned Workshop (2 days)
Week 4:
- Activities (and number of estimated days):
- Data and findings analysis (2 days)
- Prepare draft evaluation report. (2 days)
Week 5:
- Activities (and number of estimated days):
- Draft report presentation to discuss the initial findings, conclusions, and recommendations before revision and final approval of the final report.(1 day)
- Make revisions in report and submit final evaluation report (2 days)
- Deliverables:
- Draft version of the evaluation report
- Debriefing session
- Final draft of the evaluation report
Requirements
Qualifications:
The Evaluator is expected to provide an independent, objective perspective as well as technical experience on evaluations. He/she will coordinate directly with the EMT.
The Evaluator should meet the following requirements:
Required:
- 5 years of experience in humanitarian response mechanisms, specifically relief interventions especially in protracted crises with 2 years in leading evaluations in humanitarian programmes for small-to-large scale programmes within a migration or displacement context;
- Very good understanding of the RC/RC Movement and types of humanitarian response;
- Previous experience in coordination, design, implementation, and monitoring and evaluation of humanitarian programmes;
- Experience in the evaluation of urban programs and/or post disaster programming and evaluation;
- Knowledge of activities generally conducted by humanitarian organizations in the sectors of Health and care (with specific focus on MHPSS), WASH and PGI.
- Experience in participatory approaches to evaluations;
- Native level Turkish written and verbal communication skills.
- Excellent English writing and presentation skills in English, with relevant writing samples of similar evaluation reports.
Desirable:
- Field experience in the evaluation of humanitarian with prior experience of evaluating RC/RC programmes.
For any queries regarding these terms of reference, please contact:
IFRC Deputy Head of Delegation
nazira.lacayo@ifrc.org
With copy to:
IFRC PMER Team leader
gulfem.kaya@ifrc.org
Pelin Koc
IFRC Senior Programme Officer
pelin.koc@ifrc.org