Terms Of Reference For Recruitment Of A Consultant For Project Final Evaluation
Project Title: “Promoting the livelihood of Persons with Disability in Rwanda”
Project Duration: 01/01/2018 - 12/31/2021 (4 years)
Starting date for the Consultancy: As soon as possible
December 2021

1.Evaluation Summary
Program/Project,Project Number; P 3740-MYP-Promoting the Livelihood of Persons with Disabilities in Rwanda
Partner Organisation; National Union of Disabilities’ Organisations in Rwanda
Project start and end dates,
Phase of project January 2018 – December 2021
Evaluation Purpose The main objective of the final evaluation is to guide project management and stakeholders identify and understand successes to date and challenges that need to be addressed by providing stakeholders with an external, objective view on the project status.
• Establish the level of performance in relation to the project implementation in 4 districts (Kayonza, Ngororero, Musanze and Nyaruguru) for evidence-based decision making and management.
• To assess the final project achievement for accountability purposes to stakeholders.
• For Organisational learning for all stakeholders to guide improvement on implementation in the remaining project period.
• Draw lessons and make recommendations for learning to enhance project implementation and performance.

The final Evaluation will also focus on the following elements regarding the project:
• Sustainability
• Relevance
• Effectiveness and Efficiency
• Impact
• Gender
• Child Safeguarding
• Inclusion of people with disabilities and people without disabilities
• Environment
• Covid-19 Pandemic

Evaluation Type;Final evaluation
Commissioning organisation/contact person; CBM Country Office, Rwanda
Evaluation Team members (if known) External consultant-Review Team
Primary Methodology Mixed Methods, including quantitative and qualitative methods, physical on-site
Proposed Evaluation Start and End Dates 15 January 2022 to 10 February 2022,
Anticipated Evaluation Report Release Date 11 February 2022
Recipient of Final Evaluation Report CBM (CO, RH, IO, MA), NUDOR

1.Background Of Project
CBM is an international Christian development organisation, committed to improving the quality of life of persons with disabilities in the poorest communities of the world.
Based on its Christian values and over 100 years of professional expertise, CBM addresses poverty as a cause, and a consequence, of disability, and works in partnership to create a society for all. CBM vision is an inclusive world in which all persons with disabilities enjoy their human rights and achieve their full potential.
CBM works with partner Organisations in low income countries to ensure that people with disabilities and their families have access to affordable and comprehensive health care and rehabilitation programmes, quality education programs, and livelihood opportunities.
Working with persons with disabilities, CBM advocates for their inclusion in all aspects of society, and for the inclusion of disability in international cooperation.
Since January 2018, CBM in partnership with the National Union of Disability Organizations (NUDOR) is implementing the project entitled “Promoting the livelihood of Persons with Disability in Rwanda” in 4 Districts (Kayonza, Musanze, Ngororero, and Nyaruguru).
The following are the Terms of Reference (‘ToR’) on which CBM Rwanda agrees to engage the Consultant to conduct a comprehensive Final evaluation of the project.

2. Project Description
The project started in January 2018 and the main component of the project was composed of sensitization and mobilization to enhance mindset change with beneficiaries and raise their understanding on their economic and financial empowerment needs. The main activities were facilitated by Sector Business Mentors and resulted in the formation of Village Savings and Loan Groups (VSLGs) inclusive savings and access to loans in the groups by members to get the capital to run their own Income Generating Activities and sustainable cost-effective businesses.
Today, 957 VLGs have been formed, registered at Cell level, known and appreciated by local authorities with a huge impact in the community. They are composed by 29,777 people with disabilities and parents of children with disabilities. They have been mobilized and sensitized on VSLGs methodology and they were interested and decided to form groups in their communities.

3.Project Objectives
The project’s overall goal is to improve the Social and Economic status of persons with disabilities in Kayonza, Musanze, Ngororero, and Nyaruguru Districts by 2021.

The above overall goal will be reached through a combination of specific objectives and outcomes as presented below:
• Mainstreaming partnership with government (NCPD) and other NGOs in VSLA programme
• Building capacity of Persons with disabilities to improve their income and social participation through the implementation of VSLA approach
• Increasing access to other VSLAs stakeholders, financial services providers and government programs by using lessons learnt from the livelihood project
• Ensuring high-quality programme development through effective governance and management
• By 2021 the programme with NUDOR will be managed under sustainable partnership with other NGOs and NCPD to mainstream persons with disabilities involvement in VSL groups. - INGOs promoting VSLAs are inclusive of persons with disabilities and achieve a 5% inclusion rate of their beneficiaries.
• By 2018, trainings sessions were conducted by BMs (Business Managers) to empower members of the initiated VSLAs and access loans from MFIs.
• 80% of persons with Disabilities who are members of VSLAs are involved in saving on a regular basis and take loans
• 50% of persons with disabilities who are members of VSLGs have invested in productive assets
• 80% of beneficiaries are able to contribute to household expenses and meet their basic needs (health insurance, small livestock, school fees, assistive devices, etc…);

Outcomes:
Outcome 1: The partnership with NCPD and other NGOs working in VSLAs support achieved by 2021
Indicators: By 2021, NUDOR will be efficiently collaborating with NCPD and other NGOs working in VSLA Program
Outcome 2: Persons with disabilities mobilized and sensitized to attend VSLAs by 2021
Indicators: By 2021,14,000 Persons with disabilities in Kayonza, Musanze, Ngororero and Nyaruguru are mobilized and become VSLAs members.
Outcome 3: Increased access to internal saving and loans facilities among persons with Disabilities members of VSLAs by 2021
Indicators: All VSLAs' members accessed internal savings and borrowed money from their groups
Outcome 4: Persons with disabilities’ capacity in socioeconomic participation reinforced by 2021
Indicators: Persons with disabilities are socioeconomically empowered
Indicators: Persons with disabilities run cost-effective businesses and have access to MFI funds.
Outcome 5: Increased access to financial services and information from other MFIs and government programme by 2021
Indicators: Persons with disabilities are accessing the financial services of different MFIs and other government financial programmes
Indicators: MFIs and government programme information is known by persons with disabilities and they are privileged to benefit from them.
Outcome 6: Project staff capacity reinforced and programme management and monitoring ensured by 2021
Indicators: All Sector Business Mentors and other Project Staff are empowered to effectively perform their duties
Indicators: Office supplies and logistics are provided by NUDOR
Outcome 7: Project administration costs ensured by 2018
Indicators: Providing the project with management logistics and equipment’s

4.Objectives Of The Final Evaluation
The main objective of the final evaluation is to establish the level of the partner performance in relation to the livelihood project implementation in Kayonza, Nyaruguru, Ngororero, and Musanze Districts.
The final Evaluation will also focus on the following elements regarding the project:
• Relevance/Appropriateness and quality of design
• Effectiveness and Efficiency or cost-effectiveness (of planning and of implementation):
• Impact - Contribution to change and Sustainability:
• Gender
• Child Safeguarding
• Disability Inclusion
• Covid-Pandemic

The following questions will lead to the objective by detailing project specific areas of enquiry around the key evaluation criteria of relevance, effectiveness, efficiency, impact, and sustainability. There are also other areas of enquiry on which you want to focus: Gender, Child Safeguarding, Disability Inclusion, Covid-19 Pandemic

4.1.Relevance/Appropriateness and quality of design:
• To what extent was and still is the project approach relevant in the country context?
• Is the project based on a clear and focused rationale for the interventions?
• How far was the project based on a realistic analysis of the country situation?
• How far were strategic approaches of the project aligned with development needs and policy priorities in the country?
• How systematically did NUDOR and CBM assess the external risks and internal threats to its programme and interventions?
• How NUDOR project team describe their respective experience in the project– a time they were engaged? What are the most project team value in the project?
• What three wishes do you have to enhance the health and vitality of similar future projects?
• To what degree is the project still relevant – has anything in the context changed and how should the office respond?
• How the project’s potentiality contributing to the promotion of the rights of people with disabilities?
• To what extent were strategic approaches of the project in line with NUDOR and, CBM?
• Are the logframe indicators useful in demonstrating results and effectiveness? How has the project been monitored?
• How is learning being captured and shared?
• Does any focal area need particular added attention or should be reconsidered entirely?

4.2.Effectiveness and Efficiency or cost-effectiveness
• How successful is the project in terms of engagement and delivering results?
• How far have the objectives and related indicators for individual Project interventions been achieved (drawing on data from project reviews and evaluations)? This shall be assessed by looking at existing reports (PPR, project visits, narrative reports, statistics, activity reports...)
• How effective has the project been in working with the government at local and national level? To what extent has the project team and stakeholders been able to influence government policy and practice over the evaluation period? To what extent has the project been able to work with, and influence, other donors and which approaches have been most effective? How well has NUDOR communicated its results/lessons/emerging practices?
• How effective has the project been in aligning to government policies and systems? To what degree has NUDOR been able to influence government systems to be more inclusive of disability?
• How was capacity development (at partner level) resourced? To what extent has local capacity been built and what are the results?
• How did the relationships between NUDOR and CBM Country Office help improve efficiency?
• With what stakeholders did the project co-operate successfully, which are less involved?
• What are the core factors that gave life to this project, without which the project would cease to exist?
• What and How has the capacities of NUDOR been strengthened by CBM? What and how the capacities of MFIs/SACCOs, NGOs and other stakeholders involved in the project have been strengthened by NUDOR?
• How has the partner increased their own effectiveness and efficiency?
• How efficient is the project, (economic impact analysis)?
• What are the Social Return on Investment from the project?

4.3. Impact - Contribution to change and Sustainability:
• This assesses the positive and negative consequences of the project activities and VSLAs, direct and indirect, intended and unintended.
• What is the evidence to show that NUDOR is building capacity to contribute to specific development? Has the project added value to country development?
• How much has the project been able to influence through mainstreaming and other national advocacy?
• What are the key strengths and weaknesses demonstrated by the project?
• What are the lessons learnt from this project (from positive and negative findings) that can be drawn for NUDOR and CBM CO?
• What are long-term and unexpected consequences for the project target group (qualitative and quantitative)?
• How sustainable is the project, what will most likely continue after project end?
• How resources were managed and allocated to ensure project sustainability?
• What are the structural change which have been achieved through the project’s impact?
• How the project has impacted on the lives of people with disabilities and their families and caregivers / parents and the children with disabilities?

4.4.Gender
• Has there been any change in the participation of women and men in community, social, economic or political/decision-making life within the target area? What is the link between the work of the project and these changes?
• Has there been any change over the project period to women and men with disabilities participating in community decision-making processes? Any change in the power distribution?
• What is the ratio of women and men in the project? Does this adequately reflect the ratio of males and females with disability in the target area?
• Are female and male adults/children having equal access to project activities?
• Did both men and women receive the appropriate and needed support so that their needs are addressed?
• Is the focus on women caregivers appropriate? Does the project reinforce unequal duties such as taking care of children with disabilities? How are men included in the project?
• Is the focus on volunteers e.g. in CBR projects creating power differences between men and women or does it enhance power for one of the groups?
• Is there a difference in activities / trainings in terms of gender equality?

4.5.Child Safeguarding
• How has a safe environment for children been established and maintained throughout the stages of planning and implementation?
• Assess the awareness of involved stakeholders about the rights of children and about child protection/safeguarding and what prevention and protection activities were undertaken.
• What measures have been put into place to ensure the partner organization and any other actors involved respect the safeguarding principles? What kind of control mechanism is in place? Assess the degree to which the CBM child safeguarding standards are known and understood by the various stakeholders.
• Assess how stakeholders (partner organisations, community groups etc.) will keep a safe environment for children and how they will keep prevention and protection measures.
• Assess whether there have been any project activities that have created unforeseen negative impacts on children’s safety.
• What feedback mechanisms are in place to report the violation of child safeguarding?
• How the project considers and adhere to NUDOR child safeguarding policies?

4.6.Disability Inclusion
• Has the awareness and understanding of disability increased amongst project staff and community? What can be learned about the initiatives undertaken? Were some more successful than others?
• Did women and men with a disability equally gain a better understanding of their rights and entitlements?
• Were women, men, girls, and boys with a disability equally able to access the full range of services offered? What difficulties did each of those groups have in accessing the services? What are recommendations for addressing the barriers in the future?
• Have project personnel received knowledge and training on the specific needs of women, girls, men, and boys with a disability?
• Has the community formed a deeper respect and understanding for people with a disability and their families including decreased stigma and discrimination and increased appreciation of capacities and contribution?
• Have organisational policies, procedures, and project decisions been reviewed and updated to be disability inclusive?

4.7.Environment
• In terms of ecology, how was the project environmental impact assessment? If not, explain why?
• How is the climate change affecting the project beneficiaries living conditions?
4.8.Covid 19 Pandemic
• How the project achievement has been impacted by Covid-19 pandemic?
• How Covid has made an impact on this – what have been the results, learning, and programme adaptability
The evaluation also helps to measure the impact on individuals’ life’s and perception on the inclusion with beneficiaries, to assess the impact of the project activities on community mindset and livelihood improvement for persons with disabilities, involvement of local authorities in building capacity of persons with disabilities to run income generating activities, involvement and collaboration with microfinance institutions, community participation and development, and savings culture. It will also asses to what extent INGOS have made their mainstream VSLA projects inclusive of persons with disabilities.
The final Evaluation will also look at the broader livelihood development of persons with disabilities, including recognition of persons with disabilities by families and community members.
The Final Evaluation will also identify/document lessons learnt and make recommendations that project partners and stakeholders might use to improve the implementation of VSLA programme with other funding sources.

5.Methodology
The final Evaluation will be conducted by a systematic and objective assessment of the design, implementation and the results of the project since January 2018 to December 2021 (4 years), assessing the effectiveness of intervention against its stated Objectives, Impact, Learning, and Accountability.

Methods for Data Collection:
• The purpose of key informant interviews is to collect data and information from a wide range of people – including people with disabilities, VSLG members, community leaders, government and National Council of Persons with Disabilities (NCPD) staff, NCPD coordinators at local level, Financial Institutions, Local and INGOs implementing VSLA on inclusion of persons with disabilities, and other stakeholders who have first-hand knowledge about the targeted group including MFIs, SACCOs, other agencies and actors (other INGOs / local NGOs,) community development actors, access to markets and local government programs / services, improvement in education, food, health, etc. The representative scope of groups and individuals to be interviewed will be defined with the partner and the consultant.
• Document Review/Analysis: desk review of the documents that might provide supporting information.
On the final day of the field evaluation, the key findings will be presented and discussed with the CBM and NUDOR representatives. The Final Evaluation should use participatory and inclusive approaches and there should be consultation with a wide range of beneficiaries including people with different types of disabilities and stakeholders, Project staff, NUDOR management, local government officials, finance institution, etc.

6.Limitations
The following limitations are identified:
• Accessibility: According to the target groups and due to Covid-19 pandemic, it is envisaged that the team can organize virtual and online interview where it will be required, the focus group discussions facilitated by sign language interpreters, and an on-site physical visit component will be included.
• Number of visits/interviews: The team will take time for the review itself, visit all targeted groups or interview all concerned institutions as well. Efforts will be made to ensure that institutions, MFIs, SACCOs, and stakeholders visited include stakeholders interviewed are as official representative as possible.

7. Scope And Task Of The Final Evaluation
The evaluator will take into consideration the implementation status of the programme and the resource disbursements made from January 2018 to December 2021.
The evaluator will be required to evaluate:
• The results achievement to measure if the project is making satisfactory progress in the timely achievement of outputs as per logframe and related delivery of inputs;
• Evaluate other critical issues relating to results achievement and the factors affecting successful implementation of the project;
• The strategic positioning and partnerships;
• Sustainability of results and exit strategy.

The Final Evaluation is expected to cover the following project components:
• Project Management and implementation and collaboration with other stakeholders at NUDOR Level;
• VSLG member’s engagement and VSLGs activities including savings, loans, social funds, Income Generating Activities; the experience and satisfaction of VSLA members and groups vis a vis the benefits they receive as members of VSLAs.
• Extent of satisfaction with regards to access and use of savings; credit; social fund/safety net; financial education; support/solidarity emerging from the groups; linkages
• Self-assessment of VSLA members on the change that took place regarding financial knowledge, skills, and behaviours
• The Groups cohesion and effectiveness of leadership;
• The consistency in savings and loan repayment incl. default rates;
• The dropout rate and reasons for the same;
• Assess whether persons with different disabilities are equitably participating in VSLAs incl. persons with intellectual and psycho-social disabilities
• The VSLGs’ Financial Linkage to Micro Finance Institutions, SACCO and mainstream banks;
• The linkages created with the NCPD and INGOs implementing VSLAs.
• Analyze gender balance and impact programme had on women empowerment and children with disabilities- Participation of women and girls – important to expand on this as to economic empowerment and especially around approach of caregivers / parents of children with disabilities
• Sustainability of the project results (link with existing government programmes).
• The final Evaluation has the following principal tasks:
• Assess the project design in terms of its relevance to the overall development situation at the national level; relevance to national strategies, relevance to NUDOR mandate, and relevance to beneficiaries;
• Assess the cost-effectiveness of the project interventions;
• Assess the socio-economic situation impact on improving the socio-economic situation of persons with disabilities and their families;
• Assess the relevance and effectiveness of the project’s strategies and approaches for achievement of the project objectives;
• Assess the performance of the project in terms of effectiveness, efficiency, and timeliness of producing the expected outputs;
• Assess the quality and timeliness of inputs, the reporting and monitoring system, and the extent to which these have been effective;
• Assess the relevance of the project’s management arrangements; identify strengths, weaknesses, and lessons learnt with regards to the project
• Analyse underlying factors beyond CBM control that affected the achievement of the project' results;
• Provide recommendations to key project partners and stakeholders after the project

8. Expected Results
The Evaluation Team leader is expected to submit a report complemented with attachments as necessary. The report should be written in English. After receiving the comments, the Team leader will finalize the report and submit to CBM. The final version of the report will be shared with CBM IO and RH, and partners as deemed necessary by CO management.

These following expected result documents will be developed as a result of the process:
Inception Report (due by:20/1//2022) – The Inception report will include the proposed methodologies, data collection and reporting plans with draft data collection tools such as interview guides, a timeframe with firm dates for deliverables, bio of evaluation team and team leader, evaluation work schedule and the travel and logistical arrangements for the team.
First Draft Report (due by: 7/2/2022) – A draft report, consolidating findings from the Evaluation, identifying key findings, conclusions, recommendations, and lessons learnt for the current and future similar projects, will be submitted to CBM CO.

Final Report (due by: 12/2/2022) – The final report will contain a short executive summary (no more than 3 pages) and a main body of the report. The main body of the report covers the background of the intervention reviewed, a description of the review methods and limitations, findings (to be presented by review criteria), conclusions, lessons learned, and clear recommendations.
Recommendations should also outline recommendations that the project staff and the reviewers have in common or different views based on the feedback sessions to discuss the findings. The report should also contain appropriate appendices, including a copy of the ToR, cited resources or bibliography, a list of those interviewed, and any other relevant materials (e.g., tools).
The final report will be submitted in 2 weeks after receipt of the consolidated feedback from CBM.

9.Duration And Phasing
The total duration of the evaluation will be 20 days within the period of 15 January 2022 to 10 February 2022, according to the following plan:

The table below provides a detailed evaluation timeline:
No Task Location Number
of Days
1. Document review Kigali 3
2. Meeting with the project team Kigali 1
3. Initial briefing meeting
CBM CO 1

4. Partner visits, stakeholder’s meetings, interviews, discussions and Focus group discussions with the Audience
Kicukiro 8
5. Wrap-up debriefing Kigali 1
6. Draft Report writing Home based 3
7. Validation meeting TBD 1
8. Final report review Home based 2
TOTAL 20 days

10. Costs and payments
The following batches of payment will be reimbursed upon receipt of proper invoices:
• 30 % of the consultancy cost to be paid at the contract signature and submission of inception report agreed upon
• 40% of the consultancy cost to be paid when the draft report is submitted
• 30% of the consultancy cost to be paid when the final report is satisfactory approved by the donor
The transport and accommodation costs will be covered by the evaluation team.
CBM reserves the right to terminate the contract in case the agreed team members are not available at the agreed commencement of the assignment and if no adequate replacement can be provided. CBM reserves the right to terminate the contract in case of partial or incomplete work, breach of safeguarding and anticorruption policy, substandard work, or inability to meet the timelines.

11. Deliverables
The output of the mission will be the final evaluation Report in English. The structure and content of the report should meet the requirements of the CBM Monitoring and Evaluation Policy. The length of the Report should not exceed 30 pages in total (excluding the annexes).
The Report should:
• Contain an executive summary (mandatory)
• Be analytical in nature (both quantitative and qualitative)
• Be structured around issues and related findings
• Include lessons learnt and Best practices
• Reflect the project impact on the individuals
• Include conclusions and recommendations

12. Consultant Profile And Responsibilities
The Final Evaluation is to be conducted by an individual or firm of consultants with the profile outlined below.
• Master’s degree in Social Sciences or Development studies with at least 3 years of experience in qualitative and quantitative data collection methodologies, skills and experience in conducting evaluation of Livelihood or Economic Development Projects and Programmes;
• Or Bachelor’s Degree in Social Sciences or Development Studies or any other related field with at least 5 years of experience in the field preferably of VSLA and Livelihood or Economic Development Projects and Programmes;
• Experience in research, especially on disability issues and VSLAs.
• Prior experience with similar work in VSLA approach
• International or national comparative experience in the field of local development.
• Experience in leading evaluations of local development support programmes and VSLAs.
• Strong interpersonal, writing, presentation, and organizational skills are required;
• Understanding approaches to communicate technical information to a non-technical audience is critical;
• Ability to work as a team member and collaborate with others;
• Proficiency in English.

Submission Procedure
Interested Consultants with the required profile and experience should submit via e-mail info.rwanda@cbm.org the following documents:
• Letter of motivation;
• Detailed Curriculum Vitae (CV) with three references;
• Copy of degrees (not necessarily notified);
• Technical proposal describing how the consultant intends to undertake this assignment;
• Separate financial proposal;
• At least three certificates of good completion of similar assignments;
• B: for a Company, please include the RDB Registration Certificate and TIN Number from RRA.