Terms of Reference (TOR) for Final Evaluation in Bosnia and Herzegovina in “Promoting Healthier Lifestyles among Youth in Bosnia and Herzegovina by Challenging Gender Stereotypes – Young Men Initiative Project II (YMI)”
Deadline for application: June 19th 2020, 04 p.m. local time.
CARE’s mission in the region is to contribute to post-war recovery and the socio-economic development of Bosnia & Herzegovina, Croatia, Serbia, Kosovo*1 and Montenegro. CARE in the Balkans consists of Offices in Sarajevo, Bosnia and Herzegovina (BiH), in Belgrade, Serbia and Pristina, Kosovo*.
CARE’s work in the Balkans started in 1992, when it provided humanitarian support to people affected by war. In the late 90-ties CARE shifted its focus in the region from humanitarian post-war assistance and rehabilitation to socio-economic development engaging in interventions directed at conflict prevention and peacebuilding, sustainable livelihoods, gender equality and the prevention of gender-based violence.
CARE in the Balkans places the quality of its program at the center of its business and its mission and has developed a regional strategy that encompasses two main program directions: Gender Equality and Social and Economic Inclusion. The goal of the Social and Economic Inclusion Program is to strengthen capacities and create opportunities for marginalized, socially excluded and poor to integrate into society and access rights. CARE’s Gender Equality Program aims to empower women and girls vulnerable to violence, discrimination and poverty, to reach better life opportunities and social justice. CARE’s engagement and contribution lies in strengthening sustainability of key regional, national and/ or local civil society organizations and networks promoting gender equality and diversity, in the context of social inclusion and non-violence.
Young Men Initiative – Promoting Healthier Lifestyles among Youth in Bosnia and Herzegovina by Challenging Gender Stereotypes II or Young Men Initiative II (YMI II) project builds upon CARE ́s comprehensive and programmatic effort to fight interpersonal and gender based violence (GBV) as well as to improve gender equality in Bosnia and Herzegovina and address preventative issues related to youth extremism and violence. The YMI II project will be implemented in Bosnia and Herzegovina, in Republic of Srpska and the three cantons of the BiH Federation (Herzegovina- Neretva Canton, Sarajevo Canton and third canton that will be selected in the first quarter of the first project year after a conducted assessment reflecting interest of local partners and responsible ministries to be engaged and to cooperate). It will target youth, in particular young men vulnerable to violence and their anti-social behaviors by strengthening the relevant skills, knowledge and attitudes leading to improved behaviors around gender equitable norms and non-violence.
The project that CARE Balkans proposes would continue to build on the success of the first phase and contribute to bringing about positive changes in attitudes and behaviors with young people of secondary school age group that relate directly to health, violence, extremism and gender equality. This would be done by addressing the issues on multiple levels through five main directions of the intervention: a) increasing capacities of youth organizations’ staff to deliver our specialized curriculum, Program Y, and Program Y+ to socially marginalized populations, out of school youth and youth offenders and Program Y++, adapted Program Y for higher grade pupils in elementary schools; b) increasing the number of cantons and or entity ministries that accredit the program and support its scaling up in more schools c) developing new online tools and promoting the use of technology for developing low cost models for implementation and evaluation in targeted schools; d) raising awareness and changing attitudes of youth toward various aspects of health, violence and gender equality and e) supporting and or engaging with existing coalitions of NGO’s and citizens to advocate for comprehensive life skills education in the schools.
CARE builds on the lessons learned from CARE ́s previous work involving youth, gender and education, utilizing both research and evaluation in the design of the proposed interventions. It is anticipated that during a three-year implementation period over 30 schools will take part in the project, up to 10,000 young people will be reached directly and about 50,000 indirectly. A committed and more competent network of youth organizations and activists, together with the active engagement of relevant government institutions on all levels, will build a solid basis for sustainability and impact of the main project objectives. Thereby, this initiative will contribute to a long-term goal of young people in Bosnia and Herzegovina being personally and professionally empowered to act as agents of change in their communities, regions and nationally, leading towards a more positive future.
This project aims at scaling up and mainstreaming earlier achievements related to the implementation of the Gender Transformative Life Skills program, or short Program Y, via targeted advocacy and a close cooperation with relevant stakeholder through the support of movement/coalition building through the development of new alliances that engage parents and citizens in supporting gender equality focused life skills education program. Relevant stakeholders include the Ministries of Education at entities and cantonal levels, gender agencies, academic institutions, secondary schools, educators, media and other relevant stakeholders.
The project’s overall goal is to increase the uptake of healthy, nonviolent and gender equitable lifestyles among young men and women in Bosnia and Herzegovina.
As described in detail in previous chapters, the intervention intends to address harmful lifestyles that impact both young men and women. Also, our intention in this phase is impacting social movements and citizen coalitions in the order to encourage government to actively promote/address gender equality, prevent gender-based violence, life skills and health education in schools. Through the work with local NGOs active in gender equality promotion and youth development a higher percentage of young people will be reached to learn important life skills and consequently practice more gender equitable attitudes and behaviors. In cooperation and synergy with other similar initiatives implemented by the government and other local and international NGOs, this project would contribute to an overall decrease in school and community based violent incidents involving youth as well as to an increase of healthy, non-violent and gender equitable attitudes and behaviors reported by the targeted youth. Some of potential partners that CARE already contacted and who expressed interest for cooperation for work in elementary and high schools are TPO Foundation, Sarajevo, Association of cooperation of parents and schools in BiH.
The goal would be reached through a combination of four expected outcomes as explained below:
Youth NGOs have increased capacities and resources for supporting Program Y and Be a Man clubs in their communities, focusing on marginalized and out of school youth by implementing Program Y+ and Program Y++.
Indicators:
In order to accomplish this, the work of CARE, key local partners and Youth NGOs will be focused on meeting the following three output level results through a set of interlinked activities:
Program Y accredited and is part of a mandatory or extra-curricular school program with its upgraded versions Y+ and Y++ being tested with out-of-school youth and elementary school students.
Indicators:
In order to accomplish this, the work of CARE, key local partners and Youth NGOs will be focused on meeting the following five output level results through a set of interlinked activities:
School educators and students youth peer educators in targeted schools will be trained and their professional teaching and mentoring capacities will be built for implementation of Program Y, establishing and or reinforcement of school based clubs and piloting Program Y+
and Program Y++. At least 75 school educators and 75 students youth peer educators (male- female) from up to 30 schools will be trained and will be motivated to successfully deliver Program Y and new Program Y+ and Y++ workshops through organizing regional teachers counselling and trainings led by key staff from BiH key NGOs and partners from regional component of the YMI II from Serbia and Croatia. At least 150 youth student peer educators will be trained and empowered at youth leadership summer camps for spreading Program Y methodology in its communities. E-course will be developed for teachers/educators and youth peer trainers based on existing online Program M course developed by CARE partner organization Status M from Zagreb and implemented in Croatia in cooperation with responsible Ministry of Education (http://www.m-centar.hr/en/education/)…Participants of the course Internet portal M-center, within which is Internet course “Young Men Initiative” available assured three persons who are overseeing the progress of the group and are available to them during course. The course consists of 4 chapters and that implies that participants finishes all elements of one chapter in order to be able to approach next chapter. Total duration of the course is one month. Participants can register on the course by sending request to our main e-mail address, after which we create an account and send all the necessary info for signing in and start-up. In the beginning and in the end participants fill in pre and post testing and evaluation of the course, in order to assure system of evaluating quality of course conduction and the possibility of continuously specialization of it. Also, in this way we will estimate the efficiency of conduction throughout improvement in knowledge about specified topics.
Youth have increased awareness and improved attitudes related to health, violence and gender equality through participation in group education and youth led-campaigns, on healthy lifestyles, violence prevention and gender equality at the local and national level.
Indicators:
In order to accomplish this, the work of CARE, key local partners and Youth NGOs will be focused on meeting the following two output level results through a set of interlinked activities:
Beside the specific activities related to fulfillment of the project outcomes, there is a set of those that should be implemented during the inception phase and during the entire process, and can be summarized as follows: regular meetings of CARE and key partners for the planning, monitoring, evaluation and reporting purposes, external consultants’ engagements, assessment and research preparation and implementation, field visits and study trips.
Social movements / citizen coalitions activated and/or strengthened to encourage government to actively promote/address gender equality, prevent gender based violence, life skills and health education in schools.
Indicators:
In order to accomplish this, the work of CARE, key local partners and Youth NGOs will be focused on meeting the following four output level results through a set of interlinked activities:
Target Group and Beneficiaries
The target group of the project includes state, entity and cantonal ministries responsible for youth, education and health; the state-level agency for education with its coordinating role, educational professionals/teachers; youth aged 15-26 with an emphasis on boys and men in vocational schools;
parents; and NGO partners who are developing as national resource centres related to this work.
Beneficiaries: In the early stage, the project will work through educational workshops and campaigns with young men and women in 10-15 secondary schools/communities, reaching over 10,000 youth (approx. 70% male and 30% female) over 3 years. Through campaigns and other related activities 50,000 youth will be targeted indirectly. In addition, Roma youth will be integrated into all activities. Later in the project implementation and following successful policy dialogue and changes in curricula, the beneficiary pool will be expanded to teachers and youth in the entire country.
The intention is to focus on both entities, to a total of 8 -10 locations when it comes to reaching the youth; primarily to Sarajevo and Mostar Cantons and Banja Luka area. However, the key partner organizations will reach to other areas where they are already working. The cooperation with the government will be done on all the levels, from municipalities to entity, cantonal and state levels.
The target group of the project includes entity and cantonal ministries responsible for youth, education and health; educational professionals/teachers; youth aged 13-26 with an emphasis on boys and men and girls and young women in vocational high schools and elementary schools, marginalized and out of school youth; parents; university students and NGO partners who are developing as national resource centres related to this work and Youth NGOs from smaller BiH communities.
Beneficiaries: The project will work through educational workshops and campaigns with young men and women in over 30 secondary schools/communities and in 3 elementary schools, reaching over 10,000 youth (approx. 70% male and 30% female) over 3 years. Through campaigns and other related activities 50,000 youth will be targeted indirectly. In addition, Roma youth and other marginalized youth will be involved in all activities. Later in the project implementation and following successful policy dialogue and changes in curricula, the beneficiary pool will be expanded to teachers and youth in the entire country.
The intention is to focus on both entities, to a total of at least 10 locations when it comes to reaching the youth; primarily to Sarajevo and Mostar Cantons and Banja Luka area. However, the key partner organizations will reach out to other areas where they are already working, Jablanica, Tuzla, Brčko, Bijeljina, Zenica, East Sarajevo and Novi Travnik. The cooperation with the government will be done on all the levels, from municipalities to entity, cantonal and state levels.
Committed and more competent network of youth organizations and activists, together with the active engagement of relevant government institutions on all the levels, would build during the project implementation a solid basis for sustainability and impact of the main project objectives. CARE believes that only by providing opportunities for and by engaging young people into gaining new skills and knowledge that positively influence their development and change of attitudes and behavior can we expect them to become agents of change and active and responsible contributors toward a better life and a more optimistic future.
The final evaluation will be carried out to contribute to a comprehensive understanding attitudes amongst boys and men and girls and women, parents, key schools staff, ministry of education and pedagogue institutes on cantonal and entities level, within Bosnia and Herzegovina societies participating in the program toward gender based violence, gender equity and healthy life styles in the project after more than two years and half of intervention, to work-out lessons learned and to provide recommendations for further actions. The final evaluation will be carried out to contribute to a comprehensive understanding of project results accomplished as well, to identify lessons learned and provide recommendations in order to enhance CARE in the Balkans’ future work, accountability and inform decision-making.
We intend to assess the knowledge level, attitudes, and behavior shifts since the beginning of the intervention of the above mentioned target groups by focus group interviews and individual interviews (“face to face” and through skype) after the different interventions targeting each group will be concluded. The End line assessment report findings that will be based on quantitative research using self-administered questionnaires in May 2020 and that will be organized separately from the process of final evaluation are expected to be included in the final evaluation report. The final evaluation contributes thus to accountability towards our main stakeholders (beneficiaries, donor, wider public) as well as to learning that shall inform future programming.
The final evaluation process is going to be conducted during the last phase of the project implementation, in period from June 29th 2020 till October 30th 2020 (the detailed evaluation schedule is described in below written section The Timetable).
The overall objective of the final evaluation is to assess the results achieved based on OECD evaluation criteria. The evaluation shall address the first 33 months of project implementation.
Thus the specific objectives of this evaluation are to assess the relevance, effectiveness, efficiency, sustainability and (the road to) impact of the project in relation to the stated objectives and expected results, taking into consideration target groups/partners, beneficiaries and other affected parties.
The results of final evaluation will be used to inform the implementers, the donor and the involved stakeholders about the final findings and recommendations of the YMI project and to enable learning, improved planning and implementation of future CARE Balkans projects/programs in the BiH and region.
The consultant should use established baseline and end line indicators for benchmarking research findings from baseline assessment report – and refer to those defined in logical framework – to enable assessment of project outcomes and if feasible impact at the end-line.
Beside the analysis of the level of success of meeting the above stated criteria and complementing the specific evaluation questions below the evaluators will also assess the following aspects while conducting the evaluation:
An important note: It is expected that the evaluation field research should be conducted in Sarajevo, Mostar, Banja Luka and in at least three out of seven other communities where YNGOs are implementing Program Y and its modified versions for piloting in elementary schools and out of schools premises (Brčko, Bijeljina, Istočno Sarajevo, Tuzla, Zenica, Novi Travnik and/or Jablanica). If the travel is restricted due to state of emergency such as in case of a recurrence of the pandemic and lock down – it will be done online in cooperation with CARE and partners.
1) Relevance
2) Effectiveness
3) Efficiency
4) Impact
Wherever feasible building upon the quantitative end line assessment the evaluation team is expected to assess:
5) Sustainability
The report should also refer directly to the logical framework, assessing if the defined outcomes indicators have been met.
In order to produce the requested product the Consultants will conduct the following:
Field research in at least six locations (Mostar, Sarajevo and Banja Luka and in at least three out of seven communities where YNGOs are implementing Program Y) related to the implementation of the partners’ organizations grants in the framework of ER1, ER2, ER3 and ER4:
If feasible participatory observations in the target localities (school workshops, peer education workshops, Be a man club meetings, street campaign performances, etc.) Details will be provided by CARE project manager).
5. Produce a high-quality evaluation report in English. The evaluation report should contain at most 30 pages without annexes.
Indicative workload:
| Desk Research | 2 days |
| Inception Report | 2 days |
| Field Research– visiting partners (after state of emergency is canceled) and/or if necessary, follow up skype interviews | Up to 6 days |
| Field research – individual interviews during partners meeting (after state of emergency is canceled) or online | Up to 3 days (individual interviews with key staff from partners organizations and with CARE staff) during partners meeting in June/July or August/September 2020 – if CARE organize the meeting (lodging costs will be covered by CARE while travel costs should be calculated as a part of consultant/s daily fee) |
| Drafting Evaluation Report | 6 days |
| Incorporating Comments and Final evaluation report submission | 1 day (The Leading Evaluator) |
| TOTAL | Up to 20 days |
| Timetable | Output | Comments |
| 06th of June –19th June 2020 | Call for proposals | CARE will announce call for the Evaluator. |
| In the period June 29th – July 15th 2020 (total up to 2 days of engagement) | Desk research and Inception Report | The Evaluator will draft the Inception Report based on an initial desk research. The Inception Report will be presented through skype organized conference call and sent by e-mail to Project Manager. |
| July 15th – July 31st 2020 (total up to 3 days of engagement) | Field research 1 – visiting partners (after state of emergency is canceled) and/or if necessary, follow up skype interviews | Field Research will be conducted during the ongoing CARE partners’ national activities if they are organized (depend of situation with COVID), as agreed with CARE and stakeholders (participatory observation and main target population interviewing – individually and through focus groups interviews). |
| August/September (tbd) (total up to 3 days of engagement) | Field research 2 – individual interviews during partners meeting and/or if necessary, follow up skype interviews | CARE will organize partners meeting at the end of August or beginning of September 2020 (depend of situation with COVID). 1 and 1⁄2 of days of meeting will be dedicated to the final evaluations (In the case that CARE organize partners meeting, lodging costs will be covered by CARE while travel costs will be included in daily fee of consultant/s). |
| September 15th – 30th, 2020 (total up to 3 days of engagement) | Field research 3 – visiting partners/countries and if necessary, follow up skype interviews | Field Research will be conducted during the ongoing CARE partners’ national activities if they are organized (depend of situation with COVID), as agreed with CARE and stakeholders (participatory observation and main target population interviewing – individually and through focus groups interviews). |
| October 01st – 15th, 2020 (total up to 6 days of engagement) | Draft Final Evaluation Report | The Evaluator will deliver the draft Report to CARE by September 30th, 2020. |
| October 20th – 25th, 2020 (total up to 1 day of engagement) | Incorporating Comments and Final evaluation report writing | CARE will review and provide its comments to the Evaluator by October 20th, 2020. |
| October 30th, 2020 | FINAL Evaluation Report | The final report will be delivered to CARE in electronic format, in English, by October 30th, 2020, 04 p.m. at latest. |
The Evaluator will be engaged in the period June 29th – October 30th, 2020, for a maximum of up to 20 working days. The final product will be delivered to CARE by October 30th, 2020.
Note:
CARE International Balkans HQ Sarajevo Office
Hasana Kaimije 11, 71000 Sarajevo, Bosnia and Herzegovina
Tel: +387 33 536 790 Fax: +387 33 536 791
Sub-office: Aleja Svetog Save 7A, 78000 Banja Luka, Bosnia and Herzegovina Phone: +387 51 258 200, 258 201
Fax: +387 51 257 361
In case of field visits, the Consultant(s) will be able to conduct interviews with partners’ representatives, identified stakeholders and CARE’s project staff during regular project activities as agreed with the CARE Project Manager. In those cases, the travel and food/refreshment costs will be covered by consultants’ fee and will be part of contracted consultancy fee beside participation at the partners meeting in August/September 2020 (if we organize the meeting) where lodging costs will be covered by CARE beside travel costs that will be included in consultant/s fee.
Interviews with high school students, parents, school principals, pedagogues and school staff, social workers, university students, ministries representatives (individual interviews and/or focus group interviews) will be done in June, July, August and September 2020. The number of participants at the interviews will vary from site to site and will be determined by CARE in accordance with the size of total targeted population by each the intervention site.
The consultants will be paid in two separate installments.
First payment will be made upon submission the receipts of first invoice and consultancy time sheet (CARE will provide templates) with indicated tasks performed and dates of tasks to be implemented after the inception report is submitted, no later than 7 days after the submission day. First payment will include advance for Field research (up to 6 days).
Second and final payment will be made upon submission of the receipts of the second invoice and consultancy time sheet with indicated tasks performed and dates of tasks to be implemented after final report is delivered, no later than 7 days after the submission day.
The payment for the work defined in the Contract will be made upon the work completion and the final product delivered to CARE, with all the necessary documentation as per CARE’s administrative procedures.
The deadline for application is June 19th, 2020, 04:00 PM local time.
Required qualifications
Cost (How to apply for this job)?
If an individual is applying it is necessary to enclose CV with printed hard copies (or e-documents in PDF format on CD) or active web links that indicates experience described in above eligibility section and daily fee/rate per day in BAM and the number of days predicted for the work. The Consultant should make a breakdown of costs in the budget part of the proposal, including different activities and types of costs (travel related costs should be included into the budget, if any). If company is applying, beside above listed requests, must enclose proof of tax paid.
Offers should be submitted by June 19th 2020 at 04.00 p.m. to the following address: Procurement Team, CARE International Balkans, Hasana Kaimije 11, 71 000 Sarajevo or to the e-mail address [email protected]
The offer that is chosen by CARE International Balkans will be notified in writing by June 26th 2020.
Following documents have to be submitted in hardcopy and softcopy formats:
End line Evaluation Report:
Report should be written in English (text must be edited free from spelling mistakes and unclear linguistic formulations).
The Consultant(s) is/are expected to include in his/her application:
CARE commits itself to:
Supported by
