UNICEF and Johns Hopkins University Center for Communication Programs

Abstract

"The protocol for SCI's [Sara Communication Initiative's] process and outcome evaluation was designed and supervised by an independent research expert from the University of West Michigan, USA (Russon, Nov. 2000). The results are summarized below. The research capacity in five countries was also reviewed in order to identify the national research teams to undertake this work.

"The first component of the SCI evaluation was a study of the implementation process, conducted in July-September 1999....The implementation process study was conducted in Nigeria, Uganda, Kenya, Tanzania and Mozambique in the first phase. It was conducted through interviews with key UNICEF personnel and partners, a review of documentation, and interviews and group discussions with Sara users and intended audiences.

"The second component of the evaluation was a study of outcomes with both quantitative and qualitative parts. These findings, it was believed, would enable UNICEF and its partners to monitor the progress of the initiative, and are also necessary for accountability. The qualitative component of the outcome evaluation was designed to understand the SCI's effect on behaviour development and change. This was conducted through qualitative case study research with communities in Uganda and Kenya. A set of case studies was conducted in 1999/2000. In addition to the extensive formative research on each episode, this research provides further information on the extent to which SCI is responding to the priorities of local people...

"Results of the Implementation Study...

This study focuses on four issues:

"The findings included the following key issues:

"Results of the Quantitative Study

The survey was conducted in 25 districts in Tanzania mainland where SCI has been implemented for 2-3 years and has reached a level of maturity....Key findings reported in July 1999 included the following (Mbago and Sichona, Nov. 1999):

"It was concluded that where Sara had been applied in programming in a concerted way, she was rapidly becoming known to target audiences. In only two years of programming work she was already recognised by a third of the girls in the programme districts. Low mass media recognition was attributed to the fact that TV access was poor, overall in these districts and Sara radio programs had only been broadcast on BBC short wave and not yet on Radio Tanzania at the time of the study. However, the overall recognition of Sara, it was concluded, is a positive sign.

"Results of the Qualitative Evaluation Studies

The third component of the evaluation was the qualitative study of outcomes, to provide insights into the role of SCI in attitude and behaviour development and change. This focused on: 1) how the life skills that girls learned though SCI have fostered their participation in their families' and communities' development, and 2) how SCI has influenced gender relationships of boys and girls. These studies were conducted by national research agencies in Kenya and Uganda, two countries which had seen a certain level of implementation activity. The Kenya research study was conducted by the Institute of Development Studies (IDS, 2000), affiliated with the University of Nairobi's College of Humanities and Social Sciences. The Uganda study was conducted by the Makerere Institute of Social Research at Makerere University, Kampala.

"The research involved in-depth interviews and focus group discussions. Case studies of some girls and situations were carried out, working closely with girls and their communities to explore the impact of SCI on their lives....

"[I]t is apparent that these adolescent girls have acquired skills of discerning the difference between good or bad intentions. It is interesting that adolescent girls recognize the dangers associated with developing relationships with men through acceptance of gifts. While it takes unwavering courage for one to reject gifts, it is clear among majority of adolescents that small gifts from men constitute the greatest danger for the survival of adolescent girls....

"Conclusion on Mid-Term Evaluation

The analysis of the various research studies for the mid-term evaluation provides good evidence that Sara has the potential to be recognised widely throughout Sub-Saharan Africa as a symbol for girls' empowerment in the face of HIV/AIDS and other threats to health and well being. She is seen as a supportive, positive role model for girls' rights in areas where a reasonable attempt has been made to program with Sara communication stories and tools. However, uptake by UNICEF country offices has been uneven due to the decision-making process in each office. It was recommended by the mid-term evaluators that UNICEF should capitalise on the investment and continue to support and expand the SCI implementation process in Sub-Saharan Africa."

Click here to access the background paper containing this evaluation, which totals 91 pages, in PDF format.

Click here for a summary of the Sara Project