NNVAW Partnership
- Advocacy for policy
- Social mobilisation
- Helpline
- Enhance audiences
- Distribute booklets
- Training health, judiciary and police
Levels where impact is measured / captured
Overall Objective
The overall objective of this evaluation is to determine whether Soul City in partnership with NNVAW did what it set out to do and whether this had any impact on:
- creating a supportive environment;
- improving referrals and strengthening services for women who have experienced domestic violence;
- increasing awareness of / action on domestic violence on an individual, community and societal level
which could ultimately increase the safety and well-being of women.
Partnership evaluation process
- Workshop with NNVAW/SC Overview of the evaluation Input
- Formative Research Interviews with key-informants i.e. SC, NNVAW, Lifeline
- Development of Research Tools
- Data Collection
- Analysis and model identification
- Write up
- Dissemination
Table 1: An outcome model to inform the design of the evaluation of Soul City in partnership with NNVAW
|
Health and social outcome
|
Impact on the safety and well-being of women
|
|
Intermediate Health Outcomes
|
Empowerment of women and men
|
Better services - health, welfare and police = ngo counselling
|
Healthy Enviroments
|
|
Outputs and Health Promotion Outcomes
|
Change in knowledge and awareness of VAW, Community Mobilization
|
Change in org. capacity, Referrals, service delivery
|
Media coverage, implementation of Domestic violence act, change in org. capacity, Community mobilization
|
|
Actions
|
Soul City multimedia edutainment vehicle - TV, radio, booklets Partnership - media, helpline
|
Stop Women Abuse Helpline: - Referrals - Counselling, Strengthening capacity of NNAVAW/SC and through them partner orgs.
|
Advocacy strategy: - Mobilising communites, - Media advocacy, - Lobbying policy makers
|
|
|
Education
|
Facilitation
|
Advocacy
|
(? there is fluidity between actions and outcomes on a horizontal level, the vertical levels are heirarchial showing health promotion and intermediate outcomes which can be measured)
Source: Nutbeam, D. (1998) Evaluating Health Promotion - progress, problems and solutions
Table 2: Data source/category of stakeholders interviewed, and methods used for each of the sub-studies
| Sub-study |
Data Source / Category of stakeholders |
Method |
| Organizational and institutional level of impact and lessons learnt |
NNVAW |
x 10 Semi-structured interviews |
|
NNVAW Board |
x 3 Semi-structured interviews |
|
Soul City |
x 1 |
|
(SCNNVAW planned) |
x 9 Semi-structured interviews |
| Access to and quality of services addressing violence against women |
Life Line Directors
Life Line Counsellors |
x 9 Semi-structured interviews |
| - Stop Women Abuse Helpline |
Helpline users |
x 7 Semi-structured interviewsx 1 Focus Group |
|
Telkom traffic report |
Quantitative analysis |
|
Telkom frequency data |
Quantitative analysis
NGOs x 23 Semi-structured interviews |
| Services |
Service Providers
- NGOs
- Police
- Social Workers |
- NW x 3, NP x 2, G x 3
- FS x2, WC x3, KZNx 4, EP x2
- M x1
SAPS x 5
Welfare social workers x 2 |
|
Service Users |
x 3 Semi-structured interviews |
| Advocacy strategyImpact on the implementation of the DVA- analysis of policy process |
NGOs
SAPs - national
Welfare - national
Justice -national
(See S&T policy study) |
x2 semi-structured interviews
x1 semi-structured interviews
x1 semi-structured interviews
x1 semi-structured interviews
(2 x interviews planned) |
| Community mobilization |
Focus Groups (supplemented by Social Surveys) |
Mamelodi (FG)KwaMhlanga (FG) |
| Media Advocacy |
Content and discourse analysis (?) |
|
|
Journalist's book |
x 1 Semi-structured interview
(x1 Interview -- planned)
(Survey of all newsrooms -- planned) |
| Individual Level: awareness and action |
National Survey Sentinel Site Survey |
Quantitative & Qualitative analysis |
Analysis Technique
- Thematic Analysis of Qualitative data (Atlas / ti)
- Telkom data - quantitative analysis
Reality check
- Telkom frequency data only July to end November 1999; (Dec still outstanding)
- Variable interview technique - one inexperienced interviewer. Taken into account in analysis;
- Poor tape quality = some loss of data in Eastern Province.
Sub-studies
- Organisational Impact and lessons learnt
- Impact on access to, and quality of services (helpline and services)
- Impact of Advocacy Strategy
Proposed Conceptual Framework for analysis of the advocacy strategy
Informed by Wallack, 1993 and Ryan, 1991
Proposed Model: analysis of policy process
Source: Klugman, 1998 (based on Walt and Gilson, 1994; Reich, 1996 and Kingdon, 1995)
Organisational Level Impact
- Conceptual Framework: Bolman and Deal (Reframing Organizations: Artistry, Choice and Leadership)
- Structural Frame (e.g. Decision-making, Resource allocation, Communication,
- Human Resources Frame (e.g capacity / person power, psychosocial impact, relationships within and between organizations)
- Political Frame
- Cultural Frame
Questions
- Links?
- Conceptual frameworks?
