Advocacy evaluation resources

Here is a non-exhaustive list of some advocacy evaluation resources available online  (n.b. most links will take you directly to a PDF document).

Theory of change:
Julia Coffman & Tanya Beer (2015), The Advocacy Strategy Framework; A tool for articulating an advocacy theory of change

UNICEF (2014), Theory of change; methodological briefs 

Advocacy monitoring and evaluation methods/approaches:

Saferworld learning paper (2016), Doing things differently – rethinking monitoring and evaluation to understand change (outcome mapping and harvesting)

Robin Kane et al (2017), Contribution Analysis in Policy Work; Assessing Advocacy’s Influence

Harvard Family Research Project (2009), A User’s Guide to Advocacy Evaluation Planning

Julia Coffman (2019), Current Advocacy Evaluation Practice, Center for Evaluation Innovation.

Julia Coffman and Ehren Reed (2019), Unique Methods in Advocacy Evaluation

Intrac (2009), Tracking Progress in Advocacy: Why and How to Monitor and Evaluate Advocacy Projects and Programmes

Oxfam, Process Tracing – Draft Protocol

Guidelines:

CARE (2018), Advocacy and Influencing MEL Guidance

UNICEF, Monitoring and evaluating advocacy; companion to the advocacy toolkit

CIPPEC (2011), Learners, practitioners and teachers; Handbook on monitoring, evaluating and managing knowledge for policy influence

ODI (2014), Monitoring and evaluation of policy influence and advocacy

Communicating monitoring and evaluation results:

Glenn O’Neil (2017), A Guide: Integrating Communication in Evaluation

CDC (2013), Evaluation Reporting: A Guide to Help Ensure Use of Evaluation Findings

“Think pieces” on advocacy evaluation:

Bodille Arensman (2019), Advocacy Outcomes Are Not Self-Evident: The Quest for Outcome Identification

Jim Coe and Rhonda Schlangen (2014), The value iceberg: weighing the benefits of advocacy and campaigning

Jim Coe and Rhonda Schlangen (2019), No Royal Road: Finding and Following the Natural Pathways in Advocacy Evaluation

Jim Coe and Juliette Majot (2013), Monitoring, evaluation and learning in NGO advocacy; Findings from Comparative Policy Advocacy MEL Review Project

Annette L. Gardner and Claire D. Brindis (2017), Advocacy and Policy Change Evaluation: Theory and Practice (a book!)

Examples of advocacy evaluation reports:

UNHCR (2019), Evaluation of Effectiveness and Relevance of Advocacy Approaches in Europe

Norwegian Refugee Council (2014), Evaluation of NRC’s 2012-13 protection and advocacy work in the DRC

Oxfam America (2015), Evaluation of global advocacy programme; Global Leaders Empowered to Alleviate Poverty

Norwegian Refugee Council (2015), Evaluation of global advocacy initiative on housing, land and property

Oxfam International (2013), Evaluation of global communications campaign GROW

Read More

Webinar: How do Not-For-Profit organizations measure the results of their advocacy?

Join me for this webinar on Thursday 20th February 2020 at 15:00 GMT / 16:00 CET / 10:00 EST to learn how Not-For-Profits are measuring the results of their advocacy and what your organization can learn and do in this direction.

The webinar will be moderated by AMEC NFP Group co-chair Natalia Vaccarezza of UNICEF and feature Chris Stalker, Senior Advisor Policy & Campaigns at Oxfam America and myself – Glenn O’Neil, Founder of Owl RE research and evaluation consultancy.

Participants will gain insight using practical examples on:
-Challenges commonly faced in advocacy evaluation and possible solutions
-Trends in the field of advocacy evaluation
-Tools and tactics for effectively measuring advocacy results
Recommended actions for integrating evaluation and measurement in advocacy of NFPs

Register here>>

Read More

Event: Integrating communications in evaluation – 11h00 – 30 January 2020 ILO, Geneva

For those in Geneva region and interested in communications and evaluation – I will be making a presentation in January 2020, read more:

The Evaluation Office of the International Labour Organization invites you to a presentation by Glenn O’Neililo_image.  The topic of Dr O’Neil’s presentation will be Integrating communications in evaluation.

Communications is an important aspect of evaluation; it has been said that without communications, evaluation would not be possible.

Evaluation commissioners and evaluators are already communicating – but is communications being used optimally to support the evaluation process? In this presentation, Dr O’Neil will challenge the assumptions of how communications “works” for evaluations and propose solutions based on his experience as both a communicator and evaluator, backed up by communication practice and theory.

Dr O’Neil is founder of Owl RE, evaluation and research consultancy, Geneva. Since 15 years, he has led over 100 evaluations and reviews for some 40 organizations, including UN agencies, NGOs, foundations and governments. Dr O’Neil was previously a professional communicator in the non-profit sector and has produced his own guide on Integrating Communications in the Evaluation Process (pdf).

The event will take place from 11:00-12:00 on Thursday 30 January in the ILO Library on R2 (main floor). After the presentation, there will be a networking lunch (at your own expense) in the ILO cafeteria.

No need to register – please come to the ILO reception at 10:50 and ask for Craig Russon of the ILO Evaluation Office.

Read More

New and better evaluation criteria

The OECD/DAC evaluation criteria – the main guidance used for most evaluations has been revised. Following a broad consultation, the revised criteria have been published (pdf).

The main changes are the addition of a new criterion: Coherence; a better explanation of how to use the criteria; and a recognition that the criteria are used across many sectors and not only for the development sector.  The explanatory document (pdf)  is well worth a read.

View the criteria here (pdf) >>.
dac

Read More

Communication evaluation measurement month

November is communication evaluation measurement month! AMEC – the International Association for Measurement and Evaluation of Communication and its members and partners are hosting many events – online and in-person globally – check out the calendar >> amecMMM

Read More

A Guide: Integrating Communication in Evaluation

guide_commsI’ve put together this guide for anyone who wants to learn how communication can more effectively support evaluation: evaluation consultants, communication consultants, evaluation commissioners and programme/project staff participating in evaluations.

View the guide (pdf)>>

Read More

1 day workshop in Bern: The politics of evaluation; 2 November 2019

Join a 1 day workshop in Bern, Switzerland on the Politics of Evaluation taught by Dr. Marlène Läubli Loud.

The course will look at why and how evaluation is in itself a political activity and consequently, how the «political» interests of the various partners involved can play an important part in influencing the evaluation process. We will look at aspects of political influence and practice how those can be managed to avoid conflicts of interest and minimise risks.

politics_eval

Further information (pdf) >>

Read More

New resource: No Royal Road: Finding and Following the Natural Pathways in Advocacy Evaluation

adv_eva

Jim Coe and Rhonda Schlangen have published a very interesting publication on advocacy evaluation.

The highlight six factors that they believe should change for monitoring and evaluation of advocacy:

1. Better factor in uncertainty.

2. Plan for unpredictability.

3. Redefine contribution as combinational and dispositional.

4. Parse outcomes and their significance.

5. Break down barriers to engaging advocates in monitoring and evaluation.

6. Think differently about how we evaluate more transformational advocacy.

Learn more about the publication>>

Read More

Sketches from communication evaluation summit

If you missed the AMEC Summit on communication evaluation in May 2019 as I did, there are some great summary sketches of the main sessions by Redanredan. See an example below; well worth to check out:

0935-Quantifying-the-creative-in-a-financial-services-B2B-environment-570x270

 

Read More

A framework for context analysis

Here is an interesting tool to help with context analysis: ‘Context Matters’ framework – to support evidence-informed policy making.  The tool is interactive and you can view the different elements from various perspectives. Designed to support the use of knowledge in policy-making, it could also be of interest to researchers and evaluators as an analytical tool for contexts.
View the interactive framework here>>
Read more about the framework here>>

Contextmattersfw

Thanks to Better Evaluation for introducing this new resource to me.

Read More