Owl RE evaluations range from multi-country complex programmes to targeted specific initiatives. Using a mixed-methods approach Owl RE applies a variety of methods including multi-lingual surveys, in-depth qualitative methods (interviews and discussions), policy tracking, content analysis, media and digital monitoring, contribution analysis and network mapping. Using participatory approach involving stakeholders at the design, data collection and delivery stages is a priority. Working in multiple languages, Owl RE is conscious about the importance of context and culture. Owl RE produces high-quality reports applying creative ways to communicate evaluation findings including multimedia reports, videos, webinars, infographics and visual summaries. Owl RE specialises in the following areas:
Owl RE supports organisations in evaluating their communication activities and initiatives. As experienced communicators, Owl RE understands the challenges and opportunities today in managing and evaluating communications.
Focused on evaluating communication outcomes a range of methods are used including stakeholder interviews, audience surveys, focus group discussions, case studies, media and digital monitoring, tracking mechanisms, and content analysis. Our experience includes:
- Evaluation of global communication campaigns of NGOs and international organisations
- Evaluation of European Union communication campaigns
- Humanitarian and field communications assessments
- Crisis communication reviews
- Evaluation of corporate communication of international organisations
- Analysis of communication products – videos, portals, publications and corporate magazines
- Digital communications reviews – web, social media and mobile
As an associate member of AMEC – the International Association for the Measurement and Evaluation of Communications, Owl RE supports the 2015 Barcelona Declaration of Communication Measurement Principles representing a global standard for communication evaluation.
Owl RE’s evaluations of advocacy campaigns and programme focus on providing insights for organisations on the success of their advocacy; identified what “worked” well and what could be improved to help the organisation establish future directions for projects, maximising their influence and impact.
Owl RE works with organisations to understand how they sought to influence through theory of change and outcome mapping. While using a range of qualitative and quantitative methods, we mostly work with contribution analysis to determine the contribution of the advocacy initiative to the changes seen. Our experience includes:
- Evaluation of global NGO advocacy programmes and campaigns
- Evaluation of regional advocacy strategies for human rights and development coalitions
- Review of advocacy in support of humanitarian programmes for UN agencies, NGOs and international organisations
- Review of Global advocacy set-up and coordination
- Assessment of advocacy capacity development for local partners
Norwegian Refugee Council
Evaluation of global advocacy initiative on housing, land and property.
Digital communication evaluation
In an increasingly digital business environment, Owl RE supports organisations in understanding and evaluating the results of their digital communications.
Using a range of methods including user surveys and interviews, web and social media analytics, expert reviews and benchmarking studies, Owl Re is able to generate a holistic perspective of the impact that digital communications initiatives may have.
Expertise in this area includes:
- Evaluation of online initiatives and campaigns
- Audits of websites/portals
- Expert reviews of websites
- Benchmarking studies of comparable websites
- Needs assessments for digital communications
- Studies of digital audiences – web, social media and mobile
- Development of social media strategies
We partner with usability experts Telono for complementary services in user experience such as usability testing and eye-tracking studies.
Owl Re supports organisations through the evaluation of events such as conferences, seminars, workshops, and lectures. Focusing on holistic review of the event, Owl RE examines the content, processes, setting, interactions and intended outcomes. Event evaluations range from assessing the immediate impact on participant knowledge to the effect and changes linked to their work.
Owl RE uses a variety of methods including participant surveys, focus group discussions, content analysis, network mapping and onsite “deep-dives” into the event experience. Expertise in event evaluation includes:
- Evaluation of global summits of over 4000 participants
- Evaluation of annual business summits for professional associations
- Evaluation of internal organisational workshops / retreats
- Evaluation of professional lectures / presentations
- Mapping of networks developed during conferences
- Post-conference impact studies
International Union Against Tuberculosis and Lung Disease:
Evaluation of the World Conference on Lung Health.
Humanitarian organisations face particular challenges in evaluation given the fragile and insecure contexts they are working in.
Owl Re considers these challenges when evaluating their programmes, projects and strategies.
Experience in evaluating humanitarian organisations includes:
- Evaluation in conflict zones and complex crises
- Evaluation of humanitarian communication and advocacy
- Evaluation of emergency/surge response and capacity building
Owl RE has experience evaluating diverse sectors including gender, protection, food security, livelihoods, shelter and health; areas such as information and knowledge management, needs assessment and standards; and legal topics including disaster law, international humanitarian law, housing, land and property.
Owl RE (through Glenn O’Neil) is an observer member of Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP).
MSF (Doctors without Borders)
Lessons Learnt review: UNITAID Grant for MSF HEP-C treatment globally
Improving the effectiveness of development programmes supports greater learning and accountability for organisations. Owl RE works with organisations in evaluating their development programmes ranging from technical assistance to capacity building and grassroots initiatives.
African Climate Change Resilience Alliance (ACCRA)
Evaluation of climate change resilience programme