Events

The 24th Event of the Vienna Evaluation Network took place on November 17, 2022, 4-5.30pm CET

Topic: Evaluability Assessments and their practical application

by guest speakers  Sigrid Breddy & Tonka Eibs (Austrian Development Agency)

This was a HYBRID event: in-person and online. 

We thank Médecins sans Frontières (MSF) Vienna for hosting the event.


View or download the slides (PDF) here

Visit the ADA Evaluability Assessment Guidance here


Evaluations can face several challenges impeding the credibility of its results: The design (e.g. the Theory of Change) of an intervention being evaluated is often insufficiently clearly defined; relevant data, such as baseline or monitoring data are not or only partially available; expectations regarding the use and purpose of an evaluation are greatly varying; or the (institutional) context hampers the implementation of an evaluation. This is particularly the case for complex interventions such as multi-dimensional programmes, thematic policies or country strategies. To determine and address potential challenges early enough, evaluability assessments (EAs) are oftentimes used before starting an evaluation in order to make an intervention more evaluable, thereby strengthening the quality and use of the subsequent evaluation by making it more feasible, meaningful and cost-effective.

Recognising the importance and potential of EAs within Austrian development cooperation, the Austrian Development Agency together with the Ministry of Foreign Affairs, the Ministry of Finance, the Ministry for Climate Action and the Development Bank of Austria jointly developed a guidance document on Evaluability Assessments within the overall framework of the Evaluation Policy of the Austrian development cooperation. The guidance document establishes a common understanding and provides a framework and tools for the implementation of EAs, thereby promoting conceptual clarity and practical use of EAs within the Austrian development cooperation. Other development partners and stakeholders are invited to apply – and to provide feedback on the application of – this guidance document as well, to promote learning and continuously enhance our evaluation practice.

The presentation will give an overview of the conceptual framework for EAs as set out in the guidance document on Evaluability Assessment of Austrian development cooperation. To that end, we will set out the process of planning, implementing and using EAs and introduce the use of checklists to assess the evaluability of an intervention by examining the (i) intervention design; (ii) data availability, (iii) stakeholder demand and (iv) institutional context.

The presentation will be followed by a discussion and exchange of experience with/future plans of conducting EAs to assess the evaluability of interventions and enhance the quality of subsequent evaluations.

Sigrid Breddy holds a PhD and an MA in Political Science from Vienna University and an MSc in Development Management from the London School of Economics (LSE). She has worked in multilateral and bilateral development cooperation for over 15 years and has held various leadership and specialist positions in the area of planning, monitoring and evaluation, development finance statistics as well as research and knowledge management, both at
headquarter and country office levels. Sigrid currently serves as global head of Evaluation and Statistics at the Austrian Development Agency (ADA) in Vienna. She has previously worked for UNICEF based in Myanmar, Vietnam and Mozambique, as well as for the European Commission based in Brussels, among others. Sigrid is a staunch advocate for using data- and evidence-based decision-making strategies to strengthen global
development efforts in support of human and child rights.

Tonka Eibs has over 10 years of experience in development cooperation and humanitarian aid. She has worked as a technical advisor for MHPSS (Mental health and Psychosocial Support) and as project/ programme manager with increasing specialization on monitoring and evaluation in different NGOs and International Organisations. She supported interventions in 10 different countries and lived in Mexico, India and Kosovo. In the last 5 years she has been working as evaluation advisor with Doctors Without Borders and the Austrian Development Agency.

WHEN: Thursday, November 17, 2022, 4-5.30pm CET

WHERE: This event was HYBRID: in-person and online.

Physical location: Médecins sans Frontières (MSF), Taborstraße 10

We thank Médecins sans Frontières Vienna for hosting this event. MSF will kindly provide their facilities for the event and for networking afterwards.

The event started with a presentation by the guest speakers. After the presentation, a lively discussion about EV evolved.


SAVE THE DATE for future VEN events!

Potential guest speakers who are interested in presenting may approach us with a short outline of the topic at viennaevaluationnetwork@gmail.com


PAST EVENTS

22nd VEN Event
May 12, 2022, 4-5.30pm CET
Topic: Inclusive evaluation for gender equality: Challenges and opportunities in ensuring inclusiveness in remote evaluations
by guest speakers 
Andrea Berg, Heike Friedhoff & Anita Leutgeb
View or download the slides (PDF) here

21st VEN Event 
January, 27, 2022, 4-5.30pm CET
Topic: Photovoice & Photo-MSC: How to measure impact through visual participatory storytelling methods
by guest speakers Karijn Kakebeeke and Nur Hidayati
View or download the slides (PDF) here

20th VEN Event
November 18, 2021, 4-5.30pm CET
Topic: Evaluation of the Istanbul Convention of the Council of Europe: Using a Qualitative Comparative Analysis in a theory based contribution analysis evaluation
by guest speaker Serani Siegel
View the video recording here

View or download the slides (PDF) here

19th VEN Event
September 28, 2021, 4-5.30pm CET
Topic: Evaluations in Times of Covid-19. Implications, Consequences and Lessons Learnt
by guest speaker Karin Kohlweg
View the video recording here
View or download the slides (PDF) here

18th VEN Event
May 20, 2021, 4-5.30pm CET

Topic: How can Knowledge Management support M&E?
by guest speakers Silvia Capezzuoli and Ruth Jolly (IMA International)
View the video recording here

View or download the slides (PDF) here

17th VEN Event
February 22, 2021, 4-5.30pm CET
Evaluation of eHealth – Methods, challenges, and recommendations
by guest speaker Christian Boehler (European Centre for Social Welfare Policy and Research)

View or download the slides (PDF) here

16th VEN Event
November 26, 2020, 4-5.30pm CET
Methodological and practical insights into the participatory development of a MEL system: A case study on tracking social outcomes in Ferrero’s hazelnut value chain
by guest speaker Alice Schmidt (Global Health & Sustainability Expert)

View the video recording here
View or download the slides (PDF) here

15th VEN Event
October 1, 2020, 4-5.30pm CET
Sustaining All of our Hard Work: Plan, implement, monitor and evaluate for a sustainable exit from the start
by guest speaker Jindra Cekan/ova (valuing voices)

View the video recording here
View or download the slides (PDF): VEN_2020_Jindra_Cekan_SustainingOurHardWork

14th VEN Event
May 20, 2020, 4-5.30pm CET
Attributing development impact: lessons from action research with the Qualitative Impact Protocol
by guest speaker James Copestake (Bath University, UK)
View or download the slides (PDF): Copestake_QuIP_presentation_VEN_7May2020

13th VEN Event
February 20, 2020, 4-5.30pm CET
Meta-Evaluation: What is it, what is it good for, and how can it be done?
by guest speaker Thomas Vogel (HORIZONT3000)
View or download foto protocoll (PDF): VEN_MetaEvaluation_Vogel_FotoProtokoll

12th VEN Event
November 21, 2019 at 4-5.30pm CET
Researching children: Implications of a special population
by guest speakers Susanne Vogl (University of Vienna)
View or download the slides (PDF): Vogl Researching children_VENSlides_2019

11th VEN Event
October 3, 2019 at 4-5.30pm CET
Evaluation culture: What is needed? What is possible?
by guest speakers Katharina Warta & Klaus Schuch (fteval)
View or download the slides (PDF): Schuch&Warta_FTEVAL_VENSlides_3Oct2019 & FTEVAL_Standards_VENSlides_3Oct2019

10th VEN Event
June 17, 2019 at 4-5.30pm CET
Social impact evaluation: Measuring the social impact of alternative child care and family strengthening services
by guest speaker Rosalind Willi (SOS Children’s Villages)

View or download the slides (PDF): Willi_SocialImpactEvaluation_VENSlides_17Jun2019

9th VEN Event
April 11, 2019 at 4-5.30pm CET
Mixed Methods in Evaluation
by guest speaker Kate Winter (Kate Winter Evaluation)

View or download the slides (PDF): Winter_MixedMethods_VENSlides_11April2019

8th VEN Event
January 23, 2019 at 4-5.30pm CET
Gender Mainstreaming in Evaluation
by guest speaker Angela Wroblewski (Institute for Advanced Studies)

View or download the slides (PDF): Wroblewski_VENSlides_23Jan2019

7th VEN Event
November 14, 2018, 4-5.30pm CET
Learning from Evaluations?
by guest speaker Astrid Ganterer (Austrian Development Agency)
View or download the moderation cards

6th VEN Event
October 22, 2018, 4-5.30pm CET
Transferring evaluation results for evidence-based decision making in other contexts
by guest speaker Christian Boehler
View or download the slides (PDF): Boehler_VENSlides_22Oct2018

5th VEN Event
September 25, 2018, 4-5.30pm CET
Mainstreaming “Value For Money” in Development and Humanitarian Programming
by guest speaker Darko Petrovic
View or download the slides (PDF): Petrovic_VENSlides_25Sep2018

4th VEN Event
June 13, 2018, 3-4.30pm CET
The Role of Programme Theories in Evaluation
By guest speakers Karin Kohlweg and Lisa Ringhofer
View or download the slides (PDF): Kohlweg_Ringhofer_Slides_13June2018

3rd VEN Event
May 9, 2018, 3-4.30pm CET
Evaluating Advocacy and Communication: Challenges and Solutions
by guest speaker Glenn O’Neil
View or download the slides (PDF): ONeil_Slides_9May2018

2nd VEN Event
April 12, 2018, 3-4.30pm CET
What is “Evaluation”? Discussing the Fundamentals
by guest speaker Alfred Uhl

Inaugural VEN Event
January 16, 2018, 2-3.30pm CET
Evaluating effectiveness of complex interventions: Challenges in using RCTs
by guest speaker Ludwig Grillich