June 20, 2024
2 minute read
Aligning programme evaluation with the needs of external evaluators

Tag: Efficient and Effective Operations

Abstract: Evaluation report insights must match the requirements of the external evaluator although historically, this has not been a “simple ask”. Terre des Hommes (TdH) Burundi pioneered using the digital platform of Propel to respond proactively to the information requirements of these evaluation teams and at the same time, consolidated greater impact through placing their learning journeys in one place. Their "Programme de lutte contre la torture et les mauvais traitements" harnessed Propel to transform their approach to programme evaluation. The partnership between Propel and TdH demonstrates how targeted technology can streamline the gathering and presentation of crucial evaluation data, enhancing the impact and efficiency of evaluation processes.

What are the needs of an external evaluator and how can Propel reshape how we approach evaluations for humanitarian programmes?

‍

The Challenge 

Programme evaluations sometimes miss the mark with insufficient and irrelevant information. Similarly, traditional programme evaluation processes often struggle to effectively connect outcomes to future programming. The lack of connection between insights and programming leads to a lack of learning, hindering adaptive management. Additionally, evaluations are very time consuming and costly.

‍

Background: TdH Burundi implemented Propel to enhance the evaluation of their programmes, particularly the "Programme de lutte contre la torture et les mauvais traitements". This use case explores how Propel facilitated a more robust, resource-efficient and cost-effective evaluation process.

‍

Linking to Propel’s Theory of Change: This use case aligns with Propel’s Theory of Change by demonstrating how digital tools can optimise data management and knowledge sharing, leading to improved programme evaluation and strategic decision-making, making operations more effective and efficient.

‍‍

Stakeholders involved: Programme managers, external evaluators, and the monitoring and evaluation team were pivotal in leveraging Propel for enhanced evaluation processes
‍

The Solution

  • Introducing Propel: Introduced as a digital solution to streamline data aggregation and sharing for aligned and relevant evaluation purposes.
  • Implementation process: The team systematically used Propel to compile, analyse, and share detailed programme data with external evaluators, ensuring all relevant learnings were easily accessible and well-presented.

Impact and Results

  • Successes: The implementation of Propel improved the quality of evaluation reports, providing deeper insights into program effectiveness and identifying areas for improvement.
  • Visuals and media: Utilised Propel’s organisational view features to create comprehensive data visualisations that enhanced the evaluators' understanding of the programme’s impact.

Challenges and Adaptations

  • Acknowledgment of challenges: There was an initial learning curve in adapting to a new digital tool for evaluation purposes within the organisation.
  • Adaptations made: To overcome initial hesitancy within the team, TdH and Propel conducted tailored training sessions for the M&E team and evaluators on how to use the tool effectively, ensuring smooth adaptation and maximising its benefits.

Learning and Innovation

  • Lessons learned: Highlighted the importance of integrating technology in evaluation processes to ensure data-driven insights guide future programming.
  • Innovative practices: Developed a model for digital-enabled evaluations that can be replicated across different programmes and contexts.

Scalability and Next Steps

  • Scalability potential: The successful application of Propel in this programme opens possibilities for its use in other evaluation settings within the Terre des Hommes network, potentially transforming how programme impacts are assessed and learned from globally.
  • Call to action: Encourages other programmes within the confederation to adopt similar digital tools to enhance their evaluation processes and outcomes.

Conclusion

  • Summary of achievements: The integration of Propel into the evaluation process has aligned external evaluators’ information needs such as value for money, relevance, efficiency and effectiveness of an investment, as well as equity impact in how the programme is enabling marginalised groups.
  • Reflective insight: Embracing digital tools in programme evaluations can significantly enrich the understanding of programme impacts and guide more effective future interventions.
  • Future vision: Continued innovation in digital evaluation practices is expected to foster a more agile and informed programme planning environment across the humanitarian sector.

‍