How to evaluate the implementation of complex health programmes in low-income settings: the approach of the Gavi Full Country Evaluations

Publication Date:

6 Nov 2020

Citation:

Soi C, Shearer JC, Budden A, Carnahan E, Salisbury N, Asiimwe G, et al. (2020). How to evaluate the implementation of complex health programmes in low-income settings: the approach of the Gavi Full Country Evaluations. Health Policy Plan. 35(Suppl 2), ii35-ii46. doi: 10.1093/heapol/czaa127

Abstract

Vaccination, like most other public health services, relies on a complex package of intervention components, functioning systems and committed actors to achieve universal coverage. Despite significant investment in immunization programmes, national coverage trends have slowed and equity gaps have grown. This paper describes the design and implementation of the Gavi Full Country Evaluations, a multi-country, prospective, mixed-methods approach whose goal was to monitor and evaluate processes, inputs, outputs and outcomes of immunization programmes in Bangladesh, Mozambique, Uganda and Zambia. We implemented the Full Country Evaluations from 2013 to 2018 with the goal of identifying the drivers of immunization programme improvement to support programme implementation and increase equitable immunization coverage. The framework supported methodological and paradigmatic flexibility to respond to a broad range of evaluation and implementation research questions at global, national and cross-country levels, but was primarily underpinned by a focus on evaluating processes and identifying the root causes of implementation breakdowns. Process evaluation was driven by theories of change for each Gavi funding stream (e.g. Health Systems Strengthening) or activity, ranging from global policy development to district-level programme implementation. Mixing of methods increased in relevance and rigour over time as we learned to build multiple methods into increasingly tailored evaluation questions. Evaluation teams in country-based research institutes increasingly strengthened their level of embeddedness with immunization programmes as the emphasis shifted over time to focus more heavily on the use of findings for programme learning and adaptation. Based on our experiences implementing this approach, we recommend it for the evaluation of other complex interventions, health programmes or development assistance.

Read the Full Article

HAI’s Transition 2021

HAI has transitioned our global operations and active programs to the local NGOs CSM (Mozambique) and HAMNASA (Timor-Leste). Learn more using the buttons below

Why Transition?

Learn about CSM

Learn about HAMNASA

Stand with HAI

Stand with HAI

Our Mission

Our mission is to promote policies and support programs that strengthen government primary health care and foster social, economic, and health equity for all. Our vision is a just world that promotes health and well-being, including universal access to quality health care.

Our History

Health Alliance International began in 1987 as a US-based international solidarity organization committed to supporting the public sector provision of health care for all.  Over 35 years, HAI conducted programs in 17 countries, with flagship programs in Mozambique, Côte d'Ivoire, and Timor-Leste.

Our Evolution

In line with HAI’s commitment to support and strengthen local public health leadership, as of October 2021, HAI fully transitioned global operations and active programs to locally-based, locally-led NGOs. Learn more about this shift toward local autonomy and equity in global health.

Didn't find what you were looking for?

Didn't find what you were looking for?