Combining theory-driven evaluation and causal loop diagramming for opening the 'black box' of an intervention in the health sector: a case of performance-based financing in Western Uganda

Dimitri Renmans, Nathalie Holvoet, Bart Criel

Research output: Contribution to journalA1: Web of Science-article

60 Downloads (Pure)

Abstract

Increased attention on "complexity" in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a systems dynamics tool called causal loop diagramming (CLD) to generate hypotheses feeding into a theory-driven evaluation. Semi-structured interviews were conducted with 30 health workers from two districts (Kasese and Kyenjojo) and with 16 key informants. After CLD, we identified three relevant hypotheses: "success to the successful", "growth and underinvestment", and "supervision conundrum". The first hypothesis leads to increasing improvements in performance, as better performance leads to more incentives, which in turn leads to better performance. The latter two hypotheses point to potential bottlenecks. Thus, the proposed methodological strategy was a useful tool for identifying hypotheses that can inform a theory-driven evaluation. The hypotheses are represented in a comprehensible way while highlighting the underlying assumptions, and are more easily falsifiable than hypotheses identified without using CLD.

Original languageEnglish
JournalInternational Journal of Environmental Research and Public Health
Volume14
Issue number9
Pages (from-to)1007
Number of pages20
ISSN1660-4601
DOIs
Publication statusPublished - 2017

Keywords

  • Journal Article

Fingerprint Dive into the research topics of 'Combining theory-driven evaluation and causal loop diagramming for opening the 'black box' of an intervention in the health sector: a case of performance-based financing in Western Uganda'. Together they form a unique fingerprint.

Cite this