Applying the realist evaluation approach to the complex process of policy implementation: the case of the user fee exemption policy for cesarean section in Benin

Realist evaluation is making inroads in the field of health policy and systems research to a large extent because of its good fit with complex issues. Until now, most realist studies focused on evaluating interventions or projects related to health care delivery, organization of health services, education, management, and leadership of health workers in high income countries. With this paper, we apply the realist approach to the study of national health policy implementation in a low resource country. We use the case of the user fee exemption policy for cesarean section in Benin, which we followed up from 2009 to 2018. We report on how realist evaluation can be applied for policy implementation research. We illustrate how we developed the initial programme theory-the starting point of any realist evaluation -, how we designed the study and data collection tools, and how we analyzed the data. For each step, we present current good practices, how we adapted them when needed, the challenges and the lessons learned. We report also on how the dynamic interactions between the central level (the national implementing agency) and the peripheral level (an implementing hospital) shaped the policy implementation. We found that at central level, availability of resources for a given policy is constantly challenged in the competitive national resource allocation arena. Key factors include the political power and the legitimacy of the group supporting the policy. These are influenced by the policy implementation structure, how the actual outputs of the implementation align with promises of the group supporting the policy and consequently how these outputs, the policy and its promoters are perceived by the community. We found that the service providers are key to the implementation, and that they are constrained or influenced by the dependability of the funding, their autonomy, their personal background, and the accountability arrangements. This study can inform the design and implementation of national health policies that involve interactions between central and operational level in other low-income countries.