Mixed-methods evaluation in complex programmes: the National Reading Plan in Portugal

Abstract

This article highlights the evaluation strategies of a complex programme, which were essentially based on a pluralist, integrating approach founded on the use of mixed methods. The programme under analysis is the National Reading Plan (NRP), a public policy initiative that aims to increase literacy levels and reading habits among the Portuguese population. It was evaluated throughout its first phase, which lasted five years (2006–2011), using an evaluation model that made it possible to continuously and systematically monitor and analyse the way in which this programme was developed and implemented. A number of different quantitative and qualitative methodological operations gathered information from a broad range of sources and social actors, covering the vast set of projects promoted by the NRP. We particularly look at the contributions made by mixing methods to the evaluation of the programme's impacts, and point out its potentials when it comes to evaluating wide-ranging, long and complex programmes.