Working paper
Understanding gaps between policy and practice
Noam Angrist, Stefan Dercon
Abstract
Substantial effort is invested in improving education policy, yet for policy to matter it must be implemented in practice. This article presents new systematic analysis of the gap between education policy and practice across 50 countries during COVID-19, a time of substantial policy innovation. We find large gaps between policy intent and policy implementation in practice. While “policy-practice gaps” are large in most regions of the world, Latin America is a bright spot, with lessons for other regions. We further examine two components of the policy-practice gap to help better understand it: naive policy and ineffective service delivery. We find policies are often designed sensibly and are not naive; rather most of the policy-practice gap can be explained by ineffective service delivery. Our findings highlight the need to prioritise implementation science in education to close the gap between policy and practice. We also examine settings beyond COVID-19, and find similar patterns in the policy-practice gap. Substantial attention among the education community today is dedicated to policymaking, yet minimal attention is paid to policy implementation. Our results motivate as much attention on the latter as the former.
References
Andrews, Matt, Lant Pritchett, and Michael Woolcock. Building state capability: Evidence, analysis, action. Oxford University Press, 2017.
Angrist, Noam, Simeon Djankov, Pinelopi K. Goldberg, and Harry A. Patrinos. ”Measuring human capital using global learning data.” Nature 592, no. 7854 (2021): 403-408.
Angrist, Noam, and Rachael Meager. Implementation matters: Generalizing treatment effects in education. Blavatnik School of Government, University of Oxford, 2023.
Cook, B. G., & Odom, S. L. (2013). Evidence-Based Practices and Implementation Science in Special Education. Exceptional Children, 79(3), 135–144. https://doi.org/10.1177/001440291307900201
COVID-19 High-Frequency Monitoring Dashboard, The World Bank. 2022
Engzell, Per, Arun Frey, and Mark D. Verhagen. ”Learning loss due to school closures during the COVID-19 pandemic.” Proceedings of the National Academy of Sciences 118, no. 17 (2021).
Gertler, Paul, James Heckman, Rodrigo Pinto, Arianna Zanolini, Christel Vermeersch, Susan Walker, Susan M. Chang, and Sally Grantham-McGregor. ”Labor market returns to an early childhood stimulation intervention in Jamaica.” Science 344, no. 6187 (2014): 998-1001.
Hiss R. G. (2004). Translational research—two phases of a continuum. In From clinical trials to community: The science of translating diabetes and obesity research (pp. 11–14). Bethesda, MD: National Institute of Diabetes and Digestive and Kidney Diseases..
Lichand, G., Doria, C. A., Leal-Neto, O., & Fernandes, J. P. C. (2022). The impacts of remote learning in secondary education during the pandemic in Brazil. Nature Human Behaviour, 6(8), 1079-1086. Madon, T. (2007). Implementation Science. Science Policy Forum, 318.
Moscoviz, Laura, and David K. Evans. ”Learning loss and student dropouts during the covid-19 pandemic: A review of the evidence two years after schools shut down.” Center for Global Development, Working Paper 609 (2022).
Muralidharan, Karthik, and Abhijeet Singh. ”India’s new National Education Policy: Evidence and challenges.” Science 372, no. 6537 (2021): 36-38
Moir, T. (2018). Why Is Implementation Science Important for Intervention Design and Evaluation Within Educational Settings? In Frontiers in Education (Vol. 3). Frontiers Media SA. https://doi.org/10.3389/feduc.2018.00061
Patrinos, Harry Anthony, Emiliana Vegas, and Rohan Carter-Rau. ”An Analysis of COVID-19 Student Learning Loss.” World Bank (2022).
Pritchett, Lant. The rebirth of education: Schooling ain’t learning. CGD Books, 2013.
SABER in Action: SABER tools as a framework for education systems assessment (English). Systems Approach for Better Education Results (SABER) in action Washington, D.C. : World Bank Group. http://documents.worldbank.org/curated/en/769421492488982190/SABER-in-Action-SABER-tools-as-a-framework-for-education-systems-assessment
The Human Capital Index. 2020. doi: 10.1596/34432.
Williams, M. J., Leaver, C., Mansoor, Z., Qarout, D., Bilous, A., Mundy, K., … & Bell, S. (2020). Delivery approaches to improving policy implementation: A conceptual framework. Education Commission, University of Oxford, UKAid.
World Bank. World development report 2018: Learning to realize education’s promise. The World Bank, 2017.
World Bank. World development indicators. 2020. URL https://databank.worldbank.org/ source/world-development-indicators.
UNESCO. More Than One-half of Children and Adolescents are not Learning Worldwide. UIS Fact Sheet No. 46 http://uis.unesco.org/sites/default/files/documents/fs46-more-than-half-children-not-learning-en-2017.pdf (UNESCO, 2017).
UNESCO. (2020 & 2021). Survey of national education responses to COVID-19 school closures (iterations 1-3) [Dataset]. UNESCO Institute for Statistics. https://covid19.uis.unesco.org/data/
Discover more
What we do
Our work will directly affect up to 3 million children, and reach up to 17 million more through its influence.
Who we are
A group of strategic partners, consortium partners, researchers, policymakers, practitioners and professionals working together.
Get involved
Share our goal of literacy, numeracy and other key skills for all children? Follow us, work with us or join us at an event.