Working paper
How to improve education outcomes most efficiently?
Noam Angrist, David K Evans, Deon Filmer, Rachel Glennerster, Halsey Rogers, Shwetlena Sabarwal
Abstract
Many low- and middle-income countries lag far behind high-income countries in educational access and student learning. Policymakers must make tough choices about which investments to make to improve education with limited resources. Although hundreds of education interventions have been rigorously evaluated, comparing their impacts is challenging.
This paper provides the most recent and comprehensive review of the literature on effective education programs, with a novel emphasis on cost-effectiveness, covering the effectiveness and cost-effectiveness of interventions from over 200 impact evaluations across 52 countries. The analysis uses a unified measure – learning-adjusted years of schooling (LAYS) – that combines access and quality and compares gains to an absolute, cross-country standard. The results identify programs and policies that can be orders of magnitude more cost-effective than business-as-usual approaches, enabling policymakers to improve education outcomes substantially more efficiently.
References
Akyeampong, K., Andrabi, T., Banerjee, A., Banerji, R., Dynarski, S., Glennerster, R., . . . Yoshikawa, H. (2023). Cost-Effective Approaches to Improve Global Learning – What does recent evidence tell us are “Smart Buys” for improving learning in low- and middle-income countries? (Tech. Rep.). London, Washington D.C., New York.: FCDO, the World Bank, UNICEF, and USAID.
Alkire, S., & Foster, J. (2011). Counting and multidimensional poverty measurement. Journal of public economics, 95 (7), 476–487.
Angrist, N., Ainomugisha, M., Bathena, S. P., Bergman, P., Crossley, C., Cullen, C., . . . Sullivan, T. (2023). Building Resilient Education Systems: Evidence from Large-Scale Randomized Trials in Five Countries.
Angrist, N., Djankov, S., Goldberg, P. K., & Patrinos, H. A. (2021). Measuring human capital using global learning data. Nature (London), 592 (7854), 403–408.
ASER Centre. (2018). Annual Status of Education Report 2017 ‘Beyond Basics’ (Tech. Rep.).
ASER Centre. Azevedo, J. P., Goldemberg, D., Montoya, S., Nayar, R., Rogers, H., Saavedra, J., & Stacy, B. W. (2021). Will Every Child Be Able to Read by 2030? Defining Learning Poverty and Mapping the Dimensions of the Challenge.
Baird, S., McIntosh, C., & Özler, B. (2011). Cash or condition?: Evidence from a cash transfer experiment. The Quarterly journal of economics, 126 (4), 1709–1753.
Banerjee, A. V., Banerji, R., Berry, J., Duflo, E., Kannan, H., Mukerji, S., . . . Walton, M. (2017). From proof of concept to scalable policies: Challenges and solutions, with an application. The Journal of economic perspectives, 31 (4), 73–102.
Banerjee, A. V., Cole, S., Duflo, E., & Linden, L. (2007). Remedying Education: Evidence from Two Randomized Experiments in India. The Quarterly journal of economics, 122 (3), 1235–1264.
Bashir, S., Lockheed, M., Ninan, E., & Tan, J.-P. (2018). Facing Forward : Schooling for Learning in Africa. Washington, DC: World Bank.
Bates, M. A., & Glennerster, R. (2017). The Generalizability Puzzle.
Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008). Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions. Journal of research on educational effectiveness, 1 (4), 289–328.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed. ed.). Hillsdale, N.J. ; Hove: Erlbaum Associates.
Crawfurd, L., Evans, D., Hares, S., & Moscoviz, L. (2020). 12 Years of Quality Education for Every Girl: Five Ways the New UK Government Can Deliver on Its Manifesto Pledge. Retrieved 2022-08-05, from https://www.cgdev.org/blog/12-years-quality-education-every-girl-five-ways-new-uk-government-can-deliver-its-manifesto
De Neve, J.-W., Fink, G., Subramanian, S. V., Moyo, S., & Bor, J. (2015). Length of secondary schooling and risk of HIV infection in Botswana: evidence from a natural experiment. The Lancet global health, 3 (8), e470—-e477.
Drummond, M., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes. (Fourth edi ed.). Oxford, United Kingdom.
Duflo, E., Dupas, P., & Kremer, M. (2021). The Impact of Free Secondary Education: Experimental Evidence from Ghana. Cambridge, Mass.
Dynarski, S. (2000). Hope for Whom? Financial Aid for the Middle Class and Its Impact on College Attendance. National tax journal , 53 (3), 629–661.
Evans, D. K., & Popova, A. (2016a). Cost-Effectiveness Analysis in Development: Accounting for Local Costs and Noisy Impacts. World development, 77 , 262–276.
Evans, D. K., & Popova, A. (2016b). What really works to improve learning in developing countries?: An analysis of divergent findings in systematic reviews. The World Bank research observer , 31 (2), 242–270.
Evans, D. K., & Yuan, F. (2019). Equivalent Years of Schooling : A Metric to Communicate Learning Gains in Concrete Terms. , 8752 .
Evans, D. K., & Yuan, F. (2022). How Big Are Effect Sizes in International Education Studies? Educational evaluation and policy analysis, 44 (3), 532–540.
Filmer, D., Rogers, H., Angrist, N., & Sabarwal, S. (2020). Learning-adjusted years of schooling (LAYS): Defining a new macro measure of education. Economics of education review , 77 .
Fiszbein, A., Schady, N., Ferreira, F. H. G., Grosh, M., Keleher, N., Olinto, P., & Skoufias, E. (2009). Conditional Cash Transfers : Reducing Present and Future Poverty. Washington, DC: World Bank.
Ganimian, A. J., & Murnane, R. J. (2016). Improving Education in Developing Countries: Lessons From Rigorous Impact Evaluations. Review of educational research, 86 (3), 719–755.
Glewwe, P. W., Hanushek, E. A., Humpage, S. D., & Ravina, R. (2011). School Resources and Educational Outcomes in Developing Countries: A Review of the Literature from 1990 to 2010. Cambridge, Mass: National Bureau of Economic Research.
Glewwe, P. W., & Muralidharan, K. (2016). Improving Education Outcomes in Developing Countries: Evidence, Knowledge Gaps, and Policy Implications. In Handbook of the economics of education (Vol. 5, pp. 653–743).
Habyarimana, J. P., Opalo, K. O., & Schipper, Y. (2020). The Cyclical Electoral Impacts of Programmatic Policies: Evidence from Education Reforms in Tanzania.
Hanushek, E. A., & Woessmann, L. (2012). Do better schools lead to more growth?: Cognitive skills, economic outcomes, and causation. Journal of economic growth (Boston, Mass.), 17 (4), 267–321.
Haushofer, J., & Shapiro, J. (2016). The Short-term Impact of Unconditional Cash Transfers to the Poor: Experimental Evidence from Kenya. The Quarterly Journal Of Economics, 131 (4), 30 pp1973—-2042.
Heckman, J. J., Moon, S. H., Pinto, R., Savelyev, P. A., & Yavitz, A. (2010). The rate of return to the HighScope Perry Preschool Program. Journal of public economics, 94 (1), 114–128.
Hendren, N., & Sprung-Keyser, B. (2020). A Unified Welfare Analysis of Government Policies. The Quarterly journal of economics, 135 (3), 1209–1318.
Johnson, R. C., & Jackson, K. C. (2019). Reducing Inequality through Dynamic Complementarity: Evidence from Head Start and Public School Spending. American economic journal. Economic policy, 11 (4), 310–349.
Kane, T. J. (2004). The Impact of After-School Programs; Interpreting the Results of Four Recent Evaluations. Los Angeles, CA.
Kraay, A. (2019). The World Bank Human Capital Index: A Guide. The World Bank research observer , 34 (1), 1–33.
Kraft, M. A. (2020). Interpreting Effect Sizes of Education Interventions. Educational researcher , 49 (4), 241–253.
Kremer, M., Brannen, C., & Glennerster, R. (2013). The Challenge of Education and Learning in the Developing World. Science (American Association for the Advancement of Science), 340 (6130), 297–300.
Krishnaratne, S., White, H., & Carpenter, E. (2013). Quality education for all children? What works in education in developing countries.
Mbiti, I., Muralidharan, K., Romero, M., Schipper, Y., Manda, C., & Rajani, R. (2019). INPUTS, INCENTIVES, AND COMPLEMENTARITIES IN EDUCATION: EXPERIMENTAL EVIDENCE FROM TANZANIA. The Quarterly journal of economics, 134 (3), 1627–1673.
McKeever, V. (2020, jun). Oxford degree, says now it’s time for ‘Netflix, reading and sleep’. Retrieved from https://www.cnbc.com/2020/06/19/malala-yousafzai-completes-her-oxford-degree.html
Murray, C. J. L., & Lopez, A. D. (1996). Evidence-Based Health Policy-Lessons from the Global Burden of Disease Study. Science (American Association for the Advancement of Science), 274 (5288), 740–743.
Pliskin, J. S., Shepard, D. S., & Weinstein, M. C. (1980). Utility Functions for Life Years and Health Status. Operations research, 28 (1), 206–224.
Psacharopoulos, G., & Patrinos, H. A. (2004). Returns to investment in education: a further update. Education economics, 12 (2), 111–134.
Rodriguez-Segura, D., & Mbiti, I. (2022). Back to Basics: Curriculum reform and student learning in Tanzania. Retrieved from https://doi.org/10.35489/BSG-RISE-WP 2022/099
Singh, A. (2020). Learning More with Every Year: School Year Productivity and International Learning Divergence. Journal of the European Economic Association, 18 (4), 1770–1813.
Snilstveit, B., Stevenson, J., Phillips, D., Vojtkova, M., Gallagher, E., Schmidt, T., . . . Eyers, J. (2015). Interventions for improving learning outcomes and access to education in low- and middle- income countries: a systematic review. London.
Torrance, G. W., Thomas, W. H., & Sackett, D. L. (1972). A utility maximization model for evaluation of health care programs. Health services research, 7 (2), 118–133.
World Bank. (2018). World Development Report 2018 : Learning to Realize Education’s Promise. Washington, DC: World Bank.
World Bank. (2019). World Development Report 2019 : The Changing Nature of Work. Washington, DC: World Bank.
World Bank. (2020). The Human Capital Index 2020 Update : Human Capital in the Time of COVID-19. World Bank, Washington, DC.
Zeckhauser, R., & Shepard, D. (1976). Where Now for Saving Lives? Law and contemporary problems, 40 (4), 5–45.
Angrist, N., Evans, D., Filmer, D., Glennerster, R., Rogers, H., and Sabarwal, S. 2023. How to improve education outcomes most efficiently? What Works Hub for Global Education Working Paper Series. 2023/002. https://doi.org/10.35489/BSG-WhatWorksHubforGlobalEducation-WP_2023/002
Discover more
What we do
Our work will directly affect up to 3 million children, and reach up to 17 million more through its influence.
Who we are
A group of strategic partners, consortium partners, researchers, policymakers, practitioners and professionals working together.
Get involved
Share our goal of literacy, numeracy and other key skills for all children? Follow us, work with us or join us at an event.