Coming
soon

Evidence collection - Understanding quality characteristics of EdTech interventions and implementation for disadvantaged pupils

Agenda Alliance. (2022, September 26). Serious Concerns About Racial Disparity Among Girls ‘Kicked Out’ of School. Agenda Alliance. https://www.agendaalliance.org/news/serious-concerns-about-racial-disparity-among-girls-kicked-out-of-school/

Ahn, S., Ames, A. J., & Myers, N. D. (2012). A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses. Review of Educational Research, 82(4), 436–476. https://doi.org/10.3102/0034654312458162

Albers, B., Shlonsky, A., & Mildon, R. (Eds.). (2020). Implementation Science 3.0. Springer.

Allison, C. (2023). Guidance note on using implementation research in education (Building Evidence in Education (BE2)). London: Foreign, Commonwealth & Development Office, prepared for Building Evidence in Education (BE2). https://www.edu-links.org/sites/default/files/media/file/Guidance_Note_on_Using_Implementation_Research_in_Education.pdf

Bates, M. A., & Glennerster, R. (2017). The Generalizability Puzzle. Stanford Social Innovation Review. https://ssir.org/articles/entry/the_generalizability_puzzle

Benavides-Varela, S., Zandonella Callegher, C., Fagiolini, B., Leo, I., Altoè, G., & Lucangeli, D. (2020). Effectiveness of digital-based interventions for children with mathematical learning difficulties: A meta-analysis. Computers & Education, 157, 103953. https://doi.org/10.1016/j.compedu.2020.103953

Bender, R., Friede, T., Koch, A., Kuss, O., Schlattmann, P., Schwarzer, G., & Skipka, G. (2018). Methods for evidence synthesis in the case of very few studies. Research Synthesis Methods, 9(3), 382–392. https://doi.org/10.1002/jrsm.1297

BERA. (2018). Ethical Guidelines for Educational Research, fourth edition. BERA. https://www.bera.ac.uk/publication/ethical-guidelines-for-educational-research-2018-online

Bhutoria, A. (2022). Personalized education and artificial intelligence in United States, China, and India: A systematic review using a Human-In-The-Loop model. Computers and Education: Artificial Intelligence, 3, 100068. https://doi.org/10.1016/j.caeai.2022.100068

Blei, D. M., & Lafferty, J. D. (2009). Topic models. In Text mining (pp. 101–124). Chapman and Hall/CRC. https://www.taylorfrancis.com/chapters/edit/10.1201/9781420059458-12/topic-models-david-blei-john-la%EF%AC%80erty

Blei, D. M., & Lafferty, J. D. (2009). Visualizing Topics with Multi-Word Expressions (arXiv:0907.1013). arXiv. http://arxiv.org/abs/0907.1013

Bold, T., Kimenyi, M., Mwabu, G., Ng’ang’a, A., & Sandefur, J. (2018). Experimental evidence on scaling up education reforms in Kenya. Journal of Public Economics, 168, 1–20. https://doi.org/10.1016/j.jpubeco.2018.08.007

Bond, M. (2020). Schools and Emergency Remote Education during the COVID-19 Pandemic: A Living Rapid Systematic Review. Asian Journal of Distance Education, 15(2), 191–247. https://eric.ed.gov/?id=EJ1285336

Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020). Mapping research in student engagement and educational technology in higher education: a systematic evidence map. International Journal of Educational Technology in Higher Education, 17(1), 2. https://doi.org/10.1186/s41239-019-0176-8

Burns, R. D., Fu, Y., & Podlog, L. W. (2017). School-based physical activity interventions and physical activity enjoyment: A meta-analysis. Preventive Medicine, 103, 84–90. https://doi.org/10.1016/j.ypmed.2017.08.011

Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital Games, Design, and Learning: A Systematic Review and Meta-Analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065

CooperGibson Research. (2022). Implementation of education technology in schools and colleges. Department for Education.

Creswell, J., & Plano Clark, V. (2018). Designing and Conducting Mixed Methods Research (3rd Edition). SAGE.

Education Endowment Foundation, & Durham University. (2022). EEF Evidence Database Coding Guide – Effect Size Data Extraction (Version 2). https://d2tic4wvo1iusb.cloudfront.net/production/documents/toolkit/ESDE_CodingGuide_V2_March_2022-1.pdf

Education Endowment Foundation, & Durham University. (2022). EEF Evidence Database Coding Guide – Main Data Extraction (Version 3). https://d2tic4wvo1iusb.cloudfront.net/production/documents/toolkit/MDE_CodingGuide_V3_March2022-1.pdf

EPPI Centre. (2003). Core Keywording Strategy. https://eppi.ioe.ac.uk/CMS/Portals/0/PDF%20reviews%20and%20summaries/EPPI_Keyword_strategy.pdf

Freeman, S., & Sutton, A. (2020, July). Identifying publication bias in meta-analyses of continuous outcomes. Cochrane Training. https://training.cochrane.org/resource/identifying-publication-bias-meta-analyses-continuous-outcomes

Furenes, M. I., Kucirkova, N., & Bus, A. G. (2021). A Comparison of Children’s Reading on Paper Versus Screen: A Meta-Analysis. Review of Educational Research, 91(4), 483–517. https://doi.org/10.3102/0034654321998074

Glewwe, P., & Muralidharan, K. (2016). Chapter 10 - Improving Education Outcomes in Developing Countries: Evidence, Knowledge Gaps, and Policy Implications. In E. A. Hanushek, S. Machin, & L. Woessmann (Eds.), Handbook of the Economics of Education (Vol. 5, pp. 653–743). Elsevier. https://doi.org/10.1016/B978-0-444-63459-7.00010-5

Harn, B., Parisi, D., & Stoolmiller, M. (2013). Balancing Fidelity with Flexibility and Fit: What Do We Really Know about Fidelity of Implementation in Schools? Exceptional Children, 79(3), 181–193. https://doi.org/10.1177/001440291307900204

Haßler, B. (2021). A mixed-methods evidence assessment for emergent fields of knowledge (Working Paper No. 24). EdTech Hub. https://doi.org/10.53832/edtechhub.0003

Haßler, B., Adam, T., Allier-Gagneur, Z., Blower, T., Brugha, M., Damani, K., Hennessy, S., Hollow, D., Jordan, K., Martin, K., Megha-Bongnkar, G., Murphy, M., & Walker, H. (2021). Methodology for literature reviews (Working Paper No. 10). EdTech Hub. https://doi.org/10.5281/zenodo.4557508

Haßler, B., Adam, T., Brugha, M., Damani, K., Allier-Gagneur, Z., Hennessy, S., Hollow, D., Jordan, K., Martin, K., Murphy, M., & Walker, H. (2019). Keyword inventory (EdTech Hub Research Instruments No. 1; EdTech Hub Research Instruments). EdTech Hub. https://doi.org/10.5281/zenodo.3523935

Haßler, B., El-Serafy, Y., Khalayleh, A., & McBurnie, C. (2021). Syṡtemic Mixed-Methods Research — a conceptual framework for scalable EdTech research (Working Paper No. 9). EdTech Hub. https://doi.org/10.53832/edtechhub.0001

Haßler, B., Haseloff, G., Adam, T., Akoojee, S., Allier-Gagneur, Z., Ayika, S., Bahloul, K., Kigwilu, P. C., Costa, D. D., Damani, K., Gordon, R., Idris, A., Iseje, F., Jjuuko, R., Kagambèga, A., Khalayleh, A., Konayuma, G., Kunwufine, D., Langat, K., … Winkler, E. (2020). Technical and Vocational Education and Training in Sub-Saharan Africa: A Systematic Review of the Research Landscape (1st ed.). VET Repository, Bundesinstitut für Berufsbildung, Bonn, Germany. https://doi.org/10.5281/zenodo.4288831

Haßler, B., Major, L., & Hennessy, S. (2016). Tablet use in schools: a critical review of the evidence for learning outcomes. Journal of Computer Assisted Learning, 32(2), 139–156. https://doi.org/10.1111/jcal.12123

Hedges, L. V., & Olkin, I. (2014). Statistical Methods for Meta-Analysis. Academic Press.

Deeks, J., Higgins, J., & Altman, D. (Eds.). (2023). Chapter 10: Analysing data and undertaking meta-analyses. In J. Higgins & J. Thomas, Cochrane Handbook for Systematic Reviews of Interventions (6.4). Cochrane Training. https://training.cochrane.org/handbook/current

Higgins, J., & Thomas, J. (2023). Cochrane Handbook for Systematic Reviews of Interventions (6.4). Cochrane Training. https://training.cochrane.org/handbook/current

Higgins, S., Xiao, Z., & Katsipataki, M. (2012). The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation. Full Report. Education Endowment Foundation. https://eric.ed.gov/?id=ED612174

IntHout, J., Ioannidis, J. P., & Borm, G. F. (2014). The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Medical Research Methodology, 14(1), 25. https://doi.org/10.1186/1471-2288-14-25

Karboul, A. (2020, December 4). COVID-19 put 1.6 billion children out of school. Here’s how to upgrade education post-pandemic. World Economic Forum. https://www.weforum.org/agenda/2020/12/covid19-education-innovation-outcomes/

Kerwin, J. T., & Thornton, R. L. (2021). Making the Grade: The Sensitivity of Education Program Effectiveness to Input Choices and Outcome Measures. The Review of Economics and Statistics, 103(2), 251–264. https://doi.org/10.1162/rest_a_00911

Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical report, EBSE Technical Report EBSE-2007-01. https://www.cs.auckland.ac.nz/~norsaremah/2007%20Guidelines%20for%20performing%20SLR%20in%20SE%20v2.3.pdf

Lewin, C., Smith, A., Morris, S., & Craig, E. (2019). Using Digital Technology to Improve Learning: Evidence Review. Education Endowment Foundation. https://d2tic4wvo1iusb.cloudfront.net/production/documents/guidance/Using_Digital_Technology_to_Improve_learning_Evidence_Review.pdf?v=1698320282

Ludwig, J., Kling, J. R., & Mullainathan, S. (2011). Mechanism Experiments and Policy Evaluations. Journal of Economic Perspectives, 25(3), 17–38. https://doi.org/10.1257/jep.25.3.17

Lurvink, A.-F., Bangura, Z., Fortune, A., George, A. H., Godwin, K., Mason-Sesay, M., Moseray, D., Tholley, I., Turay, E. B., & Haßler, B. (2022). No Teacher is an Island: A case study on the enablers and barriers for effective school-based teacher professional development in Sierra Leone. OpenDevEd. https://doi.org/10.53832/opendeved.0284

Mbiti, I., Muralidharan, K., Romero, M., Schipper, Y., Manda, C., & Rajani, R. (2019). Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania*. The Quarterly Journal of Economics, 134(3), 1627–1673. https://doi.org/10.1093/qje/qjz010

McNally, S., Ruiz-Valenzuela, J., & Rolfe, H. (2016). ABRA: Online Reading Support. Evaluation Report and Executive Summary. Education Endowment Foundation. https://eric.ed.gov/?id=ED581099

McNeish, D. (2017). Challenging Conventional Wisdom for Multivariate Statistical Models With Small Samples. Review of Educational Research, 87(6), 1117–1151. https://doi.org/10.3102/0034654317727727

Moeyaert, M., Ugille, M., Natasha Beretvas, S., Ferron, J., Bunuan, R., & Van Den Noortgate, W. (2017). Methods for dealing with multiple outcomes in meta-analysis: a comparison between averaging effect sizes, robust variance estimation and multilevel meta-analysis. International Journal of Social Research Methodology, 20(6), 559–572. https://doi.org/10.1080/13645579.2016.1252189

Mohdin, A. (2021, September 23). Black Caribbean girls in England ‘twice as likely to be excluded from schools as white girls.’ The Guardian. https://www.theguardian.com/education/2021/sep/23/black-girls-in-england-twice-as-likely-to-be-excluded-from-schools-as-white-girls

Outhwaite, L., Ang, L., Herbert, E., Sumner, E., & Van Herwegen, J. (2023). Technology and Learning for Early Childhood and Primary Education [Report]. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000386108.locale=en

Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review--a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10 Suppl 1, 21–34. https://doi.org/10.1258/1355819054308530

Piper, B., Jepkemei, E., Kwayumba, D., & Kibukho, K. (2015). Kenya’s ICT Policy in Practice: The Effectiveness of Tablets and E-readers in Improving Student Outcomes. FIRE: Forum for International Research in Education, 2(1). https://doi.org/10.18275/fire201502011025

Ran, H., Kasli, M., & Secada, W. G. (2021). A Meta-Analysis on Computer Technology Intervention Effects on Mathematics Achievement for Low-Performing Students in K-12 Classrooms. Journal of Educational Computing Research, 59(1), 119–153. https://doi.org/10.1177/0735633120952063

Savva, M., Higgins, S., & Beckmann, N. (2022). Meta‐analysis examining the effects of electronic storybooks on language and literacy outcomes for children in grades Pre‐K to grade 2. Journal of Computer Assisted Learning, 38(2), 526–564. https://doi.org/10.1111/jcal.12623

Scammacca, N., Roberts, G., & Stuebing, K. K. (2014). Meta-Analysis With Complex Research Designs: Dealing With Dependence From Multiple Measures and Multiple Group Comparisons. Review of Educational Research, 84(3), 328–364. https://doi.org/10.3102/0034654313500826

Sharpe, D., & Poets, S. (2020). Meta-analysis as a response to the replication crisis. Canadian Psychology/Psychologie Canadienne, 61(4), 377. https://doi.org/10.1037/cap0000215

Sharples, J., Albers, B., Fraser, S., & Kime, S. (2019). Putting Evidence to Work: A School’s Guide to Implementation. https://d2tic4wvo1iusb.cloudfront.net/eef-guidance-reports/implementation/EEF-Active-Ingredients-Summary.pdf?v=1635355218

Sims, S., & Fletcher-Wood, H. (2018). Characteristics of effective teacher professional development: what we know, what we don’t, how we can find out.

Sims, S., Fletcher-Wood, H., O’Mara, A., Cottingham, S., Stansfield, C., Herwegen, J. V., & Anders, J. (2021). What are the Characteristics of Effective Teacher Professional Development? A Systematic Review and Meta-analysis.

Takacs, Z. K., Swart, E. K., & Bus, A. G. (2015). Benefits and Pitfalls of Multimedia and Interactive Features in Technology-Enhanced Storybooks: A Meta-Analysis. Review of Educational Research, 85(4), 698–739. https://doi.org/10.3102/0034654314566989

Tipton, E., Pustejovsky, J. E., & Ahmadi, H. (2019). A history of meta‐regression: Technical, conceptual, and practical developments between 1974 and 2018. Research Synthesis Methods, 10(2), 161–179. https://doi.org/10.1002/jrsm.1338

Tipton, E., Pustejovsky, J. E., & Ahmadi, H. (2019). Current practices in meta‐regression in psychology, education, and medicine. Research Synthesis Methods, 10(2), 180–194. https://doi.org/10.1002/jrsm.1339

Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2015). Meta-analysis of multiple outcomes: A multilevel approach. Behavior Research Methods, 47, 1274–1294. https://doi.org/10.3758/s13428-014-0527-2

Verbruggen, S., Depaepe, F., & Torbeyns, J. (2021). Effectiveness of educational technology in early mathematics education: A systematic literature review. International Journal of Child-Computer Interaction, 27, 100220. https://doi.org/10.1016/j.ijcci.2020.100220

Vicentini, L., Day, L., Gill, V., Lillis, J., Komers, S., & Olausson, N. (2022). Future opportunities for education technology in England. Department for Education.

Walker, H., Moustafa, N., & Haßler, B. (2023). EdTech Impact in Education – An Analysis Prepared for the Education Endowment Foundation. OpenDevEd. https://doi.org/10.53832/opendeved.0294

Winchester, N. (2022). Educational attainment gap: Regional disparities. https://lordslibrary.parliament.uk/educational-attainment-gap-regional-disparities/

Xiao, Y., & Watson, M. (2017). Guidance on Conducting a Systematic Literature Review. Journal of Planning Education and Research, 39, 0739456X1772397. https://doi.org/10.1177/0739456x17723971