Equivalencies Between Ad Hoc Strategies and Multivariate Models for Meta-Analysis of Dependent Effect Sizes

Resource type
Journal Article
Authors/contributors
Title
Equivalencies Between Ad Hoc Strategies and Multivariate Models for Meta-Analysis of Dependent Effect Sizes
Abstract
Meta-analyses of educational research findings frequently involve statistically dependent effect size estimates. Meta-analysts have often addressed dependence issues using ad hoc approaches that involve modifying the data to conform to the assumptions of models for independent effect size estimates, such as by aggregating estimates to obtain one summary estimate per study, conducting separate analyses of distinct subgroups of estimates, or combinations thereof. We show that these ad hoc approaches correspond exactly to certain multivariate models for dependent effect sizes. Specifically, we describe classes of multivariate random effects models that have likelihoods equivalent to those of models for effect sizes that have been averaged by study, classified into subgroups, or both. The equivalencies also apply to robust variance estimation methods.
Publication
Journal of Educational and Behavioral Statistics
Pages
-
Date
2024-03-05
ISSN
1076-9986
Call Number
openalex: W4392470354
Extra
openalex: W4392470354
Citation
Pustejovsky, J. E., & Chen, M. (2024). Equivalencies Between Ad Hoc Strategies and Multivariate Models for Meta-Analysis of Dependent Effect Sizes. Journal of Educational and Behavioral Statistics. https://doi.org/10.3102/10769986241232524