Title

How to Meta-Analyze Coefficient of Stability Estimates: Some Recommendations Based on Monte Carlo Studies

Document Type

Article

Publication Date

10-1-2007

Keywords

reliability generalization, meta-analysis, Monte Carlo

Digital Object Identifier (DOI)

https://doi.org/10.1177/0013164407301532

Abstract

Reliability generalization studies have provided estimates of the mean reliability coefficients and examined factors that explain the variability in the reliability estimates across studies for many different tests and measures. Different authors have used different data analyses to do such meta-analyses, and little research has addressed whether some methods are more accurate than others. Three methods of meta-analysis for reliability data were compared using Monte Carlo techniques. The meta-analytic methods were those described by Hedges and Vevea, Hunter and Schmidt, and Vacha-Haase. The results suggested that a combination of methods worked best and that Hunter and Schmidt's method should be used to estimate the mean and random-effect variance component, but weighted regression should be used to model continuous moderators.

Was this content written or created while at USF?

Yes

Citation / Publisher Attribution

Educational and Psychological Measurement, v. 67, issue 5, 765-783

Share

COinS