A Multilevel Bifactor Approach to Construct Validation of Mixed-Format Scales
Document Type
Article
Publication Date
2017
Keywords
wording effects, multilevel bifactor model, mixed-format scales, construct validation
Digital Object Identifier (DOI)
https://doi.org/10.1177/0013164417690858
Abstract
Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and correlated methods model. This study presents the multilevel bifactor approach to handling wording effects of mixed-format scales used in a multilevel context. The Students Confident in Mathematics scale is used to illustrate this approach. Results from comparing a series of models showed that positive and negative wording effects were present at both the within and the between levels. When the wording effects were ignored, the within-level predictive validity of the Students Confident in Mathematics scale was close to that under the multilevel bifactor model. However, at the between level, a lower validity coefficient was observed when ignoring the wording effects. Implications for applied researchers are discussed.
Was this content written or created while at USF?
Yes
Citation / Publisher Attribution
Educational and Psychological Measurement, v. 78, issue 2, p. 253-271
Scholar Commons Citation
Wang, Yan; Kim, Eun Sook; Dedrick, Robert F.; Ferron, John M.; and Tan, Tony, "A Multilevel Bifactor Approach to Construct Validation of Mixed-Format Scales" (2017). Educational and Psychological Studies Faculty Publications. 215.
https://digitalcommons.usf.edu/esf_facpub/215
