Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations

Research output: Contribution to journalJournal articlepeer-review

Standard

Critical Values for Yen’s Q3 : Identification of Local Dependence in the Rasch Model Using Residual Correlations . / Christensen, Karl Bang; Makransky, Guido; Horton, Mike.

In: Applied Psychological Measurement, Vol. 41, No. 3, 01.05.2017, p. 178-194.

Research output: Contribution to journalJournal articlepeer-review

Harvard

Christensen, KB, Makransky, G & Horton, M 2017, 'Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations ', Applied Psychological Measurement, vol. 41, no. 3, pp. 178-194. https://doi.org/10.1177/0146621616677520

APA

Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations Applied Psychological Measurement, 41(3), 178-194. https://doi.org/10.1177/0146621616677520

Vancouver

Christensen KB, Makransky G, Horton M. Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations Applied Psychological Measurement. 2017 May 1;41(3):178-194. https://doi.org/10.1177/0146621616677520

Author

Christensen, Karl Bang ; Makransky, Guido ; Horton, Mike. / Critical Values for Yen’s Q3 : Identification of Local Dependence in the Rasch Model Using Residual Correlations In: Applied Psychological Measurement. 2017 ; Vol. 41, No. 3. pp. 178-194.

Bibtex

@article{f3188d821cfb4873a9a21d7e9ffe3ff1,
title = "Critical Values for Yen{\textquoteright}s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations ",
abstract = "The assumption of local independence is central to all item response theory (IRT) models. Violations can lead to inflated estimates of reliability and problems with construct validity. For the most widely used fit statistic Q3, there are currently no well-documented suggestions of the critical values which should be used to indicate local dependence (LD), and for this reason, a variety of arbitrary rules of thumb are used. In this study, an empirical data example and Monte Carlo simulation were used to investigate the different factors that can influence the null distribution of residual correlations, with the objective of proposing guidelines that researchers and practitioners can follow when making decisions about LD during scale development and validation. A parametric bootstrapping procedure should be implemented in each separate situation to obtain the critical value of LD applicable to the data set, and provide example critical values for a number of data structure situations. The results show that for the Q3 fit statistic, no single critical value is appropriate for all situations, as the percentiles in the empirical null distribution are influenced by the number of items, the sample size, and the number of response categories. Furthermore, the results show that LD should be considered relative to the average observed residual correlation, rather than to a uniform value, as this results in more stable percentiles for the null distribution of an adjusted fit statistic.",
author = "Christensen, {Karl Bang} and Guido Makransky and Mike Horton",
year = "2017",
month = may,
day = "1",
doi = "10.1177/0146621616677520",
language = "English",
volume = "41",
pages = "178--194",
journal = "Applied Psychological Measurement",
issn = "0146-6216",
publisher = "SAGE Publications",
number = "3",

}

RIS

TY - JOUR

T1 - Critical Values for Yen’s Q3

T2 - Identification of Local Dependence in the Rasch Model Using Residual Correlations

AU - Christensen, Karl Bang

AU - Makransky, Guido

AU - Horton, Mike

PY - 2017/5/1

Y1 - 2017/5/1

N2 - The assumption of local independence is central to all item response theory (IRT) models. Violations can lead to inflated estimates of reliability and problems with construct validity. For the most widely used fit statistic Q3, there are currently no well-documented suggestions of the critical values which should be used to indicate local dependence (LD), and for this reason, a variety of arbitrary rules of thumb are used. In this study, an empirical data example and Monte Carlo simulation were used to investigate the different factors that can influence the null distribution of residual correlations, with the objective of proposing guidelines that researchers and practitioners can follow when making decisions about LD during scale development and validation. A parametric bootstrapping procedure should be implemented in each separate situation to obtain the critical value of LD applicable to the data set, and provide example critical values for a number of data structure situations. The results show that for the Q3 fit statistic, no single critical value is appropriate for all situations, as the percentiles in the empirical null distribution are influenced by the number of items, the sample size, and the number of response categories. Furthermore, the results show that LD should be considered relative to the average observed residual correlation, rather than to a uniform value, as this results in more stable percentiles for the null distribution of an adjusted fit statistic.

AB - The assumption of local independence is central to all item response theory (IRT) models. Violations can lead to inflated estimates of reliability and problems with construct validity. For the most widely used fit statistic Q3, there are currently no well-documented suggestions of the critical values which should be used to indicate local dependence (LD), and for this reason, a variety of arbitrary rules of thumb are used. In this study, an empirical data example and Monte Carlo simulation were used to investigate the different factors that can influence the null distribution of residual correlations, with the objective of proposing guidelines that researchers and practitioners can follow when making decisions about LD during scale development and validation. A parametric bootstrapping procedure should be implemented in each separate situation to obtain the critical value of LD applicable to the data set, and provide example critical values for a number of data structure situations. The results show that for the Q3 fit statistic, no single critical value is appropriate for all situations, as the percentiles in the empirical null distribution are influenced by the number of items, the sample size, and the number of response categories. Furthermore, the results show that LD should be considered relative to the average observed residual correlation, rather than to a uniform value, as this results in more stable percentiles for the null distribution of an adjusted fit statistic.

U2 - 10.1177/0146621616677520

DO - 10.1177/0146621616677520

M3 - Journal article

C2 - 29881087

VL - 41

SP - 178

EP - 194

JO - Applied Psychological Measurement

JF - Applied Psychological Measurement

SN - 0146-6216

IS - 3

ER -

ID: 195960833