details
Article (journal) accessible via
URN: urn:nbn:de:0111-pedocs-216818
DOI: 10.25656/01:21681; 10.3102/1076998619890566
URN: urn:nbn:de:0111-pedocs-216818
DOI: 10.25656/01:21681; 10.3102/1076998619890566
Title |
A bias corrected RMSD item fit statistic. An evaluation and comparison to alternatives |
---|---|
Authors | Köhler, Carmen ; Robitzsch, Alexander ; Hartig, Johannes |
Source | Journal of educational and behavioral statistics 45 (2020) 3, S. 251-273 |
Document | full text (331 KB) |
License of the document | In copyright |
Keywords (German) | Item-Response-Theory; Testkonstruktion; Modell; Frage; Antwort; Messverfahren; Statistische Methode; Evaluation; Vergleich; Bildungsforschung; Empirische Forschung |
sub-discipline | Empirical Educational Research |
Document type | Article (journal) |
ISSN | 1076-9986; 10769986 |
Language | English |
Year of creation | 2020 |
review status | Peer-Reviewed |
Abstract (English): | Testing whether items fit the assumptions of an item response theory model is an important step in evaluating a test. In the literature, numerous item fit statistics exist, many of which show severe limitations. The current study investigates the root mean squared deviation (RMSD) item fit statistic, which is used for evaluating item fit in various large-scale assessment studies. The three research questions of this study are (1) whether the empirical RMSD is an unbiased estimator of the population RMSD; (2) if this is not the case, whether this bias can be corrected; and (3) whether the test statistic provides an adequate significance test to detect misfitting items. Using simulation studies, it was found that the empirical RMSD is not an unbiased estimator of the population RMSD, and nonparametric bootstrapping falls short of entirely eliminating this bias. Using parametric bootstrapping, however, the RMSD can be used as a test statistic that outperforms the other approaches - infit and outfit, S1 X2 with respect to both Type I error rate and power. The empirical application showed that parametric bootstrapping of the RMSD results in rather conservative item fit decisions, which suggests more lenient cut-off criteria. (DIPF/Orig.) |
Statistics | Number of document requests |
Checksums | checksum comparison as proof of integrity |
Date of publication | 04.08.2021 |
Citation | Köhler, Carmen; Robitzsch, Alexander; Hartig, Johannes: A bias corrected RMSD item fit statistic. An evaluation and comparison to alternatives - In: Journal of educational and behavioral statistics 45 (2020) 3, S. 251-273 - URN: urn:nbn:de:0111-pedocs-216818 - DOI: 10.25656/01:21681; 10.3102/1076998619890566 |