SavedAdd your journal

Journals / Kuram ve Uygulamada Eğitim Bilimleri / 2015 / Cilt: 15 - Sayı: 5

Effect of Differential Item Functioning on Test Equating

KÜBRA ATALAY KABASAKAL
HÜLYA KELECİOĞLU
Pages
1229–1246
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

According to the results, differences were found in the performances of the methods under the analyzed conditions.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This study examines the effect of differential item functioning (DIF) items on test equating through multilevel item response models (MIRMs) and traditional IRMs.
📊
Key Findings & Data:The performances of three different equating models were investigated under 24 different simulation conditions, and the variables whose effects were examined included sample size, test length, DIF magnitude, and the test type.
💡
Conclusion & Impact:According to the results, differences were found in the performances of the methods under the analyzed conditions.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

This study examines the effect of differential item functioning (DIF) items on test equating through multilevel item response models (MIRMs) and traditional IRMs. The performances of three different equating models were investigated under 24 different simulation conditions, and the variables whose effects were examined included sample size, test length, DIF magnitude, and the test type. The MIRMs, in which the DIF factors were added as parameters, were compared with the Stocking-Lord (SL) method (one of the IRM-based calibration methods) and concurrent calibration method. According to the results, differences were found in the performances of the methods under the analyzed conditions. More specifically, the MIRMs were able to identify the DIF items, carry out the equating processes, and eliminate the biases caused by DIF in only one analysis. However, this does not indicate that using MIRMs is the best approach since the increase in sample size and test length generally had a positive effect on IRM-based equating, whereas MIRMs were less affected by these two conditions. Considering the IRM-based methods, it was found that separate calibration methods were more affected by the presence of DIF items compared to concurrent calibration. Moreover, this effect becomes most significant when DIF items are in common test and the magnitude of DIF is C.

🔖

Cite This Article

KABASAKAL, K. A., KELECİOĞLU, H. (2015). Effect of Differential Item Functioning on Test Equating. Kuram ve Uygulamada Eğitim Bilimleri, Cilt: 15 - Sayı: 5, 1229–1246. https://ajindex.com/articles/346972

References (4)

  1. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600).
  2. Washington, DC: American Council on Education. Atar, B. (2007). Differential item functioning analyses for mixed response data using IRT likelihood-ratio test, logistic regression, and Gllamm procedures (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No. 3263842) Bakan Kalaycıoğlu, D., & Kelecioğlu, H. (2011). Öğrenci Seçme Sınavı'nın madde yanlılığı açısından incelenmesi. Eğitim ve Bilim, 36, 3-13.
  3. Baker, F. B., & Al-Karni, A. (1991). A comparison of two procedures for computing IRT equating coefficients. Journal of Educational Measuremet, 28(2), 147-162. doi:10.1111/j.1745-3984.1991.tb00350.x Beretvas, S. N., & Williams, N. J. (2002, April). The use of HGLM as a dimensionality assessment. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA. Binici, S. (2007). Random-effect differential item functioning via hierarchical generalized linear model and generalized linear latent mixed model: a comparison of estimation methods (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No. 3282570) Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage. Camili, G., & Shephard, L. A. (1994). Methods for identifying biased test items. London, UK: Sage. Cho, S. J., & Cohen, E. S. (2010). A multilevel mixture IRT model with an application to DIF. Journal of Educational and Behavioral Statistics, 35(3), 336-370. doi:10.3102/1076998609353111 Chu, K. L. (2002). Equivalent group test equating with the presence of differential item functioning (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No.3065477) Chu, K. L., & Kamata, A. (2000, April). Nonequivalent group equating via 1-P HGLLM. Paper presented at the Annual Meeting of the American Educational Research, New Orleans, LA. Chu, K. L., & Kamata, A. (2005). Test equating in the presence of DIF items. Journal of Applied Measurement, Special Issue: The Multilevel Measurement Model, 6(3), 342-354.
  4. Cook, L. L., & Eignor, D. R. (1991). An NCME instructional module on IRT equating methods. Educational measurement: Issues and Practice. 10(3), 37-45. doi:10.1111/j.1745-3992.1991.tb00207.x Croker, L., & Algina, J. (1986). Introduction to classical and modern test theory.