KaydedilenlerDerginizi ekleyin

Dergiler / Kuram ve Uygulamada Eğitim Bilimleri / 2015 / Cilt: 15 - Sayı: 5

Effect of Differential Item Functioning on Test Equating

KÜBRA ATALAY KABASAKAL
HÜLYA KELECİOĞLU
Sayfa
1229–1246
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

Moreover, this effect becomes most significant when DIF items are in common test and the magnitude of DIF is C.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:This study examines the effect of differential item functioning (DIF) items on test equating through multilevel item response models (MIRMs) and traditional IRMs.
📊
Temel Bulgular & Veri:The performances of three different equating models were investigated under 24 different simulation conditions, and the variables whose effects were examined included sample size, test length, DIF magnitude, and the test type.
💡
Sonuç & Katkı:Moreover, this effect becomes most significant when DIF items are in common test and the magnitude of DIF is C.
🔬Tür:Modelleme & Sayısal Simülasyon
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Alan Parametreleri

Abstract

This study examines the effect of differential item functioning (DIF) items on test equating through multilevel item response models (MIRMs) and traditional IRMs. The performances of three different equating models were investigated under 24 different simulation conditions, and the variables whose effects were examined included sample size, test length, DIF magnitude, and the test type. The MIRMs, in which the DIF factors were added as parameters, were compared with the Stocking-Lord (SL) method (one of the IRM-based calibration methods) and concurrent calibration method. According to the results, differences were found in the performances of the methods under the analyzed conditions. More specifically, the MIRMs were able to identify the DIF items, carry out the equating processes, and eliminate the biases caused by DIF in only one analysis. However, this does not indicate that using MIRMs is the best approach since the increase in sample size and test length generally had a positive effect on IRM-based equating, whereas MIRMs were less affected by these two conditions. Considering the IRM-based methods, it was found that separate calibration methods were more affected by the presence of DIF items compared to concurrent calibration. Moreover, this effect becomes most significant when DIF items are in common test and the magnitude of DIF is C.

🔖

Bu Makaleye Atıf Yap

KABASAKAL, K. A., KELECİOĞLU, H. (2015). Effect of Differential Item Functioning on Test Equating. Kuram ve Uygulamada Eğitim Bilimleri, Cilt: 15 - Sayı: 5, 1229–1246. https://ajindex.com/articles/346972

Kaynakça (4)

  1. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600).
  2. Washington, DC: American Council on Education. Atar, B. (2007). Differential item functioning analyses for mixed response data using IRT likelihood-ratio test, logistic regression, and Gllamm procedures (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No. 3263842) Bakan Kalaycıoğlu, D., & Kelecioğlu, H. (2011). Öğrenci Seçme Sınavı'nın madde yanlılığı açısından incelenmesi. Eğitim ve Bilim, 36, 3-13.
  3. Baker, F. B., & Al-Karni, A. (1991). A comparison of two procedures for computing IRT equating coefficients. Journal of Educational Measuremet, 28(2), 147-162. doi:10.1111/j.1745-3984.1991.tb00350.x Beretvas, S. N., & Williams, N. J. (2002, April). The use of HGLM as a dimensionality assessment. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA. Binici, S. (2007). Random-effect differential item functioning via hierarchical generalized linear model and generalized linear latent mixed model: a comparison of estimation methods (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No. 3282570) Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage. Camili, G., & Shephard, L. A. (1994). Methods for identifying biased test items. London, UK: Sage. Cho, S. J., & Cohen, E. S. (2010). A multilevel mixture IRT model with an application to DIF. Journal of Educational and Behavioral Statistics, 35(3), 336-370. doi:10.3102/1076998609353111 Chu, K. L. (2002). Equivalent group test equating with the presence of differential item functioning (Doctoral dissertation). Available from ProOuest Dissertations and Theses database. (UMI No.3065477) Chu, K. L., & Kamata, A. (2000, April). Nonequivalent group equating via 1-P HGLLM. Paper presented at the Annual Meeting of the American Educational Research, New Orleans, LA. Chu, K. L., & Kamata, A. (2005). Test equating in the presence of DIF items. Journal of Applied Measurement, Special Issue: The Multilevel Measurement Model, 6(3), 342-354.
  4. Cook, L. L., & Eignor, D. R. (1991). An NCME instructional module on IRT equating methods. Educational measurement: Issues and Practice. 10(3), 37-45. doi:10.1111/j.1745-3992.1991.tb00207.x Croker, L., & Algina, J. (1986). Introduction to classical and modern test theory.