KaydedilenlerDerginizi ekleyin

Dergiler / Participatory Educational Research / 2022 / Cilt: 9 - Sayı: 5

Effect of Item Parameter Drift in Mixed Format Common Items on Test Equating

İbrahim UYSAL
Merve ŞAHİN KÜRŞAD
Abdullah Faruk KILIÇ
Sayfa
143–160
Yayın Tarihi
2022-09-01
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

As a result of the research, ratio of items with IPD in common items, IPD size in multiple-choice items, common item ratio, sample size and test length on equating errors were found to be significant.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item non-equivalent groups design.
📊
Temel Bulgular & Veri:In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test length (30 and 50), sample size (1000 and 3000), common item ratio (30 and 40%), ratio of items with item parameter drift (IPD) in common items (20 and 30%), location of common items in tests (at the beginning, randomly distributed, and at the end) and IPD size in multiple-choice items (low [0.2] and high [1.0]) were studied.
💡
Sonuç & Katkı:As a result of the research, ratio of items with IPD in common items, IPD size in multiple-choice items, common item ratio, sample size and test length on equating errors were found to be significant.
🔬Tür:Araştırma Makalesi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:mixed format tests · item parameter drift · test equating

Abstract

The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item non-equivalent groups design. In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test length (30 and 50), sample size (1000 and 3000), common item ratio (30 and 40%), ratio of items with item parameter drift (IPD) in common items (20 and 30%), location of common items in tests (at the beginning, randomly distributed, and at the end) and IPD size in multiple-choice items (low [0.2] and high [1.0]) were studied. Four test forms were created, and two test forms do not contain parameter drifts. After the parameter drift was performed on the first of the other two test forms, the parameter drift was again performed on the second test form. Test equating results were compared using the root mean squared error (RMSE) value. As a result of the research, ratio of items with IPD in common items, IPD size in multiple-choice items, common item ratio, sample size and test length on equating errors were found to be significant.

🔖

Bu Makaleye Atıf Yap

UYSAL, İ., KÜRŞAD, M. Ş., KILIÇ, A. F. (2022). Effect of Item Parameter Drift in Mixed Format Common Items on Test Equating. Participatory Educational Research, Cilt: 9 - Sayı: 5, 143–160. https://ajindex.com/articles/720525

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (5)

  1. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600). Washington: American Council on Education. Arce-Ferrer, A. J., & Bulut, O. (2017). Investigating separate and concurrent approaches for item parameter drift in 3PL item response theory equating. International Journal of Testing, 17(1), 1-22. doi:10.1080/15305058.2016.1227825 Babcock, B., & Albano, A. D. (2012). Rasch scale stability in the presence of item parameter and trait drift. Applied Psychological Measurement, 36(7), 565–580. doi:10.1177/0146621612455090 Bulut, O., & Sunbul, O. (2017). Monte Carlo simulation studies in Item Response Theory with the R programming language. Journal of Measurement and Evaluation in Education and Psychology, 8(3), 266-287. doi:10.21031/epod.305821 Bock, D. B., Muraki, E., & Pfeiffenberger, W. (1988). Item pool maintenance in the presence of item parameter drift. Journal of Educational Measurement, 25(4), 275-285. http://www.jstor.org/stable/1434961
  2. Brown, A., & Croudace, T. J. (2015). Scoring and estimating score precision using multidimensional IRT. In S. P. Reise & D. A. Revicki (Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 307-333). New York: Routledge/Taylor & Francis. Cao, Y. (2008). Mixed-format test equating: Effects of test dimensionality and common-item sets (Doctoral Dissertation, University of Maryland). Retrieved from https://drum.lib.umd.edu/handle/1903/8843
  3. Carsey, T. M., & Harden, J. J. (2014). Monte Carlo simulation and resampling methods for social sciences. doi:10.4135/9781483319605 Chen, Q. (2013). Remove or keep: Linking items showing item parameter drift (Unpublished doctoral dissertation). Michigan State University, Michigan. Chon, K. H., Lee, W.-C., & Ansley, T. N. (2007). Assessing IRT model-data fit for mixed format tests (Research Report 26). Iowa: Center for Advanced Studies in Measurement and Assessment. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York: Academic Press.
  4. DeMars, C. (2010). Item response theory: Understanding statistics, measurement. New York: Oxford University. Deng, W., & Monfils, R. (2017). Long-term impact of valid case criterion on capturing population-level growth under item response theory equating (Research Report 17-17). Retrieved from https://doi.org/10.1002/ets2.12144
  5. Felan, G. D. (2002, February). Test equating: Mean, linear, equipercentile and item respon