KaydedilenlerDerginizi ekleyin

Dergiler / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2023 / Cilt: 14 - Sayı: 1

The Effects of Different Item Selection Methods on Test Information and Test Efficiency in Computer Adaptive Testing

Merve ŞAHİN KÜRŞAD
Sayfa
33–46
Yayın Tarihi
2023-03-25
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

In terms of test efficiency, the performances of the methods were similar, except for the random selection method, which had the worst performance in terms of both TIF and test efficiency.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:The purpose of this study is to examine the effect of different item selection methods on test information function (TIF) and test efficiency in computer adaptive testing (CAT).
📊
Temel Bulgular & Veri:In the comparison of these methods, the best performance in the aspect of TIF is provided by the maximum fisher information method.
💡
Sonuç & Katkı:In terms of test efficiency, the performances of the methods were similar, except for the random selection method, which had the worst performance in terms of both TIF and test efficiency.
🔬Tür:Laboratuvar & Saha Deneyi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Computer adaptive testing · test information function · test efficiency

Abstract

The purpose of this study is to examine the effect of different item selection methods on test information function (TIF) and test efficiency in computer adaptive testing (CAT). TIF indicates the quantity of information the test has produced. Test efficiency resembles the amount of information from each item, and more efficient tests are produced from the smallest number of good-quality items. The study was conducted with simulated data, and the constants of the study are sample size, ability parameter distribution, item pool size, model of item response theory (IRT) and distribution of item parameters, ability estimation method, starting rule, item exposure control and stopping rule. The item selection methods, which are the independent variables of this study, are the interval information criterion, efficiency balanced information, matching -b value, Kullback-Leibler information, maximum fisher information, likelihood-weighted information, and random selection. In the comparison of these methods, the best performance in the aspect of TIF is provided by the maximum fisher information method. In terms of test efficiency, the performances of the methods were similar, except for the random selection method, which had the worst performance in terms of both TIF and test efficiency.

🔖

Bu Makaleye Atıf Yap

KÜRŞAD, M. Ş. (2023). The Effects of Different Item Selection Methods on Test Information and Test Efficiency in Computer Adaptive Testing. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 14 - Sayı: 1, 33–46. https://ajindex.com/articles/885731

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (10)

  1. Babcock, B. & Albano, A. D. (2012). Rasch scale stability in the presence of item parameter and trait drift. Applied Psychological Measurement, 36(7), 565- 580. https://doi.org/10.1177/0146621612455090
  2. Babcock, B. & Weiss, D.J. (2012). Termination criteria in computerized adaptive tests: Do variable-length CAT’s provide efficient and effective measurement? International Association for Computerized Adaptive Testing, 1, 1-18. http://dx.doi.org/10.7333%2Fjcat.v1i1.16
  3. Baker, F. (1986). The basics of item response theory. Journal of Educational Measurement, 23(3), 267-270.
  4. Baker, F. B. (1992). Item response theory: Parameter estimation techniques. Marcel Dekker. Balta, E., & Uçar, A. (2022). Investigation of measurement precision and test length in computerized adaptive testing under different conditions, E-International Journal of Educational Research, 13(1), 51-68. https://doi.org/10.19160/e-ijer.1023098
  5. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord and M. R. Novick (Eds.), Statistical theories of mental test scores (chaps. 17–20).
  6. AddisonWesley. Blais, J. & Raiche, G. (2010). Features of the sampling distribution of the ability estimate in Computerized Adaptive Testing according to two stopping rules. Journal of applied measurement, 11(4), 424-31.
  7. Bock, R. D. & Aitkin, M. (1981).Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://link.springer.com/article/10.1007/BF02293801
  8. Bock, R. D. & Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6(4), 431– 444. https://doi.org/10.1177/014662168200600405
  9. Boyd, M. A. (2003). Strategies for controlling testlet exposure rates in computerized adaptive testing systems [Unpublished Doctoral Thesis]. The University of Texas. Boztunç Öztürk, N. (2014). Bireyselleştirilmiş bilgisayarlı test uygulamalarinda madde kullanım sıklığı kontrol yöntemlerinin incelenmesi [Investigatıon of item exposure control methods in computerized adaptive testing] [Unpublished Doctoral Dissertation]. Hacettepe University. Boztunç Öztürk, N. & Doğan, N. (2015). Investigating item exposure control methods in computerized adaptive testing. Educational Sciences: Theory and Practice, 15(1), 85-98. https://doi.org/10.12738/estp.2015.1.2593
  10. Brown, A. (2018). Item response theory approaches to test scoring and evaluating the score accuracy. I