Dergiler / Journal of Teacher Education and Lifelong Learning / 2022 / Cilt: 4 - Sayı: 2

The Effect of Strong and Weak Unidimensional Item Pools on Computerized Adaptive Classification Testing

Sayfa
310–321
Yayın Tarihi
2022-12-31
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

Additionally, EAP and SPRT methods are recommended to prefer in the weak unidimensional item pool.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Computerized Adaptive Classification Tests (CACT) aim to classify individuals effectively with high classification accuracy and few items over large item pools.
📊
Temel Bulgular & Veri:The characteristic features of the item pool include the number of items, item factor loadings, the distribution of the Test Information Function, and dimensionality.
💡
Sonuç & Katkı:Additionally, EAP and SPRT methods are recommended to prefer in the weak unidimensional item pool.
🔬Tür:Laboratuvar & Saha Deneyi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Computerized adaptive classification testing · unidimesionality · strong unidimensionality

Abstract

Computerized Adaptive Classification Tests (CACT) aim to classify individuals effectively with high classification accuracy and few items over large item pools. The characteristic features of the item pool include the number of items, item factor loadings, the distribution of the Test Information Function, and dimensionality. In this study, we present the results of a comprehensive simulation study that was examined how item selection methods (MFI-KLI), ability estimation methods (EAP-WLE) and classification methods (SPRT-CI) were affected by strong and weak unidimensional item pools. Findings of the study indicate that CI had always produced results with classification accuracy similar to SPRT but with a test length of almost half. Additionally, KLI and MFI item selection methods were not affected by the item pool characteristic as weak or strong unidimensionality. From findings of this study, it can be recommended to use CI with EAP in CACT studies, whether the item pool is weak or strong unidimensional, but WLE only under strong unidimensional item pools. Additionally, EAP and SPRT methods are recommended to prefer in the weak unidimensional item pool.

🔖

Bu Makaleye Atıf Yap

GÜNDEĞER, C., SOYSAL, S. (2022). The Effect of Strong and Weak Unidimensional Item Pools on Computerized Adaptive Classification Testing. Journal of Teacher Education and Lifelong Learning, Cilt: 4 - Sayı: 2, 310–321. https://ajindex.com/articles/872848

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (9)

  1. Ayan, C. (2018). Comparing the psychometric features of traditional and computerized adaptive classification test in the cognitive diagnostic model [Unpublished Doctoral Dissertation]. Ankara University. Aybek, E. C. (2016). An investigation of applicability of the self assessment inventory as a computerized adaptive test (CAT) [Unpublished Doctoral Dissertation]. Ankara University. Breslow, N. E., & Holubkov, R. (1997). Weighted likelihood, pseudo-likelihood and maximum likelihood methods for logistic regression analysis of two-stage data. Statistics in Medicine, 16, 103-116.
  2. Cheng, P. E., & Liou, M. (2000). Estimation of trait level in computerized adaptive testing. Applied Psychological Measurement, 24(3), 257–265.
  3. Demir, S. (2019). Investigation of classification accuracy at computerized adaptive classification tests [Unpublished Doctoral Dissertation]. Hacettepe University. Diao, Q., & Reckase, M. (2009). Comparison of ability estimation and item selection methods in multidimensional computerized adaptive testing. In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing (pp. 1-13).
  4. UMI Research Press.
  5. Dogan, N., Soysal, S., & Karaman, H. (2017). Aynı örnekleme açımlayıcı ve doğrulayıcı faktör analizi uygulanabilir mi?[ Can exploratory and confirmatory factor analysis be conducted to the same sample?]. In Ö. Demirel & S. Dinçer (Eds.), Küreselleşen dünyada eğitim [Education in a globalizing World] (pp. 373- 400). Pegema Publishing. Doğruöz, E. (2018). Investigation of adaptive multistage test based on test assembly methods [Unpublished Doctoral Dissertation]. Hacetteepe University. Dooley, K. (2002), Simulation research methods. In J. Baum (Ed.), Companion to organizations, (pp. 829-848).
  6. Blackwell. Eggen, T. J. H. M. (1999). Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23, 249-260.
  7. Eggen, T. J. H. M., & Straetmans, G. J. J. M. (2000). Computerized adaptive testing for classifying examinees into three categories. Educational and Psychological Measurement, 60(5), 713-734.
  8. Erdem Kara, B. (2019). The effect of item ratio indicating differential item functioning on computer adaptive and multi stage tests [Unpublished Doctoral Dissertation]. Hacettepe University. Finkelman, M. (2008). On using stochastic curtailment to shorten the SPRT in sequential mastery testing. Journal of Educational and Behavioral Statistics, 33(4), 442-463.
  9. Flaugher, R. (2000).