Dergiler / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2022 / Cilt: 13 - Sayı: 2

Investigation of the Missing Data Imputation Methods on Characteristic Curve Transformation Methods Used in Test Equating

Sayfa
105–116
Yayın Tarihi
2022-10-12
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

In addition, it was determined that, when compared to the Haebara method, Stocking-Lord method, one of the characteristic curve transformation methods, produced lower RMSE values and these values were closer to the full data set, which was taken as a reference value.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:In this research, the aim was to evaluate the effect of zero imputation and multiple imputation missing data handling methods on item response theory (IRT) based test equating methods under different conditions.
📊
Temel Bulgular & Veri:Data in this study was obtained from the administration of the TIMSS 2019 eighth-grade science test.
💡
Sonuç & Katkı:In addition, it was determined that, when compared to the Haebara method, Stocking-Lord method, one of the characteristic curve transformation methods, produced lower RMSE values and these values were closer to the full data set, which was taken as a reference value.
🔬Tür:Araştırma Makalesi
📍Kapsam:2019 Verileri
⚙️Değişkenler:Missing data · zero imputation method · multiple imputation method

Abstract

In this research, the aim was to evaluate the effect of zero imputation and multiple imputation missing data handling methods on item response theory (IRT) based test equating methods under different conditions. Data in this study was obtained from the administration of the TIMSS 2019 eighth-grade science test. Data sets were formed by randomly selecting a sample of 1000 students with full data from booklets 7 and 8. By deleting data under a completely random missing data mechanism within the scope of common-item nonequivalent groups (CINEG) design, four different data sets were obtained with the missing data rates of 10% or 20% in the new test or in both tests. The missing da ta problem was solved by using zero imputation and multiple imputation methods from these data sets. In this way, 8 different data sets were formed. Then, scaling transformation was performed by using characteristic curve transformation methods (Haebara, Stocking-Lord). Test equating results were reported in terms of observed scores. The root mean square error (RMSE) was used as the evaluation criterion to determine the error involved in test equating. As a result, it was determined that in the case of 10% missing data in both tests, generally lower RMSE values were obtained. It was observed that the multiple imputation method, one of the methods for handling missing data, was the method that produced RMSE values that were both the lowest and closer to the full data set as a reference value compared to the zero-imputation method. In addition, it was determined that, when compared to the Haebara method, Stocking-Lord method, one of the characteristic curve transformation methods, produced lower RMSE values and these values were closer to the full data set, which was taken as a reference value.

🔖

Bu Makaleye Atıf Yap

ÖZDEMİR, G., ATAR, B. (2022). Investigation of the Missing Data Imputation Methods on Characteristic Curve Transformation Methods Used in Test Equating. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 13 - Sayı: 2, 105–116. https://ajindex.com/articles/497150

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (8)

  1. Akbaş, U. (2014). Farklı örneklem büyüklüklerinde ve kayıp veri örüntülerinde ölçeklerin psikometrik özelliklerinin kayıp veri baş etme teknikleri ile incelenmesi [Investigation of psychometric properties of scales with missing data techniques for different sample sizes and missing data patterns] (Thesis No. 370326) [Doctoral dissertation, Ankara University]. Council of Higher Education Thesis Center. https://tez.yok.gov.tr/UlusalTezMerkezi/
  2. Aksekioğlu, B. (2017). Madde tepki kuramına dayalı test eşitleme yöntemlerinin karşılaştırılması: PISA 2012 fen testi örneği [Comparison of test equating methods based on item response theory: PISA 2012 science test sample] (Thesis No. 454879) [Master thesis, Akdeniz University]. Council of Higher Education Thesis Center. https://tez.yok.gov.tr/UlusalTezMerkezi/
  3. Allison, P. D. (2003). Missing data techniques for structural equation modeling. Journal of Abnormal Psychology, 112(4), 545-557. https://doi.org/10.1037/0021-843X.112.4.545
  4. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600). American Council on Education. Atalay Kabasakal, K. (2014). Değişen madde fonksiyonunun test eşitlemeye etkisi [The effect of differential item functioning on test equating] (Thesis No. 363206) [Doctoral dissertation, Hacettepe University]. Council of Higher Education Thesis Center. https://tez.yok.gov.tr/UlusalTezMerkezi/
  5. Aytekin Kazanç, E. (2019). Şans başarısının test eşitlemeye etkisinin farklı eşitleme teknikleriyle araştırılması [Investigation of the effect of guessing on test equating with different equating methods] (Thesis No. 584263) [Master thesis, Hacettepe University]. Council of Higher Education Thesis Center. https://tez.yok.gov.tr/UlusalTezMerkezi/
  6. Battauz, M. (2021). Package ‘equateIRT’. https://cran.r-project.org/web/packages/equateIRT/equateIRT.pdf
  7. Bayhan, A. (2018). Farklı koşullardaki kayıp veri oranının iç tutarlığa etkisi [The effect of missing data rate on internal consistency within different conditions] (Thesis No. 531022) [Master thesis, Hacettepe University]. Council of Higher Education Thesis Center. https://tez.yok.gov.tr/UlusalTezMerkezi/
  8. Bayram, İ. (2020). Kayıp veri ile baş etme yöntemlerinin güvenirlik kestirimleri üzerine etkisi [Comparison of influence of the missing data handling methods on reliability estimation] (Thesis No. 634087) [Master thesis, Hacettepe University]. Council of Higher Education Thesis Center. https://tez.yok.go