Dergiler / Participatory Educational Research / 2023 / Cilt: 10 Sayı: 5

A Comparison of Covariates, Equating Designs, and Methods in Equating TIMSS 2019 Science Tests

Sayfa
41–63
Yayın Tarihi
2023-09-01
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

In equipercentile equating, the equated scores obtained from the post-smoothing (CTT) and EG were close to each other but slightly differed from post-stratification.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:This research aimed to compare the equated scores by the methods based on classical test theory (CTT) and kernel equating, using covariates design (NEC) and anchor test design (NEAT).
📊
Temel Bulgular & Veri:TIMSS 2019 science test scores equated by both Tucker, Levine true score, Levine observed score, equipercentile equating (pre-smoothing and post-smoothing) methods in CTT, and linear and equipercentile methods in kernel equating.
💡
Sonuç & Katkı:In equipercentile equating, the equated scores obtained from the post-smoothing (CTT) and EG were close to each other but slightly differed from post-stratification.
🔬Tür:Araştırma Makalesi
📍Kapsam:2019 Verileri
⚙️Değişkenler:anchor test design · covariates design · equating methods based on classical test theory

Abstract

This research aimed to compare the equated scores by the methods based on classical test theory (CTT) and kernel equating, using covariates design (NEC) and anchor test design (NEAT). TIMSS 2019 science test scores equated by both Tucker, Levine true score, Levine observed score, equipercentile equating (pre-smoothing and post-smoothing) methods in CTT, and linear and equipercentile methods in kernel equating. Additionally, the covariates in NEC design were “home resources for learning,” “student confidence in science and mathematics,” “like learning science,” “instructional clarity in science lessons,” “math achievement,” “sex,” and “speaking the language of the test at home”. The equating results in NEC were compared with those in NEAT and EG. The participants comprised 1699 4th-grade students who attended the e-TIMSS 2019 in Canada, Singapore, and Chile. Results were analyzed according to equating errors and differences between equated scores. The research concluded that math achievement and home resources for learning could be used as covariates in NEC to equate the science test in case equating could not be done in the NEAT. However, when the other variables were used as covariates in NEC, the equated scores were very similar to the EG. Also, Tucker (CTT) and post-stratification (kernel) yielded similar equated scores in linear equating, and these methods were similarly different from kernel linear equating in EG. In equipercentile equating, the equated scores obtained from the post-smoothing (CTT) and EG were close to each other but slightly differed from post-stratification.

🔖

Bu Makaleye Atıf Yap

BAŞARAN, E. S., MUTLUER, C., ÇAKAN, M. (2023). A Comparison of Covariates, Equating Designs, and Methods in Equating TIMSS 2019 Science Tests. Participatory Educational Research, Cilt: 10 Sayı: 5, 41–63. https://ajindex.com/articles/961165

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (4)

  1. Akın Arıkan, C. (2019). A comparison of kernel equating methods based on neat design. Eurasian Journal of Educational Research, 19(82), 27-44.
  2. Akın-Arıkan, Ç. (2020). The impact of covariate variables on kernel equating under the non-equivalent groups. Journal of Measurement and Evaluation in Education and Psychology, 11(4), 362-373. doi:10.21031/epod.706835 Akın Arıkan, Ç., & Gelbal, S. (2018). A comparison of traditional and kernel equating methods. International Journal of Assessment Tools in Education, 5(3), 417–427. doi:10.21449/ijate.409826 Albano, A. D. (2016). equate: An R package for observed-score linking and equating. Journal of Statistical Software, 74(8), 1–36. doi: 10.18637/jss.v074.i08 Altintas, O., & Wallin, G. (2021). Equality of admission tests using kernel equating under the non-equivalent groups with covariates design. International Journal of Assessment Tools in Education, 8(4), 729–743. doi:10.21449/ijate.976660 Andersson, B., Branberg, K., & Wiberg, M. (2013). Performing the kernel method of test equating using the R package kequate. Journal of Statistical Software, 55, 1-25.
  3. Andersson, B., Branberg, K., & Wiberg, M. (2022). Package ‘kequate’. Retrieved from https://cran.r-project.org/web/packages/kequate/kequate.pdf
  4. Atalay Kabasakal, K., & Kelecioglu, H. (2015). Effect of differential item functioning on test equating. Educational Sciences: Theory & Practice, 15(5), 1229–1246. doi:10.12738/estp.2015.5.2505 Atar, B., Atalay Kabasakal, K., & Kibrislioglu Uysal, N. (2023). Comparability of TIMSS 2015 mathematics test scores across country subgroups. The Journal of Experimental Education, 91(1), 82-100. doi:10.1080/00220973.2021.1913978 Aydın, M. (2015). The effects of student-level and school-level factors on middle school students’ mathematics achievement. (Unpublished doctoral dissertation). Necmettin Erbakan University, Konya. Aydoğan, İ., & Gelbal, S. (2022). Determination of the characteristics predicting science achievement through the classification and regression tree (cart) method: The case of TIMSS 2015 Turkey. Education and Science, 47(209), 239-259. doi:10.15390/EB.2022.9368 Branberg, K., & Wiberg, M. (2011). Observed score linear equating with covariates. Journal of Educational Measurement, 48(4), 419-440. doi:10.1111/j.1745-3984.2011.00153.x Coşkun, B. (2021). The effects of student and school characteristics on TIMSS 2015 science and math achievement.