Journals / Participatory Educational Research / 2023 / Cilt: 10 Sayı: 5

A Comparison of Covariates, Equating Designs, and Methods in Equating TIMSS 2019 Science Tests

Pages
41–63
Publication Date
2023-09-01
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The research concluded that math achievement and home resources for learning could be used as covariates in NEC to equate the science test in case equating could not be done in the NEAT.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This research aimed to compare the equated scores by the methods based on classical test theory (CTT) and kernel equating, using covariates design (NEC) and anchor test design (NEAT).
📊
Key Findings & Data:TIMSS 2019 science test scores equated by both Tucker, Levine true score, Levine observed score, equipercentile equating (pre-smoothing and post-smoothing) methods in CTT, and linear and equipercentile methods in kernel equating.
💡
Conclusion & Impact:The research concluded that math achievement and home resources for learning could be used as covariates in NEC to equate the science test in case equating could not be done in the NEAT.
🔬Design:Research Article
📍Scope:2019 Verileri
⚙️Variables:anchor test design · covariates design · equating methods based on classical test theory

Abstract

This research aimed to compare the equated scores by the methods based on classical test theory (CTT) and kernel equating, using covariates design (NEC) and anchor test design (NEAT). TIMSS 2019 science test scores equated by both Tucker, Levine true score, Levine observed score, equipercentile equating (pre-smoothing and post-smoothing) methods in CTT, and linear and equipercentile methods in kernel equating. Additionally, the covariates in NEC design were “home resources for learning,” “student confidence in science and mathematics,” “like learning science,” “instructional clarity in science lessons,” “math achievement,” “sex,” and “speaking the language of the test at home”. The equating results in NEC were compared with those in NEAT and EG. The participants comprised 1699 4th-grade students who attended the e-TIMSS 2019 in Canada, Singapore, and Chile. Results were analyzed according to equating errors and differences between equated scores. The research concluded that math achievement and home resources for learning could be used as covariates in NEC to equate the science test in case equating could not be done in the NEAT. However, when the other variables were used as covariates in NEC, the equated scores were very similar to the EG. Also, Tucker (CTT) and post-stratification (kernel) yielded similar equated scores in linear equating, and these methods were similarly different from kernel linear equating in EG. In equipercentile equating, the equated scores obtained from the post-smoothing (CTT) and EG were close to each other but slightly differed from post-stratification.

🔖

Cite This Article

BAŞARAN, E. S., MUTLUER, C., ÇAKAN, M. (2023). A Comparison of Covariates, Equating Designs, and Methods in Equating TIMSS 2019 Science Tests. Participatory Educational Research, Cilt: 10 Sayı: 5, 41–63. https://ajindex.com/articles/961165

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (4)

  1. Akın Arıkan, C. (2019). A comparison of kernel equating methods based on neat design. Eurasian Journal of Educational Research, 19(82), 27-44.
  2. Akın-Arıkan, Ç. (2020). The impact of covariate variables on kernel equating under the non-equivalent groups. Journal of Measurement and Evaluation in Education and Psychology, 11(4), 362-373. doi:10.21031/epod.706835 Akın Arıkan, Ç., & Gelbal, S. (2018). A comparison of traditional and kernel equating methods. International Journal of Assessment Tools in Education, 5(3), 417–427. doi:10.21449/ijate.409826 Albano, A. D. (2016). equate: An R package for observed-score linking and equating. Journal of Statistical Software, 74(8), 1–36. doi: 10.18637/jss.v074.i08 Altintas, O., & Wallin, G. (2021). Equality of admission tests using kernel equating under the non-equivalent groups with covariates design. International Journal of Assessment Tools in Education, 8(4), 729–743. doi:10.21449/ijate.976660 Andersson, B., Branberg, K., & Wiberg, M. (2013). Performing the kernel method of test equating using the R package kequate. Journal of Statistical Software, 55, 1-25.
  3. Andersson, B., Branberg, K., & Wiberg, M. (2022). Package ‘kequate’. Retrieved from https://cran.r-project.org/web/packages/kequate/kequate.pdf
  4. Atalay Kabasakal, K., & Kelecioglu, H. (2015). Effect of differential item functioning on test equating. Educational Sciences: Theory & Practice, 15(5), 1229–1246. doi:10.12738/estp.2015.5.2505 Atar, B., Atalay Kabasakal, K., & Kibrislioglu Uysal, N. (2023). Comparability of TIMSS 2015 mathematics test scores across country subgroups. The Journal of Experimental Education, 91(1), 82-100. doi:10.1080/00220973.2021.1913978 Aydın, M. (2015). The effects of student-level and school-level factors on middle school students’ mathematics achievement. (Unpublished doctoral dissertation). Necmettin Erbakan University, Konya. Aydoğan, İ., & Gelbal, S. (2022). Determination of the characteristics predicting science achievement through the classification and regression tree (cart) method: The case of TIMSS 2015 Turkey. Education and Science, 47(209), 239-259. doi:10.15390/EB.2022.9368 Branberg, K., & Wiberg, M. (2011). Observed score linear equating with covariates. Journal of Educational Measurement, 48(4), 419-440. doi:10.1111/j.1745-3984.2011.00153.x Coşkun, B. (2021). The effects of student and school characteristics on TIMSS 2015 science and math achievement.