Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2021 / Cilt: 12 - Sayı: 2

The Comparison of the Equated Tests Scores by Using Various Covariates using Bayesian Nonparametric Model

Pages
192–211
Publication Date
2021-06-30
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result of the research, it was determined that the model is more informative than the classical methods.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This research is based on obtaining equated scores by using covariates in the Bayesian nonparametric model.
📊
Key Findings & Data:The study was conducted on Canadian and Italian samples of Programme for International Student Assessment (PISA) 2012.
💡
Conclusion & Impact:As a result of the research, it was determined that the model is more informative than the classical methods.
🔬Design:Modeling & Simulation
📍Scope:2012 Verileri
⚙️Variables:Test equating · Bayesian nonparametric model · covariates

Abstract

This research is based on obtaining equated scores by using covariates in the Bayesian nonparametric model. As covariates in the study, gender, mathematics self-efficacy scores, and common item scores were used. The distributions were obtained for all score groups. Hellinger Distance was calculated to obtain the distances between the distributions of equated scores by using covariates and the distribution of the target test scores. These distances were compared with the distributions of equated scores obtained from methods based on Item Response Theory. The study was conducted on Canadian and Italian samples of Programme for International Student Assessment (PISA) 2012. PARSCALE and IRTEQ were used for classical methods, and R was used for Bayesian nonparametric model. When gender, mathematics self-efficacy scores, and common item scores were used as covariates in the model, distance values of obtained equated scores to target test scores were close to each other, but their distributions were different. The closest distribution to target test scores was achieved when gender and mathematics self-efficacy scores were used together as covariates in the model, and the farthest distributions were obtained from item response theory methods. As a result of the research, it was determined that the model is more informative than the classical methods.

🔖

Cite This Article

YURTÇU, M., KELECİOĞLU, H., BOONE, E. (2021). The Comparison of the Equated Tests Scores by Using Various Covariates using Bayesian Nonparametric Model. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 12 - Sayı: 2, 192–211. https://ajindex.com/articles/218022

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (6)

  1. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508-600).
  2. Washington, DC: American Council on Education. Ayotola, A., & Adedeji, T. (2009). The relationship between mathematics self-efficacy and achievement in mathematics. Procedia Social and Behavioral Science, 1, 953-957. Retrieved from https://cyberleninka.org/article/n/1232855.pdf
  3. Barrientos, A. F., Jara, A., & Quintana, F. (2012). On the support of MacEachern’s dependent dirichlet processes and extensions. Bayesian Analaysis, 7(2), 277-310. Retrieved from https://projecteuclid.org/download/pdfview_1/euclid.ba/1339878889
  4. Barrientos, A. F., Jara, A., & Quintana, F. (2016). Fully nonparametric regression for bounded data using Bernstein polynomials. Retrieved from http://www.mat.uc.cl/~ajara/Publications_files/DependentBernstein.pdf
  5. Berger, J. O., Boukai, B., & Wang, Y. (1997). Unied frequentist and bayesian testing of a precise hypothesis. Statistical Science, 12(3), 133-160. Retrieved from https://www2.stat.duke.edu/~berger/papers/statsci.pdf
  6. Boone, E. L. Merrick, J. R. W., & Krachey, M. J. (2012). A Hellinger distance approach to MCMC diagnostics. Journal of Statistical Computation and Simulation, 84(4), 833-849. doi: 10.1080/00949655.2012.729588 Branberg, K., & Wiberg, M. (2011). Observed score linear equating with covariates. Journal of Educational Measurement, 48(4), 419-440. doi: 10.1111/j.1745-3984.2011.00153.x De Iorio, M., Müller, P., Rosner, G., L., & MacEachern, S. N. (2004). An ANOVA model for dependent random measures. Journal of the American Statistical Association, 99(465), 205-215. doi: 10.1198/016214504000000205 Ding, Y. (2016). How do students’ mathematics self-efficacy, mathematics self-concept and mathematics anxiety influence mathematical literacy?-A comparison between Shanghai-China and Sweden in PISA 2012 (Master thesis). University of Gothenburg, Faculty of Education, Gothenburg, Sweden. Dorans, J. N., & Holland, P. W. (2000). Population invariance and the equitability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37(4), 281-306. doi: 10.1111/j.1745-3984.2000.tb01088.x Dorans, N. J., Moses, T. P., & Eignor, D. R. (2010). Principles and practices of test score equating (ETS RR-10-29). New Jersey: ETS, Princeton. González J., & Wiberg M. (2017) Recent developments in equating. In J. González & M. Wiberg (Eds.), Applying test equating methods: Methodology of educational measurement an