Dergiler / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2019 / Cilt: 10 - Sayı: 3

The Influence of Using Plausible Values and Survey Weights on Multiple Regression and Hierarchical Linear Model Parameters

Sayfa
235–248
Yayın Tarihi
2022-10-12
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

Findings of the study were discussed in details and some conclusions were drawn for practice and further research.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:In large-scale assessments like Programme for International Students Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), plausible values are often used as students’ ability estimations.
📊
Temel Bulgular & Veri:This study aims to investigate the influence of three approaches on the parameters of linear and hierarchical linear regression models: 1) using only one plausible value, 2) using all plausible values, 3) incorporating sampling weights or not.
💡
Sonuç & Katkı:Findings of the study were discussed in details and some conclusions were drawn for practice and further research.
🔬Tür:Uygulamalı Anket & Alan Araştırması
📍Kapsam:2015 Verileri
⚙️Değişkenler:Alan Parametreleri

Abstract

In large-scale assessments like Programme for International Students Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), plausible values are often used as students’ ability estimations. In those studies, stratified sampling method is employed in order to draw participants, and hence, the data gathered has a hierarchical structure. In the context of large-scale assessments, plausible values refer to randomly drawn values from posterior ability distribution. It is reported that using one of plausible values or mean of those values as independent variable in linear models may lead to some estimation errors. Moreover, it is observed that sampling weights sometimes are not used during analysis of large-scale assessment data. This study aims to investigate the influence of three approaches on the parameters of linear and hierarchical linear regression models: 1) using only one plausible value, 2) using all plausible values, 3) incorporating sampling weights or not. Data used in the present study is obtained from school and student questionnaires in PISA (2015) Turkey database. Results revealed that the use of sampling weights and number of plausible values has significant effects on regression coefficients, standard errors and explained variance for both regression models. Findings of the study were discussed in details and some conclusions were drawn for practice and further research.

🔖

Bu Makaleye Atıf Yap

KOYUNCU, İ., GELBAL, S., TAT, O. (2022). The Influence of Using Plausible Values and Survey Weights on Multiple Regression and Hierarchical Linear Model Parameters. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 10 - Sayı: 3, 235–248. https://ajindex.com/articles/497209

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (9)

  1. Acar, T., & Öğretmen, T. (2012). Çok düzeyli istatistiksel yöntemler ile 2006 PISA fen bilimleri performansının incelenmesi. Eğitim ve Bilim, 37(163). Retrieved from http://egitimvebilim.ted.org.tr/index.php/EB/article/download/1040/346
  2. Adams, R. J., & Wu, M. L. (Eds.) (2002) PISA 2000 technical report. Paris: OECD Publications. Atar, B. (2010). Basit doğrusal regresyon analizi ile hiyerarşik doğrusal modeller analizinin karşılaştırılması. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 1(2), 78-84.
  3. Atar, H. Y., & Atar, B. (2012). Examining the effects of Turkish education reform on students’ TIMSS 2007 science achievements. Educational Sciences: Theory and Practice, 12(4), 2632–2636.
  4. Beaton, A.E. (1987). Implementing the new design. (The NAEP 1983-84 technical report, Report No. 15-TR-20). Princeton, NJ: Educational Testing Service. Bock, R. D. & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of the EM algorithm. Psychometrika 46, 443-459.
  5. Bryk, A. S., & Raudenbush, S. W. (1988). Toward a more appropriate conceptualization of research on school effects: A three-level hierarchical linear model. American Journal of Education 97(1), 65-108.
  6. Bryk, A. S., & Raudenbush, S. W. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage Publications. Bryk, A. S., Raudenbush, S. W., & Congdon, R. (2010). HLM7 for Windows [Computer software]. Chicago, IL: Scientific Software International, Inc. Carle, A. C. (2009). Fitting multilevel models in complex survey data with design weights: Recommendations. BMC Medical Research Methodology, 9(1), 1-13. doi: 10.1186/1471-2288-9-49
  7. Chowa, G. A., Masa, R. D., Ramos, Y., & Ansong, D. (2015). How do student and school characteristics influence youth academic achievement in Ghana? A hierarchical linear modelling of Ghana Youth Save baseline data. International Journal of Educational Development, 45, 129-140.
  8. Cochran, W. G. (1977). Sampling techniques (3rd ed.). New York, NY: John Wiley and Sons. Fraenkel, J. R.; Wallen, N. E.; Hyun, H. H. (2012): How to design and evaluate research in education (8th Ed.). New York, NY: McGraw-Hill Humanities / Social Sciences/Languages. Gelman, A. (2006). Multilevel (hierarchical) modelling: What it can and cannot do. Technometrics 48(3), 432-435.
  9. Goldstein, H. (2011). Multilevel statistical models (Vol. 922). Oxford: John Wiley & Sons. International Business Machines Corp. (2015). IBM SPSS S