Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2021 / Cilt: 12 - Sayı: 2

PISA 2015 Reading Test Item Parameters Across Language Groups: A measurement Invariance Study with Binary Variables

Pages
112–128
Publication Date
2021-06-30
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Measurement invariance studies taking into account the binary structure of the data set for these two groups revealed that eight of the twenty-eight items in the PISA-2015 reading skills test had possible limitations in equivalence

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Large-scale international assessments, including PISA, might be useful for countries to receive feedback on their education systems.
📊
Key Findings & Data:In this respect, the purpose of our study is to investigate whether there is a measurement invariance problem across native English and non-native English speaker groups in the PISA-2015 reading skills subtest.
💡
Conclusion & Impact:Measurement invariance studies taking into account the binary structure of the data set for these two groups revealed that eight of the twenty-eight items in the PISA-2015 reading skills test had possible limitations in equivalence
🔬Design:Research Article
📍Scope:2015 Verileri
⚙️Variables:PISA 2015 · measurement invariance (MI) · binary variables

Abstract

Large-scale international assessments, including PISA, might be useful for countries to receive feedback on their education systems. Measurement invariance studies are one of the active research areas for these assessments, especially cross-cultural and linguistic comparability have attracted attention. PISA questions are prepared in the English language, and students from many countries answer the translated form. In this respect, the purpose of our study is to investigate whether there is a measurement invariance problem across native English and non-native English speaker groups in the PISA-2015 reading skills subtest. The study sample included students from Canada, the USA, and the UK as the native speaker group and students from Japan, Thailand, and Turkey as the non-native speaker group. Measurement invariance studies taking into account the binary structure of the data set for these two groups revealed that eight of the twenty-eight items in the PISA-2015 reading skills test had possible limitations in equivalence

🔖

Cite This Article

SÖYLER, P. B., AYDIN, B., ATILGAN, H. (2021). PISA 2015 Reading Test Item Parameters Across Language Groups: A measurement Invariance Study with Binary Variables. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 12 - Sayı: 2, 112–128. https://ajindex.com/articles/218017

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Adams, R., & Rowe, K. (1988). Educational research, methodology, and measurement:An international handbook. Oxford: Pergamon Press.
  2. Adams, R., & Rowe, K. (1988). Educational research, methodology, and measurement:An international handbook. Oxford: Pergamon Press.
  3. Akbaş, U. ve Tavşancıl, E. (2015). Farklı örneklem büyüklüklerinde ve kayıp veri örüntülerinde ölçeklerin psikometrik özelliklerinin kayıp veri baş etme teknikleri ile incelenmesi., Journal of Measurement and Evaluation in Education and Psychology, 6(1), 38-57
  4. Akbaş, U. ve Tavşancıl, E. (2015). Farklı örneklem büyüklüklerinde ve kayıp veri örüntülerinde ölçeklerin psikometrik özelliklerinin kayıp veri baş etme teknikleri ile incelenmesi., Journal of Measurement and Evaluation in Education and Psychology, 6(1), 38-57
  5. Algina, J. & Crocker, L., (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston. Algina, J. & Crocker, L., (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston. Arffman, I. (2002). In search of equivalence: Translation problems in international literacy studies. Finland. Arffman, I. (2010). Equivalence of translations in international reading literacy studies. Scandinavian Journal of Educational Research, 54(1), 37-59.
  6. Arffman, I. (2010). Equivalence of translations in international reading literacy studies. Scandinavian Journal of Educational Research, 54(1), 37-59.
  7. Asil, M., & Gelbal, S. (2012). Cross-cultural equivalence of the PISA student questionnaire. Education ve Science, 236-249.
  8. Asil, M., & Gelbal, S. (2012). Cross-cultural equivalence of the PISA student questionnaire. Education ve Science, 236-249. Asil M., & Brown, G. (2015). Comparing OECD PISA reading in English to other languages: Identifying potential sources of non-invariance. International Journal of Testing, 16(1), 71-93. Asil M., & Brown, G. (2015). Comparing OECD PISA reading in English to other languages: Identifying potential sources of non-invariance. International Journal of Testing, 16(1), 71-93.
  9. Baker, F. B. (2016). The basics of item response theory. Ankara:
  10. Pegem Academy. Baker, F. B. (2016). The basics of item response theory. Ankara:
  11. Pegem Academy. Baykal, A., & Circi, R. (2010). Item revision to improve construct validity: A study on released science items in Turkish PISA 2006. Procedia Social and Behavioral Sciences, 2(2), 1931-1935.
  12. Baykal, A., & Circi, R. (2010). Item revision to improve construct validity: A study