SavedAdd your journal

Journals / International Journal of Assessment Tools in Education / 2022 / Cilt: 9 - Sayı: 2

The Methodological Quality of Experimental STEM Education Articles Published in Scholarly Journals from 2014 to 2020

Ramazan AVCU
Seher AVCU
Pages
290–318
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Ultimately, we discuss some implications for authors, journals editors, policymakers, and curriculum developers.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Experimental studies have a considerable impact on the educational policies and practices of many countries.
📊
Key Findings & Data:In Turkey, policymakers are planning to initiate a STEM education reform in K-12 schools based on experimental studies.
💡
Conclusion & Impact:Ultimately, we discuss some implications for authors, journals editors, policymakers, and curriculum developers.
🔬Design:Review & Systematic Survey
📍Scope:2014 Verileri
⚙️Variables:STEM education · Methodological quality · Experimental research

Abstract

Experimental studies have a considerable impact on the educational policies and practices of many countries. In Turkey, policymakers are planning to initiate a STEM education reform in K-12 schools based on experimental studies. However, the methodological flaws in these studies may lead to biased outcomes and may mislead the STEM education community. Despite the importance of methodological quality, to the best of our knowledge, there are no studies that investigate the methodological quality of experimental STEM education articles published in scholarly journals. Therefore, in this study, we conducted a methodological review to examine the methodological quality of experimental STEM education articles published in refereed Turkish journals from 2014 to 2020. During the targeted period, we located 68 articles. We analyzed these articles by developing a coding framework. We found that the selected articles suffer seriously from various methodological flaws. We discuss the findings in light of the literature on methodological quality and suggest ways to improve the rigor of the experimental designs used. Ultimately, we discuss some implications for authors, journals editors, policymakers, and curriculum developers.

Özet

Experimental studies have a considerable impact on the educational policies and practices of many countries. In Turkey, policymakers are planning to initiate a STEM education reform in K-12 schools based on experimental studies. However, the methodological flaws in these studies may lead to biased outcomes and may mislead the STEM education community. Despite the importance of methodological quality, to the best of our knowledge, there are no studies that investigate the methodological quality of experimental STEM education articles published in scholarly journals. Therefore, in this study, we conducted a methodological review to examine the methodological quality of experimental STEM education articles published in refereed Turkish journals from 2014 to 2020. During the targeted period, we located 68 articles. We analyzed these articles by developing a coding framework. We found that the selected articles suffer seriously from various methodological flaws. We discuss the findings in light of the literature on methodological quality and suggest ways to improve the rigor of the experimental designs used. Ultimately, we discuss some implications for authors, journals editors, policymakers, and curriculum developers.

🔖

Cite This Article

AVCU, R., AVCU, S. (2022). The Methodological Quality of Experimental STEM Education Articles Published in Scholarly Journals from 2014 to 2020. International Journal of Assessment Tools in Education, Cilt: 9 - Sayı: 2, 290–318. https://ajindex.com/articles/540014

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (10)

  1. Ahern, K.J. (1999). Ten tips for reflexive bracketing. Qualitative Health Research, 9(3), 407–411. https://doi.org/10.1177/104973239900900309
  2. Akgündüz, D., Aydeniz, M., Çakmakçı, G., Çavaş, B., Çorlu, M.S., Öner, T., & Özdemir, S. (2015). STEM eğitimi Türkiye raporu: Günün modası mı yoksa gereksinim mi? [A report on STEM education in Turkey: A provisional agenda or a necessity?]. Scala Press.
  3. Aktemur, Ş. (2015). Review of aviation research: A content analysis of articles published in the Collegiate Aviation Review, 2007–2012 [Unpublished master’s thesis]. Florida Institute of Technology. Aron, A., Coups, E.J., & Aron, E.N. (2019). Statistics for the behavioral and social sciences: A brief course (6th ed.). Pearson. Ary, D., Jacobs, L.C., Sorensen, C.K., & Walker, D. (2014). Introduction to research in education (9th ed.). Wadsworth Cengage Learning. Aydın Günbatar, S., & Tabar, V. (2019). Türkiye’de gerçekleştirilen STEM araştırmalarının içerik analizi [Content analysis of Science, Technology, Engineering and Mathematics (STEM) research conducted in Turkey]. Yüzüncü Yıl University Journal of Education, 16(1), 1054–1083. http://dx.doi.org/10.23891/efdyyu.2019.153
  4. Baydaş, Ö., Küçük, S., Yılmaz, R. M., Aydemir, M., & Göktaş, Y. (2015). Educational technology research trends from 2002 to 2014. Scientometrics, 105, 709–725. https://doi.org/10.1007/s11192-015-1693-4
  5. Borman, G.D., Slavin, R.E., Cheung, A., Chamberlain, A.M., Madden, N.A., & Chambers, B. (2005). Success for all: First-year results from the national randomized field trial. Educational Evaluation and Policy Analysis, 27(1), 1 22. https://doi.org/10.3102/01623737027001001
  6. Brown, J. (2012). The current status of STEM education research. Journal of STEM Education: Innovations and Research, 13(5), 7–11.
  7. Brown, J.R., & Dant, R.P. (2008). On what makes a significant contribution to the retailing literature. Journal of Retailing, 84(2), 131 135. https://doi.org/10.1016/j.jretai.2008.05.002
  8. Campbell, D.T., & Boruch, R.F. (1975). Making the case for randomized assignment to treatments by considering the alternatives: Six ways in which quasi-experimental evaluations in compensatory education tend to underestimate effects. In C. A. Bennett & A. A. Lumsdaine (Eds.), Evaluation and experiment: Some critical issues in assessing social programs (pp. 195–296).
  9. Academic Press.
  10. Çavaş, P., Ayar, A., Bula Turuplu, S., & Gürcan, G. (2020). Türkiye’de STEM eğitimi üzerine yapılan araştırmaların durumu üzerine bir çalışma