Journals / International Journal of Assessment Tools in Education / 2019 / Cilt: 6 - Sayı: 2

Thematic Content Analysis of Studies Using Generalizability Theory

Pages
279–299
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

According to the results, there is an increase in the number of studies conducted by using G theory by years.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:One of the important theories in education and psychology is Generalizability (G) Theory and various properties distinguish it from the other measurement theories.
📊
Key Findings & Data:It reviews 60 studies, including 31 articles and 29 theses published from 2004 to 2017.
💡
Conclusion & Impact:According to the results, there is an increase in the number of studies conducted by using G theory by years.
🔬Design:Review & Systematic Survey
📍Scope:2004 Verileri
⚙️Variables:Educational sciences · Generalizability theory · Thematic content analysis

Abstract

One of the important theories in education and psychology is Generalizability (G) Theory and various properties distinguish it from the other measurement theories. To better understand methodological trends of G theory, a thematic content analysis was conducted. This study analyzes the studies using generalizability theory in the field of education in Turkey by using the method of thematic content analysis. It reviews 60 studies, including 31 articles and 29 theses published from 2004 to 2017. The selected studies underwent thematic content analysis using parameters including tagged information, aim, G Theory type, number of facets used in the study, Turkish word for “facet,” object of measurement, sample size, design type, mixed-design availability, shared results of G and D studies, computer programs, method of calculating negative variance, availability of fixed facets, and design balance. The data were interpreted on the basis of frequencies; both table and figures are included in the study. According to the results, there is an increase in the number of studies conducted by using G theory by years. Of these, many compare theories; most of them applying univariate G Theory and consider two-faceted measurement situations. While a small subset of studies features mixed design, a large group features crossed design, with individuals as the object of measurement. The computer program most commonly used in analyses is EduG. The majority of studies use balanced design. Recommendations are provided accordingly with the results.

Özet

One of the important theories in education and psychology is Generalizability (G) Theory and various properties distinguish it from the other measurement theories. To better understand methodological trends of G theory, a thematic content analysis was conducted. This study analyzes the studies using generalizability theory in the field of education in Turkey by using the method of thematic content analysis. It reviews 60 studies, including 31 articles and 29 theses published from 2004 to 2017. The selected studies underwent thematic content analysis using parameters including tagged information, aim, G Theory type, number of facets used in the study, Turkish word for “facet,” object of measurement, sample size, design type, mixed-design availability, shared results of G and D studies, computer programs, method of calculating negative variance, availability of fixed facets, and design balance. The data were interpreted on the basis of frequencies; both table and figures are included in the study. According to the results, there is an increase in the number of studies conducted by using G theory by years. Of these, many compare theories; most of them applying univariate G Theory and consider two-faceted measurement situations. While a small subset of studies features mixed design, a large group features crossed design, with individuals as the object of measurement. The computer program most commonly used in analyses is EduG. The majority of studies use balanced design. Recommendations are provided accordingly with the results.

🔖

Cite This Article

GÜLER, N., TEKER, G. T. (2022). Thematic Content Analysis of Studies Using Generalizability Theory. International Journal of Assessment Tools in Education, Cilt: 6 - Sayı: 2, 279–299. https://ajindex.com/articles/540168

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (9)

  1. Arık, R. S. & Türkmen, M. (2009). Examination of the articles in the scientific journals published in the field of educational sciences. Paper presented at I. International Congress of Educational Research, Çanakkale, Turkey. Atılgan, H. (2004). Genellenebilirlik kuramı ve çok değişkenlik kaynaklı Rasch modelinin karşılaştırılmasına ilişkin bir araştırma [A research on the comparison of the generalizability theory and many facet Rasch model] (Doctoral Dissertation). Hacettepe University, Ankara.
  2. Atılgan, H. (2013). Sample size estimation of G and Phi coefficients in generalizability theory. Eurasian Journal of Educational Research, 51, 215–228.
  3. Au, W. (2007). High-stakes testing and curricular control: A qualitative metasynthesis. Educational Researcher, 36, 258–267.
  4. Bektaş, M., Dündar, H. & Ceylan, A. (2013). Investigation of several variables papers national classroom teacher education symposium. Uşak University Journal of Social Sciences, 6(2), 201–226. DOI: http://dx.doi.org/10.12780/UUSBD167
  5. Bloch, R. & Norman, G. (2011). G String 4 user manual (Version 6.1.1). Hamilton, Ontario, Canada. Retrieved from http://fhsperd.mcmaster.ca/g_string/download/g_string_4_manual_ 611.pdf Brennan, R. L. (2011). Generalizability Theory and Classical Test Theory. Applied Measurement in Education, 24, 1–21. doi:10.1080/08957347.532417. Brennan, R. L. (2001). Generalizability Theory. New York: Springer-Verlag. Brennan, R. L. (1997). A perspective on the history of Generalizability Theory. Educational Measurement: Issues and Practice, 16(4), 14–20. https://doi.org/10.1111/j.1745-3992.1997.tb00604.x
  6. Brennan, R. L. (1992). Elements of Generalizability Theory. NY: Springer-Verlag. Çalık, M. & Sözbilir, M. (2014). Parameters of content analysis. Education and Science, 39(174), 33–38. doi:10.15390/EB.2014.3412 Çiltaş, A. (2012). Content analysis of the graduate thesis and dissertations in mathematics education in Turkey between 2005-2010. The Journal of Academic Social Science Studies, 5(7), 211–228.
  7. Çiltaş, A., Güler, G. & Sözbilir, M. (2012). Mathematics education research in Turkey: A content analysis study. Educational Sciences: Theory & Practice, 12(1), 565–580.
  8. Deliceoğlu, G. (2009). The Comparison of the reliabilities of the soccer abilities’rating scale based on the Classical Test Theory and Generalizability. (Doctoral Dissertation). Ankara University, Ankara.
  9. Doğru, M., Gençosman, T., Ataalkın, A. N. & Şeker, F. (2012). Fen bilimleri eğitiminde çalışılan yüksek lisans