Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2019 / Cilt: 10 - Sayı: 4

Investigation of the Reliability of Teachers, Self and Peer Assessments at Primary School Level with Generalizability Theory

Pages
406–421
Publication Date
2022-10-12
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Especially in the music lesson, the reliability coefficients obtained by excluding teacher and peer assessments from the analysis are found to be around .60, which is a remarkable result.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This study aims at determining the reliability coefficients of teacher, self and peer assessments carried out at primary school level.
📊
Key Findings & Data:The study group consists of 30 students of the third graders from a public school in the city of Ankara.
💡
Conclusion & Impact:Especially in the music lesson, the reliability coefficients obtained by excluding teacher and peer assessments from the analysis are found to be around .60, which is a remarkable result.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

This study aims at determining the reliability coefficients of teacher, self and peer assessments carried out at primary school level. In line with this aim, an interdisciplinary approach is adopted, and the notion of helpfulness included within the scope of values education is addressed in connection with the practices followed in Turkish, social studies and music lessons. The study group consists of 30 students of the third graders from a public school in the city of Ankara. In the light of the aim of the study, the Generalizability Theory is used for the data analysis. It is found out at the end of the study that the variance component estimated for the main effect of the student is the largest component of the total variance in all three lessons. When G and Ф coefficients are examined, reliability coefficients are found to be over .80 in music, and over .90 in Turkish and social studies. According to G-Facet analysis results, when teacher and peer assessments are excluded from the analysis, respectively, G and Ф coefficients have a decreasing tendency whereas these coefficients increase when self-assessment is excluded from the analysis. Especially in the music lesson, the reliability coefficients obtained by excluding teacher and peer assessments from the analysis are found to be around .60, which is a remarkable result.

🔖

Cite This Article

ÖZTÜRK, N. B., GÜRLEN, E., EMİNOĞLU, E. (2022). Investigation of the Reliability of Teachers, Self and Peer Assessments at Primary School Level with Generalizability Theory. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 10 - Sayı: 4, 406–421. https://ajindex.com/articles/497219

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (8)

  1. Alıcı, D. (2010). Öğrenci performansının değerlendirilmesinde kullanılan diğer ölçme araç ve yöntemleri. S. Tekindal (Ed.), Eğitimde ölçme ve değerlendirme (2. Baskı) içinde (ss. 127-168). Ankara:
  2. Pegem Akademi. Atılgan, H. (2005). Genellenebilirlik kuramı ve puanlayıcılar arası güvenirlik için örnek bir uygulama. Eğitim Bilimleri ve Uygulama Dergisi, 4(7), 95-108. Retrieved from http://www.ebuline.com/pdfs/7Sayi/7_6.pdf
  3. Bahar, M. (2006). Fen ve teknoloji öğretimi. Ankara:
  4. Pegem A Yayıncılık. Bahar, M., Nartgün, Z., Durmuş, S., & Bıçak, B. (2008). Geleneksel-alternatif ölçme ve değerlendirme öğretmen el kitabı. Ankara:
  5. Pegem A Yayıncılık. Ballantyne, R., Huges, K., & Mylonas, A. (2002). Developing procedures for implementing peer assessment in large classes using an action research process. Assessment and Evaluation in Higher Education, 27(5), 427-441. doi: 10.1080/0260293022000009302 Börkan, B. (2017). Akran değerlendirmesinde puanlayıcı katılığı kayması. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 8(4), 469-489. doi: 10.21031/epod.328119 Boud, D. (1986). Implementing student self-assessment. Sydney: Higher Education Research and Development Society of Australasia. Brennan, R. L. (2001).
  6. Generalizability theory. New York, NY: Springer-Verlag Inc. Büyükkıdık, S., & Anıl, D. (2015). Performansa dayalı durum belirlemede güvenirliğin genellenebilirk kuramında farklı desenlerle incelenmesi. Eğitim ve Bilim, 40(177), 285-296. doi: 10.15390/EB.2015.2454 Çeçen, M. A. (2011). Türkçe öğretmenlerinin seviye belirleme sınavı ve Türkçe sorularına ilişkin görüşleri. Mustafa Kemal Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 8(15), 201-211. Retrieved from http://www.acarindex.com/dosyalar/makale/acarindex-1423909379.pdf
  7. Cihanoğlu, M. O. (2008). Alternatif değerlendirme yaklaşımlarından öz ve akran değerlendirmenin işbirlikli öğrenme ortamlarında akademik başarı, tutum ve kalıcılığa etkileri (Yayımlanmamış doktora tezi). Dokuz Eylül Üniversitesi Eğitim Bilimleri Enstitüsü, İzmir.
  8. Cram, B. (1995). Self-assessment: From theory to practice. Developing a workshop guide for teachers. In G. Brindley (Ed.), Language assessment in action (pp. 271-350). Sydney: National Centre for English Language Teaching and Research, Macquerie University. Doğan, C. D., & Anadol, H. Ö. (2017). Genellenebilirlik kuramında tümüyle çaprazlanmış ve maddelerin puanlayıcılara yuvalandığı desenlerin karşılaştırılması. Kastamonu Eğitim Dergisi, 25(1), 361-372. Retrieved from https://derg