SavedAdd your journal

Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2021 / Cilt: 12 - Sayı: 2

Using Generalizability Theory to Investigate the Reliability of Scores Assigned to Students in English Language Examination in Nigeria

Nijerya’da İngilizce Sınavına Katılan Öğrenci Puanlarının Güvenilirliğinin Genellenebilirlik Kuramı ile İncelenmesi

Olufunke Favour AKINDAHUNSI
Eyitayo Rufus Ifedayo AFOLABI
Pages
147–162
Publication Date
2022-10-12
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Theresults indicated the g-coefficient to be 0.90 and Φ coefficient as 0.87, which is an indication of high reliabilityof scores.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The study investigated the reliability of scores assigned to students in English language in National ExaminationsCouncil (NECO).
📊
Key Findings & Data:The population consisted of all the students who sat for NECO Senior School CertificateExamination (SSCE) in 2017 in Nigeria.
💡
Conclusion & Impact:Theresults indicated the g-coefficient to be 0.90 and Φ coefficient as 0.87, which is an indication of high reliabilityof scores.
🔬Design:Research Article
📍Scope:2017 Verileri
⚙️Variables:Domain Parameters

Abstract

The study investigated the reliability of scores assigned to students in English language in National ExaminationsCouncil (NECO). The population consisted of all the students who sat for NECO Senior School CertificateExamination (SSCE) in 2017 in Nigeria. A sample of 311,138 was selected using the proportionate stratifiedsampling technique. The Optical Marks Record (OMR) sheet containing the responses of the examinees was theinstrument for the study. The data was analyzed using lme4 package of R language and environment for statisticalcomputing, factor analysis and Tucker index of factor congruence. The psychometric properties of the data weredetermined by estimating the generalizability (g) coefficient, phi (Φ) coefficient and construct validity. Theresults indicated the g-coefficient to be 0.90 and Φ coefficient as 0.87, which is an indication of high reliabilityof scores. The result also showed that a decrease in the number of the items resulted in a decrease in both g- andphi coefficients in D-study. The construct validity of 0.99 obtained from the result affirms the credibility of theitems. Hence, it was concluded that the scores were dependable and generalizable.

🔖

Cite This Article

AKINDAHUNSI, O. F., AFOLABI, E. R. I. (2022). Using Generalizability Theory to Investigate the Reliability of Scores Assigned to Students in English Language Examination in Nigeria. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 12 - Sayı: 2, 147–162. https://ajindex.com/articles/497169

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (4)

  1. Alkharusi, H. (2012). Generalizability theory: An analysis of variance approach to measurement problems in educational assessment. Journal of Studies in Education, 2(1), 184-196. doi: 10.5296/jse.v2i1.1227 Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1-48. doi: 10.18637/jss.v067.i01 Breithaupt, K. (2011). Medical licensure testing: White paper for the assessment review task force of the medical council of Canada. Retrieved from https://www.mcc.ca/wp-content/uploads/Technical-ReportsBreithaupt-2011.pdf
  2. Brennan, R. L. (2001). Generalizability theory. New York: Springer. Brennan, R. L. (2003). Coefficients and indices in generalizability theory (CASMA Research Report Number 1). Iowa: Centre for Advanced Studies in Measurement and Assessment. Crocker, L., & Algina, J. (2008). Introduction to classical and modern test theory. U.S.A: Cengage Learning. de Gruijter, D. N., & van der Kamp, L. J. Th. (2008). Statistical test theory for the behavioural sciences. New York: Chapman & Hall/CRC. de Vries, I. M. (2012). An analysis of test construction procedures and score dependability of a paramedic recertification exam (Master’s thesis). Queen’s University Kingston, Ontario, Canada. Desjardins, C. D., & Bulut, O. (2018). Handbook of educational measurement and psychometrics using R (1 st Ed). Parkway, Boca Raton: Chapman and Hall/CRC Press. doi: 10.1201/b20498 Fosnacht, K., & Gonyea, R. M. (2018). The dependability of the updated NSSE: A generalizability study. Research and Practice in Assessment 13, 62-73. Retrieved from https://eric.ed.gov/?id=EJ1203503
  3. Gugiu, M. R., Gugiu, P. C., & Baldus, R. (2012). Utilizing generalizability theory to investigate the reliability of the grades assigned to undergraduate research papers. Journal of Multidisciplinary Evaluation, 8(19), 26-40. Retrieved from https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/362
  4. Johnson, S., & Johnson, R. (2009). Conceptualising and interpreting reliability. Coventy: Ofqual Junker, B. W. (2012). Some aspects of classical reliability theory and classical test theory. Department of Statistics, Carnegie Mellon University, Pittsburgh. Kamis, O., & Dogan, C. D. (2018). An investigation of reliability coefficients estimated for decision studies in generalizability theory. Journal of Education and Learning, 7(4), 103-113. doi: 10.5539/jel.v7n4p103 Li, M., Shavelson, R. J., Yin, Y., & Wiley, W. (20