SavedAdd your journal

Journals / Ahmet Keleşoğlu Eğitim Fakültesi Dergisi / 2023 / Cilt: 5 - Sayı: 1

Comparison of Alpha, Stratified Alpha, and Omega Reliability Coefficients in Multidimensional Test Structures

Çok Boyutlu Test Yapılarında Alfa, Tabakalı Alfa ve Omega Güvenirlik Katsayılarının Karşılaştırılması

Sümeyra SOYSAL
Pages
213–236
Publication Date
2023-03-31
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result of the research, it was found that the Stratified Alpha and Omega values were higher than the general Alpha value..

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The aim of this research is to examine the reliability of multidimensional test structures.
📊
Key Findings & Data:For this purpose, the estimations of the Cronbach Alpha, Stratified Alpha and Omega coefficients for a two-dimensional test were examined in the the data simulated under sample size (100,200 and 400), correlation between dimensions (0.00 and 0.50), correlation between items (0.30-0.50 and ≥0.65), test length (10 and 20) and the number of items per dimensions (5-5, 7-3, 10-10 and 15-1).
💡
Conclusion & Impact:As a result of the research, it was found that the Stratified Alpha and Omega values were higher than the general Alpha value..
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:güvenirlik · Cronbach alfa · tabakalı alfa

Abstract

The aim of this research is to examine the reliability of multidimensional test structures. For this purpose, the estimations of the Cronbach Alpha, Stratified Alpha and Omega coefficients for a two-dimensional test were examined in the the data simulated under sample size (100,200 and 400), correlation between dimensions (0.00 and 0.50), correlation between items (0.30-0.50 and ≥0.65), test length (10 and 20) and the number of items per dimensions (5-5, 7-3, 10-10 and 15-1). As a result of the research, it was found that the Stratified Alpha and Omega values were higher than the general Alpha value.. In addition, it was concluded that the inter-item correlation condition was more effective than the interdimensional correlation on the estimations of the three reliability coefficients.

Özet

Bu araştırmanın amacı, çok boyutlu test yapılarının güvenirliğinin incelenmesidir. Bu amaçla iki boyutlu bir test için örneklem büyüklüğü (100,200 ve 400), boyutlar arası korelasyon (0,00 ve 0,50), maddeler arası korelasyon (0,30-0,50 ve ≥0,65) , test uzunluğu (10 ve 20) ve boyutlara düşen madde sayısı (5-5, 7-3, 10-10 ve 15-1) koşulları altında üretilen verilerden Cronbach Alfa, Tabakalı Alfa ve Omega katsayılarının kestirim değerleri incelenmiştir. Araştırma sonucunda Tabakalı Alfa ve Omega değerlerinin genel Alfa değerinden yüksek fakat birbirine benzer sonuçlar verdiği bulunmuştur. Ayrıca üç güvenirlik katsayısının kestirimleri üzerinde maddeler arası korelasyon koşulunun boyutlar arası korelasyona göre daha etkili olduğu sonucuna ulaşılmıştır.

🔖

Cite This Article

SOYSAL, S. (2023). Comparison of Alpha, Stratified Alpha, and Omega Reliability Coefficients in Multidimensional Test Structures. Ahmet Keleşoğlu Eğitim Fakültesi Dergisi, Cilt: 5 - Sayı: 1, 213–236. https://ajindex.com/articles/884758

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (15)

  1. Bacon, D. R., Sauer, P. L., & Young, M. (1995). Composite Reliability in Structural Equations Modeling. Educational and Psychological Measurement, 55(3), 394-406.
  2. Brunner, M., & Süβ, H. M. (2005). Analyzing the reliability of multidimensional measures: An example from intelligence research. Educational and Psychological Measurement, 65(2), 227-240.
  3. Carmines, E. G., & Zeller, R. A. (1982). Reliability and validity assessment. Beverly Hills: Sage Publications. Cho, E., & Kim, S. (2015). Cronbach’s coefficient alpha: Well-known but poorly understood. Organizational Research Methods, 18, 207-230.
  4. Cho, E. (2016). Making reliability reliable: A systematic approach to reliability coefficients. Organizational Research Methods, 19(4), 651-682.
  5. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart & Winston. Cronbach, L. J. (1947). Test “reliability”: Its meaning and determination. Psychometrika, 12(1), 1–16.
  6. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
  7. Cronbach, L. J., Schonemann, P., & McKie, D. (1965). Alpha coefficients for stratified-paralel tests. Educational and Psychological Measurement, 25, 291-312.
  8. Cortina, J. M (1993). What is coefficient alpha? An examination of theory and application. Journal of Applied Psychology, 78, 98-104.
  9. Deng, L., & Chan, W. (2017). Testing the difference between reliability coefficients alpha and omega. Educational and psychological measurement, 77(2), 185-203.
  10. Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British journal of psychology, 105(3), 399-412.
  11. Feldt, L. S., Brennan, R. L. (1989) Reliability. In Linn RL (ed), Educational measurement (3rd ed., pp. 105–146),
  12. Macmillan. Graham, J. M. (2006). Congeneric and (Essentially) Tau-Equivalent Estimates of Score Reliability. Educational and Psychological Measurement, 66(6), 930–944.
  13. Green, S. B., Lissitz, R.W., and Mulaik, S. A. (1977). Limitations of coefficient alpha as an index of test unidimensionality. Educational and Psychological Measurement, 37, 827–838.
  14. Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10, 255-282.
  15. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. Pearson College Division. Harwell, M., Stone, C. A., Hsu, T. C., & Kirisci, L. (1996). Monte Carlo studies in item r