Journals / Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi / 2015 / Cilt: 15 - Sayı: 2

COMPARISON OF TEST AND ITEM PARAMETERS UNDER GRADED RESPONSE MODEL (IRT) AND CLASSICAL TEST THEORY

AŞAMALI TEPKİ MODELİ VE KLASİK TEST KURAMI ALTINDA ELDE EDİLEN TEST VE MADDE PARAMETRELERİNİN KARŞILAŞTIRILMASI

Pages
184–197
Publication Date
2015-12-21
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The mean response of CLES scale items was 3,39 which reflected the fact that the items tended to have fairly moderate difficulty values overall.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The primary objective of the present research was to investigate the test and item parameters of Constructivist Learnin Envirement Scale (CLES) under graded response model (GRM) and classical test theory (CTT) and submit the best model which was fitted to real data.
📊
Key Findings & Data:The mean response of CLES scale items was 3,39 which reflected the fact that the items tended to have fairly moderate difficulty values overall.
💡
Conclusion & Impact:As a result, it can be colcluded that item and test parameters were highly correlated and researchers could use two methods if their assumpions were met and limitations were considerd.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Aşamalı tepki modeli · madde tepki kuramı · klasik test kuramı

Abstract

The primary objective of the present research was to investigate the test and item parameters of Constructivist Learnin Envirement Scale (CLES) under graded response model (GRM) and classical test theory (CTT) and submit the best model which was fitted to real data. The results from a traditionally reliability analysis and a eigenvalue plot indicated that CLES scale satisfied the unidimensionality assumption and reliable. The mean response of CLES scale items was 3,39 which reflected the fact that the items tended to have fairly moderate difficulty values overall. Regarding the item discrimination, there were 10 items with low discrimination values for CTT because their item dicsrimination values are less than 0,60 and .there was 3 items with a very low level for GRM analysis. Item discrimination parameters for each item ranged between 0,68 and 1,81. It should be noticed that item discriminations can be considered as generally adequate and efective at distinquishing among respondents based on their estimated trait levels. The discriminations from the graded response model and classical test theory analysis correlated highly (r=.96) with each other. As a result, it can be colcluded that item and test parameters were highly correlated and researchers could use two methods if their assumpions were met and limitations were considerd.

Özet

Bu çalışmanın temel amacı klasik test kuramı (KTK) ve aşamalı tepki modeli (ATM) altında Yapılandırmacı Öğrenme Ortamları Ölçeğinin kestirilen madde ve test parametrelerinin karşılaştırılarak, araştırmacılara hangi kuram altında kestirilen parametrelerin daha keskin ve güvenilir olduğunu sunmaktır. Geleneksel güvenirlik analizi ve özdeğer grafiği sonuçları veri grubunun tek boyutlu olduğunu ve ölçekten elde edilen sonuçların güvenilir olduğunu göstermektedir. Yapılandırmacı öğrenme ortamları ölçeği ortaokul formunun madde ortalaması 3,39 olarak hesaplanmış ve bu da orta düzeyde madde güçlüğüne karşılık gelmektedir. Madde ayırıcılık parametreleri incelendiğinde KTK altında 10 maddenin düşük ayırıcılığa sahip olduğu, ATM altında ise 3 maddenin düşük ayırıcılığa sahip olduğu ve ayırıcılık değerlerinin 0,61 ile 1,81 arasında değiştiği ortaya konmuştur. Her iki kuram altında madde ayırıcılık parametreleri arasında r=0,96 düzeyinde korelasyon bulunmuştur. Sonuç olarak her iki kuram altında kestirilen madde ve test parametrelerinin yüksek düzeyde ilişkili olduğu, model varsayımların karşılandığı ve sınırlılıkların göz önüne alındığı durumlarda her iki kuramında kullanılabileceği sonucuna ulaşılmıştır.

🔖

Cite This Article

KÖSE, İ. A. (2015). COMPARISON OF TEST AND ITEM PARAMETERS UNDER GRADED RESPONSE MODEL (IRT) AND CLASSICAL TEST THEORY. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, Cilt: 15 - Sayı: 2, 184–197. https://ajindex.com/articles/683

📄 Full Text PDF Viewer

↗New Tab

References (1)

  1. Arkün, S. & Aşkar, P. (2010). The development of a scale on assessing constructivist learning environments. HU Journal of Education, 39, 32-43 Baker, F.B. (1985). The basics of item response theory. Portsmouth, NH:Heineman Bobcock, B.G.E.(2009).Estimating a Noncompensatory IRT Model Using a modified Metropolis algorithm. Unpublished Doctoral Dissertation.The University of Minesota. Bock, R. D.,Thissen, D. & Zimowski, M.F. (1997). IRT estimation of domain scores. Journal of Educational Measurement, 34, 197-211 Chow, P. & Winzer, M.M. (1992). Reliability and validity of a scale measuring attitudes toward mainstreaming. Educational and Psychological Measurement, 52, 223-228. De Ayala, R.J., Dodd, B.G. & Koch, W.R. (1989). Acomparison of the graded response and partial credit models for assessing writing ability. Paper Presented at the Anuual Meeting of the National Council on Measurement in Education, San Francisco, CA. Demars, C. (2010). Item response theory. Understanding statistics measurement. Oxford University Press. Embretson, S.E. & Reise, S.P. (2000). Item Response Theory for Psychologists. Mahwah, NJ:Erlbaum. Gray-Little, B., Williams, V.S.L. & Hancock, T.D. (1997). An item response theory analysis of the Rosenberg Self Esteem Scale. Personality and Social Psychology Bulletin, 23, 443-451. Hambleton, R.K. & Swaminathan, H. (1985). Item Response Theory. Kluwer-Nijhoff Publishing. Boston-USA. Hambleton, R.K. & Swaminathan, H. (1989). Item Response Theory. Principles And Applications. Kluwer-Nijhoff Publishing. Boston-USA. Hambleton, R.K., Swaminathan, H.& Rogers, H.J. (1991). Fundamentals of Item Response Theory. Sage Publications, London. LaHuis, D.M., Clark, P. & O’Brien, E. (2011). An examination of item response theory item fit indices fort he graded response model. Organizational Reseach Methods, 14(1), 10-23. Lane, S., Stone, C.A., Ankenmann, R.D. & Liu, M. (1995). Examination of the assumptions and properties of the graded item response model: An example using a mathematics perfromance assessment. Applied Measurement in Education, 8(4), 313-340. Lee, K.H. (1995). Application of the graded response model to the revised Tennessee self-concept scale: Unidimensionality, parameter invariance, and differential item functioning. Unpublished Doctoral Dissertation. University of Southern California. Keith, P.R. (1983). Application of a graded response model to the assessment of job satisfaction. Unpublished Doctoral Dissertation. University of Illinois.