SavedAdd your journal

Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2021 / Cilt: 12 - Sayı: 3

An Application of Multilevel Mixture Item Response Theory Model

Sedat ŞEN
Türker TOKER
Pages
226–238
Publication Date
2022-10-12
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Several suggestions were made based on the results.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Although the mixture item response theory (IRT) models are useful for heterogeneous samples, they are not capable of handling a multilevel structure that is very common in education and causes dependency between hierarchies.
📊
Key Findings & Data:Ignoring the hierarchical structure may yield less accurate results because of violation of the local independence assumption.
💡
Conclusion & Impact:Several suggestions were made based on the results.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Item response theory · mixture models · multilevel mixture item response theory

Abstract

Although the mixture item response theory (IRT) models are useful for heterogeneous samples, they are not capable of handling a multilevel structure that is very common in education and causes dependency between hierarchies. Ignoring the hierarchical structure may yield less accurate results because of violation of the local independence assumption. This interdependency can be modeled straightforwardly in a multi-level framework. In this study, a large-scale data set, TEOG exam, was analyzed with a multilevel mixture IRT model to account for dependency and heterogeneity in the data set. Sixteen different multilevel models (different class solutions) were estimated using the eighth-grade mathematics data set. Model fit statistics for these 16 models suggested the CB1C4 model (one school-level and four student-level latent classes) was the best fit model. Based on CB1C4 model, the students were classified into four latent student groups and one latent school group. Parameter estimates obtained with maximum likelihood estimation were presented and interpreted. Several suggestions were made based on the results.

🔖

Cite This Article

ŞEN, S., TOKER, T. (2022). An Application of Multilevel Mixture Item Response Theory Model. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 12 - Sayı: 3, 226–238. https://ajindex.com/articles/497175

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (4)

  1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716-723. doi: 10.1109/TAC.1974.1100705 Asparouhov, T., & Muthén, B. (2008). Multilevel mixture models. In G. R. Hancock & K. M. Samuelsen (Eds.), Advances in latent variable mixture models (pp. 27-51).
  2. Charlotte, NC: Information Age Publishing. Bacci, S., & Gnaldi, M. (2015). A classification of university courses based on students’ satisfaction: An application of a two-level mixture item response model. Quality & Quantity, 49(3), 927-940. doi: 10.1007/s11135-014-0101-0
  3. Bates, D. M., & DebRoy, S. (2004). Linear mixed models and penalized least squares. Journal of Multivariate Analysis, 91(1), 1-17. doi: 10.1016/j.jmva.2004.04.013 Bolt, D. M., Cohen, A. S., & Wollack, J. A. (2002). Item parameter estimation under conditions of test speededness: Application of a mixture Rasch model with ordinal constraints. Journal of Educational Measurement, 39(4), 331-348. doi: 10.1111/j.1745-3984.2002.tb01146.x Cho, S. J., & Cohen, A. S. (2010). A multilevel mixture IRT model with an application to DIF. Journal of Educational and Behavioral Statistics, 35(3), 336-37. doi: 10.3102/1076998609353111 Choi, Y. J., Alexeev, N., & Cohen, A. S. (2015). Differential item functioning analysis using a mixture 3-parameter logistic model with a covariate on the TIMSS 2007 mathematics test. International Journal of Testing, 15(3), 239-253. doi: 10.1080/15305058.2015.1007241 Cohen, A. S., & Bolt, D. M. (2005). A mixture model analysis of differential item functioning. Journal of Educational Measurement, 42(2), 133-148. Retrieved from https://www.jstor.org/stable/20461782
  4. Cohen, A. S., Gregg, N., & Deng, M. (2005). The role of extended time and item content on a high-stakes mathematics test. Learning Disabilities: Research and Practice, 20(4), 225-233. doi: 10.1111/j.1540-5826.2005.00138.x de Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: Guilford Publications. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates. Finch, W. H., & Finch, M. E. H. (2013). Investigation of specific learning disability and testing accommodations based differential item functioning using a multilevel multidimensional mixture item response theory model. Educational and Psychological Measurement, 73(6), 973-993. doi: 10.1177/0013164413494776 Jilke, S., Meuleman, B., & van de Walle, S. (2015).