SavedAdd your journal

Journals / International Journal of Assessment Tools in Education / 2023 / Cilt: 10 Sayı: 2

Using ACER ConQuest program to examine multidimensional and many-facet models

Mahmut Sami KOYUNCU
Mehmet ŞATA
Pages
279–302
Publication Date
2023-06-26
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

If the data structure is multidimensional, appropriate multidimensional IRT analyses should be performed.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The main aim of this study was to introduce the ConQuest program, which is used in the analysis of multivariate and multidimensional data structures, and to show its applications on example data structures.
📊
Key Findings & Data:Finally, different sources of variability (e.g., item, student, rater, gender), which are both multidimensional and independent of each other, were performed by considering different sources of variability together.
💡
Conclusion & Impact:If the data structure is multidimensional, appropriate multidimensional IRT analyses should be performed.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Multidimensionality · ConQuest · Many-facet Rasch

Abstract

The main aim of this study was to introduce the ConQuest program, which is used in the analysis of multivariate and multidimensional data structures, and to show its applications on example data structures. To achieve this goal, a basic research approach was applied. Thus, how to use the ConQuest program and how to prepare the data set for analysis were explained step by step. Then, two example applications were made considering the multidimensional structures. Finally, different sources of variability (e.g., item, student, rater, gender), which are both multidimensional and independent of each other, were performed by considering different sources of variability together. According to the analyses, the dimensionality of the data structures must be examined in the analysis process. If the data structure is multidimensional, appropriate multidimensional IRT analyses should be performed.

Özet

The main aim of this study was to introduce the ConQuest program, which is used in the analysis of multivariate and multidimensional data structures, and to show its applications on example data structures. To achieve this goal, a basic research approach was applied. Thus, how to use the ConQuest program and how to prepare the data set for analysis were explained step by step. Then, two example applications were made considering the multidimensional structures. Finally, different sources of variability (e.g., item, student, rater, gender), which are both multidimensional and independent of each other, were performed by considering different sources of variability together. According to the analyses, the dimensionality of the data structures must be examined in the analysis process. If the data structure is multidimensional, appropriate multidimensional IRT analyses should be performed.

🔖

Cite This Article

KOYUNCU, M. S., ŞATA, M. (2023). Using ACER ConQuest program to examine multidimensional and many-facet models. International Journal of Assessment Tools in Education, Cilt: 10 Sayı: 2, 279–302. https://ajindex.com/articles/951357

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (9)

  1. Ackerman, T.A. (1994). Using multidimensional item response theory to understand what items and tests are measuring. Applied Measurement in Education, 7(4), 255–278. https://doi.org/10.1207/s15324818ame0704_1
  2. Adams, R.J., Wilson, M.R., & Wang, W. (1997). The Multidimensional Random Coefficients Multinomial Logit Model. Applied Psychological Measurement, 21, 1–24. https://doi.org/10.1177%2F0146621697211001
  3. Adams, R.J., Wilson, M.R., & Wu, M.L. (1997). Multilevel Item Response Models: An Approach to Errors in Variables Regression. Journal of Educational and Behavioural Statistics, 22, 46–75. https://doi.org/10.2307/1165238
  4. Adams, R., Cloney, D., Wu, M., Osses, A., Schwantner, V., & Vista, A. (2022). ACER ConQuest Manual. https://conquestmanual.acer.org/
  5. Adams, R.J, Wu, M.L, Cloney, D., and Wilson, M.R. (2020). ACER ConQuest: Generalised Item Response Modelling Software [Computer software]. Version 5. Camberwell, Victoria: Australian Council for Educational Research. Andrich, D. (1978). A Rating Formulation for Ordered Response Categories. Psychometrika, 43, 561–573. https://doi.org/10.1007/BF02293814 Bartolomé, J., & Garaizar, P. (2022). Design and Validation of a Novel Tool to Assess Citizens’ Netiquette and Information and Data Literacy Using Interactive Simulations. Sustainability, 14(6), 3392. https://doi.org/10.3390/su14063392
  6. Bock, D.R., & Aitkin, M. (1981). Marginal Maximum Likelihood Estimation of Item Parameters: An Application of the EM Algorithm. Psychometrika, 46, 443–459. https://doi.org/10.1007/BF02293801
  7. Brnic, M., & Greefrath, G. (2021, September 13–16). Does The Gender Matter? The Use of A Dıgıtal Textbook Compared To Prınted Materıals. 15th International Conference on Technology In Mathematics Teaching (ICTMT 15), Copenhagen, Denmark. Chen, J., de la Torre, J., & Zhang, Z. (2013). Relative and absolute fit evaluation in cognitive diagnosis modeling. Journal of Educational Measurement, 50(2), 123-140. https://doi.org/10.1111/j.1745-3984.2012.00185.x
  8. De Ayala, R.J. (2009). The theory and practice of ıtem response theory. Methodology in the Social Sciences. New York: Guildford. Finch, H., & Habing, B. (2003, April). Comparison of NOHARM and DETECT in item cluster recovery: Counting dimensions and allocating items. Paper presented at the annual meeting of the National Council on Measurement, Chicago. Fischer, G.H. (1983). Logistic Latent Trait Models with Linear Constraints. Psychometrika, 48, 3–26. https://doi.org/10.1007/BF02314674
  9. Hahn, I. &