SavedAdd your journal

Journals / International Journal of Assessment Tools in Education / 2022 / Cilt: 9 - Sayı: 3

Which scale short form development method is better? A Comparison of ACO, TS, and SCOFA

Hakan KOĞAR
Pages
583–592
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures.
📊
Key Findings & Data:According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit.
💡
Conclusion & Impact:For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Short form · Scale development · Ant colony optimization

Abstract

The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures. A simulation study was designed based on this purpose. Three different factor structures and three simulation conditions were selected. As the findings of this simulation study, the model-data fit and reliability coefficients were reported for each factor structure in each simulation condition. All analyses were conducted under the R environment. According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit. In a situation where the factor structure of the scale is getting more and more complex, model-data fit and Omega coefficients decrease. For scales with a unidimensional factor structure, all of the scale short-form development methods are recommended. For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended. When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.

Özet

The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures. A simulation study was designed based on this purpose. Three different factor structures and three simulation conditions were selected. As the findings of this simulation study, the model-data fit and reliability coefficients were reported for each factor structure in each simulation condition. All analyses were conducted under the R environment. According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit. In a situation where the factor structure of the scale is getting more and more complex, model-data fit and Omega coefficients decrease. For scales with a unidimensional factor structure, all of the scale short-form development methods are recommended. For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended. When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.

🔖

Cite This Article

KOĞAR, H. (2022). Which scale short form development method is better? A Comparison of ACO, TS, and SCOFA. International Journal of Assessment Tools in Education, Cilt: 9 - Sayı: 3, 583–592. https://ajindex.com/articles/540027

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (10)

  1. Anastasi, A. (1982). Psychological Testing (5th ed.). Macmillan. Batley, R.M., & Boss, M.W. (1993). The effects on parameter estimation of correlated dimensions and a distribution-restricted trait in a multidimensional item response model. Applied Psychological Measurement, 17(2), 131 141. https://doi.org/10.1177/014662169301700203
  2. Cayanus, J.L., & Martin, M.M. (2004). An instructor self‐disclosure scale. Communication Research Reports, 21(3), 252-263. https://doi.org/10.1080/08824090409359987
  3. Colorni, A., Dorigo, M., & Maniezzo, V. (1991). Distributed optimization by ant colonies. In: Varela, F. and Bourgine, P., Eds., Proceedings of the European Conference on Artificial Life, ECAL’91, Paris, Elsevier Publishing, Amsterdam, 134-142.
  4. Ebesutani, C., McLeish, A.C., Luberto, C.M., Young, J., & Maack, D.J. (2014). A bifactor model of anxiety sensitivity: Analysis of the Anxiety Sensitivity Index-3. Journal of Psychopathology and Behavioral Assessment, 36(3), 452 464. https://doi.org/10.1007/s10862-013-9400-3
  5. French, B.F., & Finch, W.H. (2011). Model misspecification and invariance testing using confirmatory factor analytic procedures. The Journal of Experimental Education, 79(4), 404-428. https://doi.org/10.1080/00220973.2010.517811
  6. Gatignon, H. (2010). Confirmatory Factor Analysis. In Statistical Analysis of Management Data (pp. 59-122). Springer. https://doi.org/10.1007/978-1-4419-1270-1_4
  7. Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  8. Janssen, A.B., Schultze, M., & Grötsch, A. (2017). Following the ants: Development of short scales for proactive personality and supervisor support by Ant Colony Optimization. European Journal of Psychological Assessment, 33(6), 409. https://doi.org/10.1027/1015-5759/a000299
  9. Jiang, S., Wang, C., & Weiss, D.J. (2016). Sample size requirements for estimation of item parameters in the multidimensional graded response model. Frontiers in Psychology, 7(Article:109), 1-10. https://doi.org/10.3389/fpsyg.2016.00109
  10. Jorgensen, T.D., Pornprasertmanit, S., Schoemann, A. M., Rosseel, Y., Miller, P., Quick, C.,., & Enders, C. (2016). semTools: Useful Tools for Structural Equation Modeling. R package version 0.5 4. Retrieved from https://cran.r project.org/web/packages/semTools/index.html Kleka, P., & Soroko, E. (2018). How to a