Dergiler / International Journal of Assessment Tools in Education / 2022 / Cilt: 9 - Sayı: 3

Which scale short form development method is better? A Comparison of ACO, TS, and SCOFA

Sayfa
583–592
Yayın Tarihi
2022-10-18
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures.
📊
Temel Bulgular & Veri:According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit.
💡
Sonuç & Katkı:When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.
🔬Tür:Modelleme & Sayısal Simülasyon
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Short form · Scale development · Ant colony optimization

Özet

The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures. A simulation study was designed based on this purpose. Three different factor structures and three simulation conditions were selected. As the findings of this simulation study, the model-data fit and reliability coefficients were reported for each factor structure in each simulation condition. All analyses were conducted under the R environment. According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit. In a situation where the factor structure of the scale is getting more and more complex, model-data fit and Omega coefficients decrease. For scales with a unidimensional factor structure, all of the scale short-form development methods are recommended. For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended. When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.

Abstract

The purpose of this study is to identify which scale short-form development method produces better findings in different factor structures. A simulation study was designed based on this purpose. Three different factor structures and three simulation conditions were selected. As the findings of this simulation study, the model-data fit and reliability coefficients were reported for each factor structure in each simulation condition. All analyses were conducted under the R environment. According to the findings of this study, the increase in the level of misspecification and the decrease in the sample size can significantly affect the model-data fit. In a situation where the factor structure of the scale is getting more and more complex, model-data fit and Omega coefficients decrease. For scales with a unidimensional factor structure, all of the scale short-form development methods are recommended. For scales with multidimensional factor structure, Ant Colony Optimization, and Stepwise Confirmatory Factor Analysis algorithms and for scales with bifactor factor structure, the ACO algorithm is recommended. When viewed from the framework of metaheuristic algorithms, it has been identified that ACO produces better findings than Tabu Search.

🔖

Bu Makaleye Atıf Yap

KOĞAR, H. (2022). Which scale short form development method is better? A Comparison of ACO, TS, and SCOFA. International Journal of Assessment Tools in Education, Cilt: 9 - Sayı: 3, 583–592. https://ajindex.com/articles/540027

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (10)

  1. Anastasi, A. (1982). Psychological Testing (5th ed.). Macmillan. Batley, R.M., & Boss, M.W. (1993). The effects on parameter estimation of correlated dimensions and a distribution-restricted trait in a multidimensional item response model. Applied Psychological Measurement, 17(2), 131 141. https://doi.org/10.1177/014662169301700203
  2. Cayanus, J.L., & Martin, M.M. (2004). An instructor self‐disclosure scale. Communication Research Reports, 21(3), 252-263. https://doi.org/10.1080/08824090409359987
  3. Colorni, A., Dorigo, M., & Maniezzo, V. (1991). Distributed optimization by ant colonies. In: Varela, F. and Bourgine, P., Eds., Proceedings of the European Conference on Artificial Life, ECAL’91, Paris, Elsevier Publishing, Amsterdam, 134-142.
  4. Ebesutani, C., McLeish, A.C., Luberto, C.M., Young, J., & Maack, D.J. (2014). A bifactor model of anxiety sensitivity: Analysis of the Anxiety Sensitivity Index-3. Journal of Psychopathology and Behavioral Assessment, 36(3), 452 464. https://doi.org/10.1007/s10862-013-9400-3
  5. French, B.F., & Finch, W.H. (2011). Model misspecification and invariance testing using confirmatory factor analytic procedures. The Journal of Experimental Education, 79(4), 404-428. https://doi.org/10.1080/00220973.2010.517811
  6. Gatignon, H. (2010). Confirmatory Factor Analysis. In Statistical Analysis of Management Data (pp. 59-122). Springer. https://doi.org/10.1007/978-1-4419-1270-1_4
  7. Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  8. Janssen, A.B., Schultze, M., & Grötsch, A. (2017). Following the ants: Development of short scales for proactive personality and supervisor support by Ant Colony Optimization. European Journal of Psychological Assessment, 33(6), 409. https://doi.org/10.1027/1015-5759/a000299
  9. Jiang, S., Wang, C., & Weiss, D.J. (2016). Sample size requirements for estimation of item parameters in the multidimensional graded response model. Frontiers in Psychology, 7(Article:109), 1-10. https://doi.org/10.3389/fpsyg.2016.00109
  10. Jorgensen, T.D., Pornprasertmanit, S., Schoemann, A. M., Rosseel, Y., Miller, P., Quick, C.,., & Enders, C. (2016). semTools: Useful Tools for Structural Equation Modeling. R package version 0.5 4. Retrieved from https://cran.r project.org/web/packages/semTools/index.html Kleka, P., & Soroko, E. (2018). How to a