Journals / International Journal of Assessment Tools in Education / 2022 / Cilt: 9 - Sayı: 1

Item Removal Strategies Conducted in Exploratory Factor Analysis: A Comparative Study

Pages
165–180
Publication Date
2022-10-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The aim of this study is to examine how the practice of different item removal strategies during exploratory factor analysis (EFA) phase of scale development change the number of factors, factor loadings, explained variance ratio, and reliability values (α and ω) explained.
📊
Key Findings & Data:In the study, data obtained from 379 university students were used for the development of a 46-item scale.
💡
Conclusion & Impact:The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Exploratory Factor Analysis · Item removal strategies · Crossloading items

Abstract

The aim of this study is to examine how the practice of different item removal strategies during exploratory factor analysis (EFA) phase of scale development change the number of factors, factor loadings, explained variance ratio, and reliability values (α and ω) explained. In the study, data obtained from 379 university students were used for the development of a 46-item scale. As the first item removal strategy, crossloading items on two factors and where the difference between factor loadings was less than .10 were identified. Then, items were removed one by one, starting with the item with the least difference between the loadings on the factors. As the second strategy, the items that loaded on two factors and where the difference between factor loadings was less than .10 were found, and these items were removed from the scale as a whole. As the third strategy, the items that gave high loading on more than two factors and where the difference between these factors was less than .10 were identified. The item removal process was started with these items. The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed. Furthermore, the items in the factors were not all the same. The study results underscore the importance of theoretical competence in the scale development process.

Özet

The aim of this study is to examine how the practice of different item removal strategies during exploratory factor analysis (EFA) phase of scale development change the number of factors, factor loadings, explained variance ratio, and reliability values (α and ω) explained. In the study, data obtained from 379 university students were used for the development of a 46-item scale. As the first item removal strategy, crossloading items on two factors and where the difference between factor loadings was less than .10 were identified. Then, items were removed one by one, starting with the item with the least difference between the loadings on the factors. As the second strategy, the items that loaded on two factors and where the difference between factor loadings was less than .10 were found, and these items were removed from the scale as a whole. As the third strategy, the items that gave high loading on more than two factors and where the difference between these factors was less than .10 were identified. The item removal process was started with these items. The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed. Furthermore, the items in the factors were not all the same. The study results underscore the importance of theoretical competence in the scale development process.

🔖

Cite This Article

GÜVENDİR, M. A., ÖZKAN, Y. Ö. (2022). Item Removal Strategies Conducted in Exploratory Factor Analysis: A Comparative Study. International Journal of Assessment Tools in Education, Cilt: 9 - Sayı: 1, 165–180. https://ajindex.com/articles/540041

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Albayrak, A.S. (2006). Uygulamalı çok değişkenli istatistik teknikleri [Applied multivariate statistical techniques]. Asil Yayın Dağıtım. Albayrak, A.S. (2005). Çoklu doğrusal bağlantı halinde en küçük kareler tekniğinin alternatifi yanlı tahmin teknikleri ve bir uygulama [Alternative to the minimum square technique: a multi-linear connection balanced estimating techniques and an application]. Zonguldak Karaelmas Üniversitesi Sosyal Bilimler Dergisi, 1(1), 105 126. Bartlett, M.S. (1950). Tests of significance in factor analysis. British Journal of Psychology, 3, 77-85.https://doi.org/10.1111/j.2044-8317.1950.tb00285.x
  2. Basto, M., & Pereira, J.M. (2012). An SPSS R-Menu for ordinal factor analysis. Journal of statistical software, 46(4), 1-29. https://doi.org/10.18637/jss.v046.i04
  3. Bornstein, R.F. (1996). Face validity in psychological assessment: Implications for a unified model of validity. American Psychologist, 51(9), 983-984. https://doi.org/10.1037/0003-066X.51.9.983
  4. Brown, J.D. (2009). Statistics Corner Questions and answers about language testing statistics: Principal components analysis and exploratory factor analysis, In. Definitions, differences, and choices. Shiken: JALT Testing & Evaluation SIG Newsletter, 13(1), 19 - 23. https://hosted.jalt.org/test/PDF/Brown30.pdf
  5. Büyüköztürk, Ş. (2007). Veri Analizi El Kitabı [Data analysis handbook for social sciences]. Ankara:
  6. Pegem Yayınları.
  7. Bryman, A., & Cramer, D. (2011). Quantitative data analysis with IBM SPSS 17, 18 and 19: A guide for social scientists. Routledge-Cavendish/Taylor & Francis Group. Can, A. (2016). SPSS ile bilimsel araştırma sürecinde nicel veri analizi [Quantitative data analysis in the process of scientific research with SPSS]. Ankara:
  8. Pegem Akademi. Cattell, R.B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245-276. https://doi.org/10.1207/s15327906mbr0102_10
  9. Clark, L.A., & Watson, D. (2016). Constructing validity: Basic issues in objective scale development. In A. E. Kazdin (Ed.), Methodological issues and strategies in clinical research (pp. 187 203). American Psychological Association. https://doi.org/10.1037/14805-012
  10. Comrey, A.L. (1962). The minimum residual method of factor analysis. Psychological Reports, 11(1), 15-18. https://doi.org/10.2466/pr0.1962.11.1.15
  11. Comrey, A.L., & Lee, H.B. (1973). A first course in factor analysis. Academic Press.
  12. Costello, A.B., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four r