Journals / Uludağ Üniversitesi Eğitim Fakültesi Dergisi / 2022 / Cilt: 35 - Sayı: 1

INVESTIGATING THE WORDING EFFECT IN SCALES BASED ON DIFFERENT DIMENSION REDUCTION TECHNIQUES

ÖLÇEKLERDE İFADE ETKİSİNİN FARKLI BOYUTLULUK ANALİZLERİYLE İNCELENMESİ

Pages
44–67
Publication Date
2022-04-28
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Based on the study results, some recommendations were given to researchers and practitioners regarding how to examine the dimensionality of a dataset obtained from a scale including both positively and negatively worded items.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This study aims to examine the dimensionality of a dataset obtained from the application of a multidimensional scale which is not balanced in terms of the numbers of the positively and negatively worded items based on the item response theory, DETECT, and factor analysis.
📊
Key Findings & Data:The study group consisted of 1,388 parents.
💡
Conclusion & Impact:Based on the study results, some recommendations were given to researchers and practitioners regarding how to examine the dimensionality of a dataset obtained from a scale including both positively and negatively worded items.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:ifade etkisi · yöntem etkisi · boyutluluk

Abstract

This study aims to examine the dimensionality of a dataset obtained from the application of a multidimensional scale which is not balanced in terms of the numbers of the positively and negatively worded items based on the item response theory, DETECT, and factor analysis. To this aim, a scale developed to measure parents' perceptions of their children's school was utilized. The study group consisted of 1,388 parents. The dimensionality of the dataset obtained from the scale was examined based on the item response theory, DETECT and factor analyses. The results of the three methods commonly revealed that the negatively worded items formed a separate cluster. Based on this finding, it can be stated that relations among the negatively worded items cannot only be explained by the intended trait with the scale, and the wording of the items also affect the relations among the negatively worded items. No matter what dimension reduction technique was used to analyze the data, the study results evidenced the existence of a strong wording effect in the data set. Based on the study results, some recommendations were given to researchers and practitioners regarding how to examine the dimensionality of a dataset obtained from a scale including both positively and negatively worded items.

Özet

Bu araştırmanın amacı, olumlu ve olumsuz madde sayısının dengeli olmadığı çok boyutlu bir ölçekten elde edilen verinin boyutluluğunun çok boyutlu madde tepki kuramı, DETECT ve faktör analizi yöntemlerine dayalı olarak incelenmesidir. Bu amaçla, araştırma kapsamında velilerin okula yönelik oluşturdukları algılarının ortaya çıkarılması amacıyla geliştirilmiş bir ölçek kullanılmıştır. Çalışma grubunda 1388 veli yer almıştır. Ölçeğin uygulanmasından elde edilen verinin boyutluluğu faktör analizi, çok boyutlu madde tepki kuramı ve DETECT analizine dayalı olarak incelenmiştir. Üç farklı boyutluluk analizine dayalı olarak verinin boyutluluğu incelendiğinde, tüm yöntemlerde ortak biçimde olumsuz maddelerin ayrı bir boyut oluşturduğu görülmüştür. Buna göre, olumsuz maddeler arasındaki ilişkilerin yalnızca ölçekle ölçülen özellikle açıklanamayacağı, olumsuz maddeler arasındaki ilişkiler üzerinde maddelerin ifade ediliş yönünün de etkili olduğu belirtilebilir. Bu araştırmanın bulguları, veri setinde her teknikte ortaya çıkan güçlü bir ifade etkisi olduğunu göstermiştir. Bu bulgulara dayalı olarak, araştırmacı ve uygulayıcılara olumlu ve olumsuz maddelerin birlikte kullanıldığı ölçeklerden elde edilen verinin boyutluluğunun incelenmesine ilişkin önerilerde bulunulmuştur.

🔖

Cite This Article

KARTAL, S. K., AYBEK, E. C., YAŞAR, M. (2022). INVESTIGATING THE WORDING EFFECT IN SCALES BASED ON DIFFERENT DIMENSION REDUCTION TECHNIQUES. Uludağ Üniversitesi Eğitim Fakültesi Dergisi, Cilt: 35 - Sayı: 1, 44–67. https://ajindex.com/articles/398156

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (13)

  1. Ackerman, T. A. (1992). A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. Journal of Educational Measurement, 29, 67-91.
  2. Ackerman, T. A., Gierl, M. A., & Walker, C. M. (2003). Using multidimensional item response theory to evaluate educational and psychological tests. Educational Measurement: Issues and Practice, 22, 37-53.
  3. Baker, F. B. (2001). The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation. Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems. Educational and Psychological Measurement, 60(3), 361-370.
  4. Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
  5. Büyüköztürk, Ş. (2011). Sosyal bilimler için veri analizi el kitabı. Pegem Akademi. Chalmers, R. P. (2012). A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29.
  6. Checa, I., & Espejo, B. (2018). Method effects associated with reversed items in the 29 items Spanish version of Ryff’s Well-Being Scales. Neuropsychiatry, 8(5), 1533-1540.
  7. Chen, Y., Rendina-Gobioff, G., & Dedrick, R. F. (2007). Detecting effects of positively and negatively worded items on a self-concept scale for third and sixth grade elementary students. Paper presented at the 52nd Annual Meeting of the Florida Educational Research Association. Curry, K.A & Holter, A. (2019) The Influence of Parent Social Networks on Parent Perceptions and Motivation for Involvement. Urban Education, 54(4), 535-563.
  8. Davison, M. (1977). On a metric, unidimensional unfolding model for attitudinal and developmental data. Psychometrika, 42, 523-548.
  9. De Ayala, R. J. (1994). The influence of multidimensionality on the graded response model. Applied Psychological Measurement, 18(2), 155-170.
  10. De Ayala, R. J. (2009).
  11. De Ayala, R. J. (2009). The theory and practice of item response theory. The Guilford Press.
  12. DiStefano, C., & Motl, R. W. (2009). Personality correlates of method effects due to negatively worded items on the Rosenberg Self-Esteem scale. Personality and Individual Differences, 46, 309–313.
  13. Embretson, S. E., & Reise, S.P.(2000). Item response theory for psychologists. Lawrence Erlbaum Associate, Inc. Gable, R., Murphy, C. A., Hall, C., & Clark, A.E., (1986) The Development of the Pilot Form of the Parent Attitudes toward Sc